2024-04-15T15:15:08.812 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T15:15:08.812 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_leonidus@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/quiesce} --verbose --name leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi --archive /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149 -- /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/orig.config.yaml 2024-04-15T15:15:08.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:15:08.946 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149 branch: wip-lusov-quiesce-xlock description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/quiesce} email: null first_in_suite: false job_id: '7657149' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-quiesce-xlock ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow request sha1: 9bf1c4ba967dd24077be6e5b87edda4ca87a6e14 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9bf1c4ba967dd24077be6e5b87edda4ca87a6e14 kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiesce-xlock sha1: 9bf1c4ba967dd24077be6e5b87edda4ca87a6e14 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5929 sha1: 9bf1c4ba967dd24077be6e5b87edda4ca87a6e14 sleep_before_teardown: 0 suite: fs suite_branch: wip-lusov-quiesce-xlock suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9bf1c4ba967dd24077be6e5b87edda4ca87a6e14 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP1yFPtNF4djnER2a5Tzj8HISpSxE2ok0zR9L2l4VyzfhRoRvmw2aI6dyBxFOcpTYbp+gzX6e4WOksp1idelL28= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbsZRMhhQTg2OkI3DiREEAPxKc834j7fqByWOCKhckGRXPuwOMkjZ42tBj+67zXyu8FZWM7Ph+skG80R37dbqU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_quiesce teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-15_14:54:08 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-15T15:15:08.946 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa; will attempt to use it 2024-04-15T15:15:08.947 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa/tasks 2024-04-15T15:15:08.947 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-15T15:15:08.948 INFO:teuthology.task.internal:Checking packages... 2024-04-15T15:15:08.973 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9bf1c4ba967dd24077be6e5b87edda4ca87a6e14' 2024-04-15T15:15:08.973 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-15T15:15:08.973 INFO:teuthology.packaging:ref: None 2024-04-15T15:15:08.973 INFO:teuthology.packaging:tag: None 2024-04-15T15:15:08.973 INFO:teuthology.packaging:branch: wip-lusov-quiesce-xlock 2024-04-15T15:15:08.973 INFO:teuthology.packaging:sha1: 9bf1c4ba967dd24077be6e5b87edda4ca87a6e14 2024-04-15T15:15:08.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-quiesce-xlock 2024-04-15T15:15:09.114 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2861-g9bf1c4ba-1jammy 2024-04-15T15:15:09.116 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-15T15:15:09.122 INFO:teuthology.task.internal:no buildpackages task found 2024-04-15T15:15:09.122 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-15T15:15:09.131 INFO:teuthology.task.internal:Saving configuration 2024-04-15T15:15:09.148 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-15T15:15:09.154 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T15:15:09.180 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 15:08:42.362777', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEsBD6ucmTdqU0b0jmiT2Q+AnCsho4jPTLmSkNYk6B3g'} 2024-04-15T15:15:09.208 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 15:08:42.360860', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDGMP9B/5MmlMUMwjXg+17aNPf+eAFmWFnMBhzQKE3jB'} 2024-04-15T15:15:09.208 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-15T15:15:09.214 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-15T15:15:09.214 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-15T15:15:09.214 INFO:teuthology.run_tasks:Running task console_log... 2024-04-15T15:15:09.297 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9d47d6f4c0>, signals=[15]) 2024-04-15T15:15:09.297 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-15T15:15:09.303 INFO:teuthology.task.internal:Opening connections... 2024-04-15T15:15:09.303 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:15:09.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:15:09.388 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:15:09.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:15:09.469 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-15T15:15:09.476 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-04-15T15:15:09.481 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-04-15T15:15:09.481 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-04-15T15:15:09.530 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-15T15:15:09.530 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2024-04-15T15:15:09.530 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="22.04" 2024-04-15T15:15:09.530 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-15T15:15:09.530 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=jammy 2024-04-15T15:15:09.531 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2024-04-15T15:15:09.531 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2024-04-15T15:15:09.531 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-15T15:15:09.531 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-15T15:15:09.531 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-15T15:15:09.531 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-15T15:15:09.531 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=jammy 2024-04-15T15:15:09.532 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-04-15T15:15:09.559 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-04-15T15:15:09.564 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-04-15T15:15:09.564 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-04-15T15:15:09.611 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-15T15:15:09.612 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2024-04-15T15:15:09.612 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="22.04" 2024-04-15T15:15:09.612 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-15T15:15:09.612 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=jammy 2024-04-15T15:15:09.612 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2024-04-15T15:15:09.612 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2024-04-15T15:15:09.612 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-15T15:15:09.612 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-15T15:15:09.612 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-15T15:15:09.612 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-15T15:15:09.613 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=jammy 2024-04-15T15:15:09.613 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-04-15T15:15:09.642 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-15T15:15:09.651 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-15T15:15:09.656 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-15T15:15:09.656 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-04-15T15:15:09.659 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2024-04-15T15:15:09.663 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-15T15:15:09.668 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-15T15:15:09.668 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-04-15T15:15:09.707 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2024-04-15T15:15:09.989 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-15T15:15:10.044 INFO:teuthology.run_tasks:Running task kernel... 2024-04-15T15:15:10.059 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-15T15:15:10.059 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-15T15:15:10.059 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-15T15:15:10.060 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T15:15:10.060 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T15:15:10.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:15:10.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-15T15:15:10.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:15:10.069 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-15T15:15:10.231 DEBUG:teuthology.task.kernel:sha1 for client.1 is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-15T15:15:10.231 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-15T15:15:10.231 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-04-15T15:15:10.236 INFO:teuthology.orchestra.run.smithi118.stdout:5.15.0-56-generic 2024-04-15T15:15:10.237 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-15T15:15:10.237 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-15T15:15:10.237 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-04-15T15:15:10.237 DEBUG:teuthology.orchestra.run.smithi118:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-15T15:15:10.297 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-15T15:15:10.376 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-15T15:15:10.376 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-15T15:15:10.376 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-04-15T15:15:10.382 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-56-generic 2024-04-15T15:15:10.382 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-15T15:15:10.382 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-15T15:15:10.382 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-15T15:15:10.382 DEBUG:teuthology.orchestra.run.smithi073:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-15T15:15:10.421 INFO:teuthology.orchestra.run.smithi118.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-15T15:15:10.422 INFO:teuthology.orchestra.run.smithi118.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-15T15:15:10.422 INFO:teuthology.orchestra.run.smithi118.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-15T15:15:10.422 INFO:teuthology.orchestra.run.smithi118.stderr:hint: 2024-04-15T15:15:10.422 INFO:teuthology.orchestra.run.smithi118.stderr:hint: git config --global init.defaultBranch 2024-04-15T15:15:10.422 INFO:teuthology.orchestra.run.smithi118.stderr:hint: 2024-04-15T15:15:10.422 INFO:teuthology.orchestra.run.smithi118.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-15T15:15:10.422 INFO:teuthology.orchestra.run.smithi118.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-15T15:15:10.422 INFO:teuthology.orchestra.run.smithi118.stderr:hint: 2024-04-15T15:15:10.422 INFO:teuthology.orchestra.run.smithi118.stderr:hint: git branch -m 2024-04-15T15:15:10.423 INFO:teuthology.orchestra.run.smithi118.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-15T15:15:10.425 DEBUG:teuthology.orchestra.run.smithi118:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-15T15:15:10.450 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-15T15:15:10.494 DEBUG:teuthology.orchestra.run.smithi118:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-15T15:15:10.554 DEBUG:teuthology.orchestra.run.smithi118:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-15T15:15:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-15T15:15:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-15T15:15:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-15T15:15:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:hint: 2024-04-15T15:15:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:hint: git config --global init.defaultBranch 2024-04-15T15:15:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:hint: 2024-04-15T15:15:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-15T15:15:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-15T15:15:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:hint: 2024-04-15T15:15:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:hint: git branch -m 2024-04-15T15:15:10.607 INFO:teuthology.orchestra.run.smithi073.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-15T15:15:10.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-15T15:15:10.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-15T15:15:10.735 DEBUG:teuthology.orchestra.run.smithi073:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-15T15:16:48.138 INFO:teuthology.orchestra.run.smithi118.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-15T15:16:48.139 INFO:teuthology.orchestra.run.smithi118.stderr: * [new branch] main -> origin/main 2024-04-15T15:16:48.173 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190312 -> 20190312 2024-04-15T15:16:48.173 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190416 -> 20190416 2024-04-15T15:16:48.173 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190514 -> 20190514 2024-04-15T15:16:48.173 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190618 -> 20190618 2024-04-15T15:16:48.173 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190717 -> 20190717 2024-04-15T15:16:48.173 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190815 -> 20190815 2024-04-15T15:16:48.173 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190923 -> 20190923 2024-04-15T15:16:48.173 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20191022 -> 20191022 2024-04-15T15:16:48.173 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20191215 -> 20191215 2024-04-15T15:16:48.173 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200122 -> 20200122 2024-04-15T15:16:48.174 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200316 -> 20200316 2024-04-15T15:16:48.176 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200421 -> 20200421 2024-04-15T15:16:48.176 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200519 -> 20200519 2024-04-15T15:16:48.176 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200619 -> 20200619 2024-04-15T15:16:48.176 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200721 -> 20200721 2024-04-15T15:16:48.176 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200817 -> 20200817 2024-04-15T15:16:48.176 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200918 -> 20200918 2024-04-15T15:16:48.176 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20201022 -> 20201022 2024-04-15T15:16:48.176 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20201118 -> 20201118 2024-04-15T15:16:48.176 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20201218 -> 20201218 2024-04-15T15:16:48.176 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210208 -> 20210208 2024-04-15T15:16:48.177 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210315 -> 20210315 2024-04-15T15:16:48.177 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210511 -> 20210511 2024-04-15T15:16:48.177 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210716 -> 20210716 2024-04-15T15:16:48.177 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210818 -> 20210818 2024-04-15T15:16:48.177 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210919 -> 20210919 2024-04-15T15:16:48.177 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20211027 -> 20211027 2024-04-15T15:16:48.177 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20211216 -> 20211216 2024-04-15T15:16:48.177 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220209 -> 20220209 2024-04-15T15:16:48.177 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220310 -> 20220310 2024-04-15T15:16:48.177 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220411 -> 20220411 2024-04-15T15:16:48.178 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220509 -> 20220509 2024-04-15T15:16:48.178 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220610 -> 20220610 2024-04-15T15:16:48.181 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220708 -> 20220708 2024-04-15T15:16:48.181 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220815 -> 20220815 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220913 -> 20220913 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20221012 -> 20221012 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20221109 -> 20221109 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20221214 -> 20221214 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230117 -> 20230117 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230210 -> 20230210 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230310 -> 20230310 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230404 -> 20230404 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230515 -> 20230515 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230625 -> 20230625 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230804 -> 20230804 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230919 -> 20230919 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20231030 -> 20231030 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20231111 -> 20231111 2024-04-15T15:16:48.182 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20231211 -> 20231211 2024-04-15T15:16:48.183 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20240115 -> 20240115 2024-04-15T15:16:48.183 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20240220 -> 20240220 2024-04-15T15:16:48.183 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20240312 -> 20240312 2024-04-15T15:16:48.183 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20240410 -> 20240410 2024-04-15T15:16:52.361 INFO:teuthology.orchestra.run.smithi118.stderr:Updating files: 48% (1763/3602) Updating files: 49% (1765/3602) Updating files: 50% (1801/3602) Updating files: 51% (1838/3602) Updating files: 52% (1874/3602) Updating files: 53% (1910/3602) Updating files: 54% (1946/3602) Updating files: 55% (1982/3602) Updating files: 56% (2018/3602) Updating files: 57% (2054/3602) Updating files: 58% (2090/3602) Updating files: 59% (2126/3602) Updating files: 60% (2162/3602) Updating files: 61% (2198/3602) Updating files: 62% (2234/3602) Updating files: 63% (2270/3602) Updating files: 63% (2290/3602) Updating files: 64% (2306/3602) Updating files: 65% (2342/3602) Updating files: 66% (2378/3602) Updating files: 67% (2414/3602) Updating files: 68% (2450/3602) Updating files: 69% (2486/3602) Updating files: 70% (2522/3602) Updating files: 71% (2558/3602) Updating files: 72% (2594/3602) Updating files: 73% (2630/3602) Updating files: 74% (2666/3602) Updating files: 75% (2702/3602) Updating files: 76% (2738/3602) Updating files: 77% (2774/3602) Updating files: 77% (2789/3602) Updating files: 78% (2810/3602) Updating files: 79% (2846/3602) Updating files: 80% (2882/3602) Updating files: 81% (2918/3602) Updating files: 82% (2954/3602) Updating files: 83% (2990/3602) Updating files: 84% (3026/3602) Updating files: 85% (3062/3602) Updating files: 86% (3098/3602) Updating files: 87% (3134/3602) Updating files: 88% (3170/3602) Updating files: 89% (3206/3602) Updating files: 90% (3242/3602) Updating files: 91% (3278/3602) Updating files: 91% (3311/3602) Updating files: 92% (3314/3602) Updating files: 93% (3350/3602) Updating files: 94% (3386/3602) Updating files: 95% (3422/3602) Updating files: 96% (3458/3602) Updating files: 97% (3494/3602) Updating files: 98% (3530/3602) Updating files: 99% (3566/3602) Updating files: 100% (3602/3602) Updating files: 100% (3602/3602), done. 2024-04-15T15:16:52.366 INFO:teuthology.orchestra.run.smithi118.stdout:HEAD is now at 5da74b16 Merge branch 'robot/pr-0-1712895838' into 'main' 2024-04-15T15:16:52.386 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.1... 2024-04-15T15:16:52.387 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-15T15:16:52.613 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-15T15:16:52.614 DEBUG:teuthology.orchestra.run.smithi118:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ --input-file=- 2024-04-15T15:16:52.616 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi118.front.sepia.ceph.com to complete... 2024-04-15T15:16:52.899 INFO:teuthology.orchestra.run.smithi073.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-15T15:16:52.899 INFO:teuthology.orchestra.run.smithi073.stderr: * [new branch] main -> origin/main 2024-04-15T15:16:52.932 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190312 -> 20190312 2024-04-15T15:16:52.932 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190416 -> 20190416 2024-04-15T15:16:52.933 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190514 -> 20190514 2024-04-15T15:16:52.933 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190618 -> 20190618 2024-04-15T15:16:52.933 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190717 -> 20190717 2024-04-15T15:16:52.934 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190815 -> 20190815 2024-04-15T15:16:52.934 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190923 -> 20190923 2024-04-15T15:16:52.934 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20191022 -> 20191022 2024-04-15T15:16:52.934 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20191215 -> 20191215 2024-04-15T15:16:52.934 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200122 -> 20200122 2024-04-15T15:16:52.935 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200316 -> 20200316 2024-04-15T15:16:52.935 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200421 -> 20200421 2024-04-15T15:16:52.935 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200519 -> 20200519 2024-04-15T15:16:52.935 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200619 -> 20200619 2024-04-15T15:16:52.935 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200721 -> 20200721 2024-04-15T15:16:52.935 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200817 -> 20200817 2024-04-15T15:16:52.935 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200918 -> 20200918 2024-04-15T15:16:52.936 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20201022 -> 20201022 2024-04-15T15:16:52.936 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20201118 -> 20201118 2024-04-15T15:16:52.936 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20201218 -> 20201218 2024-04-15T15:16:52.936 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210208 -> 20210208 2024-04-15T15:16:52.936 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210315 -> 20210315 2024-04-15T15:16:52.937 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210511 -> 20210511 2024-04-15T15:16:52.937 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210716 -> 20210716 2024-04-15T15:16:52.937 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210818 -> 20210818 2024-04-15T15:16:52.937 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210919 -> 20210919 2024-04-15T15:16:52.938 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20211027 -> 20211027 2024-04-15T15:16:52.938 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20211216 -> 20211216 2024-04-15T15:16:52.939 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220209 -> 20220209 2024-04-15T15:16:52.939 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220310 -> 20220310 2024-04-15T15:16:52.939 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220411 -> 20220411 2024-04-15T15:16:52.939 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220509 -> 20220509 2024-04-15T15:16:52.939 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220610 -> 20220610 2024-04-15T15:16:52.939 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220708 -> 20220708 2024-04-15T15:16:52.939 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220815 -> 20220815 2024-04-15T15:16:52.940 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220913 -> 20220913 2024-04-15T15:16:52.940 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20221012 -> 20221012 2024-04-15T15:16:52.940 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20221109 -> 20221109 2024-04-15T15:16:52.940 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20221214 -> 20221214 2024-04-15T15:16:52.940 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230117 -> 20230117 2024-04-15T15:16:52.941 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230210 -> 20230210 2024-04-15T15:16:52.942 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230310 -> 20230310 2024-04-15T15:16:52.942 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230404 -> 20230404 2024-04-15T15:16:52.942 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230515 -> 20230515 2024-04-15T15:16:52.942 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230625 -> 20230625 2024-04-15T15:16:52.942 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230804 -> 20230804 2024-04-15T15:16:52.942 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230919 -> 20230919 2024-04-15T15:16:52.942 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20231030 -> 20231030 2024-04-15T15:16:52.943 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20231111 -> 20231111 2024-04-15T15:16:52.943 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20231211 -> 20231211 2024-04-15T15:16:52.943 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20240115 -> 20240115 2024-04-15T15:16:52.943 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20240220 -> 20240220 2024-04-15T15:16:52.943 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20240312 -> 20240312 2024-04-15T15:16:52.944 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20240410 -> 20240410 2024-04-15T15:16:55.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15 15:16:54 URL:https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb [44839714/44839714] -> "/tmp/linux-image.deb" [1] 2024-04-15T15:16:55.119 INFO:teuthology.orchestra.run.smithi118.stderr:FINISHED --2024-04-15 15:16:54-- 2024-04-15T15:16:55.119 INFO:teuthology.orchestra.run.smithi118.stderr:Total wall clock time: 2.5s 2024-04-15T15:16:55.119 INFO:teuthology.orchestra.run.smithi118.stderr:Downloaded: 1 files, 43M in 2.1s (20.5 MB/s) 2024-04-15T15:16:55.121 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.1... 2024-04-15T15:16:55.121 DEBUG:teuthology.orchestra.run.smithi118:> sudo dpkg -i /tmp/linux-image.deb 2024-04-15T15:16:55.358 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g3f60ed14f7c1. 2024-04-15T15:16:57.140 INFO:teuthology.orchestra.run.smithi073.stderr:Updating files: 48% (1755/3602) Updating files: 49% (1765/3602) Updating files: 50% (1801/3602) Updating files: 51% (1838/3602) Updating files: 52% (1874/3602) Updating files: 53% (1910/3602) Updating files: 54% (1946/3602) Updating files: 55% (1982/3602) Updating files: 56% (2018/3602) Updating files: 57% (2054/3602) Updating files: 58% (2090/3602) Updating files: 59% (2126/3602) Updating files: 60% (2162/3602) Updating files: 61% (2198/3602) Updating files: 62% (2234/3602) Updating files: 63% (2270/3602) Updating files: 63% (2273/3602) Updating files: 64% (2306/3602) Updating files: 65% (2342/3602) Updating files: 66% (2378/3602) Updating files: 67% (2414/3602) Updating files: 68% (2450/3602) Updating files: 69% (2486/3602) Updating files: 70% (2522/3602) Updating files: 71% (2558/3602) Updating files: 72% (2594/3602) Updating files: 73% (2630/3602) Updating files: 74% (2666/3602) Updating files: 75% (2702/3602) Updating files: 76% (2738/3602) Updating files: 77% (2774/3602) Updating files: 77% (2789/3602) Updating files: 78% (2810/3602) Updating files: 79% (2846/3602) Updating files: 80% (2882/3602) Updating files: 81% (2918/3602) Updating files: 82% (2954/3602) Updating files: 83% (2990/3602) Updating files: 84% (3026/3602) Updating files: 85% (3062/3602) Updating files: 86% (3098/3602) Updating files: 87% (3134/3602) Updating files: 88% (3170/3602) Updating files: 89% (3206/3602) Updating files: 89% (3207/3602) Updating files: 90% (3242/3602) Updating files: 91% (3278/3602) Updating files: 92% (3314/3602) Updating files: 93% (3350/3602) Updating files: 94% (3386/3602) Updating files: 95% (3422/3602) Updating files: 96% (3458/3602) Updating files: 97% (3494/3602) Updating files: 98% (3530/3602) Updating files: 99% (3566/3602) Updating files: 100% (3602/3602) Updating files: 100% (3602/3602), done. 2024-04-15T15:16:57.145 INFO:teuthology.orchestra.run.smithi073.stdout:HEAD is now at 5da74b16 Merge branch 'robot/pr-0-1712895838' into 'main' 2024-04-15T15:16:57.166 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-15T15:16:57.166 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-15T15:16:57.369 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-15T15:16:57.374 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-15T15:16:57.450 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-15T15:16:57.451 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ --input-file=- 2024-04-15T15:16:57.453 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi073.front.sepia.ceph.com to complete... 2024-04-15T15:16:57.537 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-15T15:16:59.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15 15:16:58 URL:https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb [44839714/44839714] -> "/tmp/linux-image.deb" [1] 2024-04-15T15:16:59.137 INFO:teuthology.orchestra.run.smithi073.stderr:FINISHED --2024-04-15 15:16:58-- 2024-04-15T15:16:59.137 INFO:teuthology.orchestra.run.smithi073.stderr:Total wall clock time: 1.7s 2024-04-15T15:16:59.137 INFO:teuthology.orchestra.run.smithi073.stderr:Downloaded: 1 files, 43M in 1.5s (27.7 MB/s) 2024-04-15T15:16:59.141 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-15T15:16:59.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo dpkg -i /tmp/linux-image.deb 2024-04-15T15:16:59.389 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g3f60ed14f7c1. 2024-04-15T15:17:01.382 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-15T15:17:01.386 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-15T15:17:01.505 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-15T15:17:02.032 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-15T15:17:02.141 INFO:teuthology.orchestra.run.smithi118.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:05.625 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-15T15:17:05.748 INFO:teuthology.orchestra.run.smithi073.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:25.775 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub' 2024-04-15T15:17:25.788 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-15T15:17:25.815 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2024-04-15T15:17:26.155 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:26.175 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:26.532 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-15T15:17:26.548 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-15T15:17:26.611 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-15T15:17:26.617 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-15T15:17:26.784 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-15T15:17:26.784 INFO:teuthology.orchestra.run.smithi118.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-15T15:17:26.784 INFO:teuthology.orchestra.run.smithi118.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-15T15:17:26.820 INFO:teuthology.orchestra.run.smithi118.stderr:done 2024-04-15T15:17:27.046 DEBUG:teuthology.orchestra.run.smithi118:> dpkg-deb -c /tmp/linux-image.deb 2024-04-15T15:17:27.046 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2024-04-15T15:17:27.053 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./ 2024-04-15T15:17:27.053 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./boot/ 2024-04-15T15:17:27.053 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7002012 2024-04-11 18:50 ./boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:27.060 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-15T15:17:27.071 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 172073 2024-04-11 18:50 ./boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:27.071 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13120512 2024-04-11 18:50 ./boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:27.092 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/ 2024-04-15T15:17:27.092 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/ 2024-04-15T15:17:27.092 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postinst.d/ 2024-04-15T15:17:27.092 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postrm.d/ 2024-04-15T15:17:27.092 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/preinst.d/ 2024-04-15T15:17:27.092 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/prerm.d/ 2024-04-15T15:17:27.092 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/ 2024-04-15T15:17:27.092 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/ 2024-04-15T15:17:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/ 2024-04-15T15:17:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/ 2024-04-15T15:17:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/ 2024-04-15T15:17:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/ 2024-04-15T15:17:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ 2024-04-15T15:17:27.093 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 507569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-15T15:17:27.095 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-15T15:17:27.095 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-15T15:17:27.095 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-15T15:17:27.095 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 109905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 155249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 87009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-15T15:17:27.096 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-15T15:17:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-15T15:17:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-15T15:17:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/ 2024-04-15T15:17:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/ 2024-04-15T15:17:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/ 2024-04-15T15:17:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-15T15:17:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpuid.ko 2024-04-15T15:17:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/msr.ko 2024-04-15T15:17:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/ 2024-04-15T15:17:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 444425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-15T15:17:27.098 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1035881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-15T15:17:27.098 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 2849609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-15T15:17:27.113 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ 2024-04-15T15:17:27.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/af_alg.ko 2024-04-15T15:17:27.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_hash.ko 2024-04-15T15:17:27.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_skcipher.ko 2024-04-15T15:17:27.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-15T15:17:27.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-15T15:17:27.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-15T15:17:27.113 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/ 2024-04-15T15:17:27.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-15T15:17:27.113 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/ 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-15T15:17:27.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cryptd.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_simd.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-15T15:17:27.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lrw.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-15T15:17:27.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 169065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xts.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_extlog.ko 2024-04-15T15:17:27.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/ 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/einj.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 119033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 96825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 107737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci.ko 2024-04-15T15:17:27.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-15T15:17:27.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-15T15:17:27.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-15T15:17:27.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-15T15:17:27.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-15T15:17:27.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-15T15:17:27.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_legacy.ko 2024-04-15T15:17:27.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-15T15:17:27.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-15T15:17:27.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-15T15:17:27.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_radisys.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rz1000.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-15T15:17:27.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 102121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-15T15:17:27.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-15T15:17:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-15T15:17:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-15T15:17:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-15T15:17:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-15T15:17:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ 2024-04-15T15:17:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-15T15:17:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/ 2024-04-15T15:17:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 163969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-15T15:17:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/ 2024-04-15T15:17:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/ 2024-04-15T15:17:27.124 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 140865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-15T15:17:27.124 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/ 2024-04-15T15:17:27.124 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1241657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-15T15:17:27.125 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-04-15T15:17:27.165 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 203289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/ 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 115265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 143433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/ 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 126617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 119873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 313217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/ 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 117233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/ 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-15T15:17:27.166 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/applicom.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/ 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 186921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 179561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-15T15:17:27.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/ 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 103409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/nvram.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/ 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-15T15:17:27.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/ 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/ 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-palmas.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-si5351.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-twl6040.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-wm831x.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/ 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-15T15:17:27.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 89257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 333657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/ 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/ 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 751713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-15T15:17:27.170 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/ 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 90441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/ 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/ 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 146769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 96145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-15T15:17:27.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 64161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/ 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-gpio.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max14577.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max77693.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max8997.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-palmas.ko 2024-04-15T15:17:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/ 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/ 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/ 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-arizona.ko 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9052.ko 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9055.ko 2024-04-15T15:17:27.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-dln2.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 81073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-generic.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-kempld.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max7300.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max730x.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max732x.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-15T15:17:27.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-vx855.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/ 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-a4tech.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-apple.ko 2024-04-15T15:17:27.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-belkin.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cherry.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-chicony.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 74393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cp2112.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cypress.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ezkey.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-15T15:17:27.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-generic.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kensington.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lg-g15.ko 2024-04-15T15:17:27.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 121369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-magicmouse.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-microsoft.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-monterey.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ntrig.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-15T15:17:27.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-15T15:17:27.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-15T15:17:27.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 81113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 184745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 319921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/ 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 153633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 261945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/ 2024-04-15T15:17:27.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 75065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 110681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 382033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 115057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-15T15:17:27.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 89025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 81473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-15T15:17:27.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 113201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc2103.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 108961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-15T15:17:27.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 56313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hih6130.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 156465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-15T15:17:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/jc42.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 86497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-15T15:17:27.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 131505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-15T15:17:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 56505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 141353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 97777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-15T15:17:27.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-15T15:17:27.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-15T15:17:27.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 71169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 96577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 75129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 83425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 116777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 134441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-15T15:17:27.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/ 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/ 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/ 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-15T15:17:27.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 64233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 76969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-15T15:17:27.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-15T15:17:27.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/ 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 329697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-15T15:17:27.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1119913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 83905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 408433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 120921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 347217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 84945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 590929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/ 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 514641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/ 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 911665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 375545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-15T15:17:27.196 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 197121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/ 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 212553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 334401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 120673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 132585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 157937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ 2024-04-15T15:17:27.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 156673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/evbug.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ff-memless.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/ 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/ 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-15T15:17:27.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8323.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8333.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt1070.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt2160.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-15T15:17:27.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/stowaway.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/matrix-keymap.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/ 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 160017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 114273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 428185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/psmouse.ko 2024-04-15T15:17:27.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/ 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 140969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ct82c710.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/parkbd.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/pcips2.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ps2mult.ko 2024-04-15T15:17:27.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serport.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/ 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-88pm860x.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-adp5520.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-bd2802.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da903x.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da9052.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-gpio.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3533.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm355x.ko 2024-04-15T15:17:27.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3642.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp8788.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-max8997.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-mc13783.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca9532.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca955x.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca963x.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-tca6507.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm8350.ko 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ 2024-04-15T15:17:27.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/ 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/ 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 790753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 116825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bufio.ko 2024-04-15T15:17:27.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 199041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 134945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-era.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-mirror.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 97209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-region-hash.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-15T15:17:27.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-snapshot.ko 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 234457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-zero.ko 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/ 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 264329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 125009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 157681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-15T15:17:27.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 444665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-15T15:17:27.250 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/ 2024-04-15T15:17:27.250 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/ 2024-04-15T15:17:27.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 214841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-15T15:17:27.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-15T15:17:27.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-15T15:17:27.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-15T15:17:27.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 150761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-15T15:17:27.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 97281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-15T15:17:27.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 63873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-15T15:17:27.250 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/ 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm800.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm805.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm80x.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona-i2c.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 148633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/bcm590xx.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/dln2.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/janz-cmodio.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/kempld-core.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-core.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lp3943.ko 2024-04-15T15:17:27.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/max8907.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/menf21bmc.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/retu-mfd.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 99425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/si476x-core.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps65010.ko 2024-04-15T15:17:27.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps6507x.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wm8994.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 64265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/ 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/ 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-15T15:17:27.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/core.ko 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/ 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ds1682.ko 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/dummy-irq.ko 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/ 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/echo.ko 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/ 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/ 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 191649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-15T15:17:27.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hmc6352.ko 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 92345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ics932s401.ko 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/ 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/ 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 154169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-15T15:17:27.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 389033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/phantom.ko 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/ 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/ 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 234905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/ 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 620961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/ 2024-04-15T15:17:27.256 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/ 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 587065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/ 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 158649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-15T15:17:27.257 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 109521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/ 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 64705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/ 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 84329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/ 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/ 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-15T15:17:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/ 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 56057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 115881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/ 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 124497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 128409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 110345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 88953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/ 2024-04-15T15:17:27.259 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 105633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 228985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1733353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 167185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 161417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 440625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/ 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 432201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/ 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 257201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-15T15:17:27.260 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 446177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1311433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 206689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/ 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 269313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/ 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 169089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-15T15:17:27.261 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 76209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/ 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 75945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/ 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 356377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 63185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/ 2024-04-15T15:17:27.262 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 115569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 366217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 755793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 324577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1196297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 362593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/ 2024-04-15T15:17:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 671801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 121537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 966705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 193585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 108633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/ 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 126881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 150777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/ 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-15T15:17:27.264 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 905033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 344145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1412417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 117353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/ 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 131425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ 2024-04-15T15:17:27.265 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 56689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/ 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 181081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/ 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 171417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/ 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/ 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 300817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 105689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-15T15:17:27.266 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 885129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/ 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/ 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 81641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 100689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 264161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/ 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 142449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/ 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1350385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/ 2024-04-15T15:17:27.267 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-15T15:17:27.268 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/ 2024-04-15T15:17:27.268 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-15T15:17:27.268 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 80065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-15T15:17:27.268 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/ 2024-04-15T15:17:27.268 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 74289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-15T15:17:27.268 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 79457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-15T15:17:27.268 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 100785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-15T15:17:27.269 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 83441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-15T15:17:27.269 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/ 2024-04-15T15:17:27.269 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 644537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/ 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 128497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 207993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 82633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/ 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/ 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 110729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-15T15:17:27.270 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/ 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 98689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 102513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/ 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/ 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/ 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/defxx.ko 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/ 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 275801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/ 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 290441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-15T15:17:27.271 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/ 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 108329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/ 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-15T15:17:27.272 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/ 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-15T15:17:27.273 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 103377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 96025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 121105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/ 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/plip.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-15T15:17:27.274 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sb1000.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/ 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 80161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/ 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 137321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-15T15:17:27.275 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 108089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/ 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 176497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/ 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 383593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/ 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 175537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/ 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/ 2024-04-15T15:17:27.276 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 335857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 126553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/ 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 168145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 103889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/ 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/ 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pci-stub.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/ 2024-04-15T15:17:27.277 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 179961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia.ko 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 133753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/ 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/ 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/ 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/ 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/ 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-15T15:17:27.278 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/ 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/ 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 87481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-15T15:17:27.279 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 164769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/ 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-15T15:17:27.280 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/ 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 73073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-15T15:17:27.281 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9030_battery.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9052-battery.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/gpio-charger.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max14577_charger.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max17042_battery.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8903_charger.ko 2024-04-15T15:17:27.282 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8925_power.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/sbs-battery.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/test_power.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_power.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm8350_power.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/ 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 73297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/ 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/ 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-15T15:17:27.283 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/ 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/ 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/ 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/ 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-15T15:17:27.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9052.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9055.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9063.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 82225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-15T15:17:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8907.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8925.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8997.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8998.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-15T15:17:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-palmas.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 56777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-15T15:17:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 90377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 164569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/ 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 340721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 120337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-15T15:17:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/ 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 468081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 380673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/ 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 243705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/ 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 135617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/ 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 304993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/ 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1527113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/ 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 297801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-15T15:17:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/ 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 144401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/ 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 390713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/ 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 88881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 117481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 173017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/ 2024-04-15T15:17:27.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 267577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/ 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 95329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 194017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fdomain.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/ 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 366529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 251505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/imm.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 327841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 129785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/ 2024-04-15T15:17:27.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 397785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-15T15:17:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-15T15:17:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 63121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-15T15:17:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/ 2024-04-15T15:17:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 386849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-15T15:17:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 178177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-15T15:17:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 64809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-15T15:17:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/ 2024-04-15T15:17:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 274009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-15T15:17:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/ 2024-04-15T15:17:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 2736001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-15T15:17:27.333 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/ 2024-04-15T15:17:27.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 88529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-15T15:17:27.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-15T15:17:27.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 389177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-15T15:17:27.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 104769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-15T15:17:27.333 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/ 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 836945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/ 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 158729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 96537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/ 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/ 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 443745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 152033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-15T15:17:27.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ppa.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/ 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 2324809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 103601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/ 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 697337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qlogicfas408.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 322865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 219857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 357153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 121185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 93481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-15T15:17:27.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 138121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 205025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/xen-scsifront.ko 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 174913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/ 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/ 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 920169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-15T15:17:27.336 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/ 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1170033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 149721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/ 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 90057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/ 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/ 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-15T15:17:27.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-15T15:17:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 99313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/moxa.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/mxser.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 134401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/ 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/ 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-15T15:17:27.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_uart.ko 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/ 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 120577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/rp2.ko 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/ 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 693081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-15T15:17:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/ 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_mf624.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_netx.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/ 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/ 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 90321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 189209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-15T15:17:27.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/ 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 63073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 56721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 107417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ulpi.ko 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/ 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/ 2024-04-15T15:17:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 574593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/ 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/ 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 131345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 146617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-15T15:17:27.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 71257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 84937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/ 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-15T15:17:27.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 204049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/ 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 182561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-15T15:17:27.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 90313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 90361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 94841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 87465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 95441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 195969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 108321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 104377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 102273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-15T15:17:27.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811_cs.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/ 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cytherm.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ehset.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-15T15:17:27.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/lvstest.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/ 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 84265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbtest.ko 2024-04-15T15:17:27.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/ 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/usbmon.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/ 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 396209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/ 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-15T15:17:27.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/f81232.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 188609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 152305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 142833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-15T15:17:27.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 122329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/metro-usb.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 89969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mxuport.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 193857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-15T15:17:27.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 151137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usbserial.ko 2024-04-15T15:17:27.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 64049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-15T15:17:27.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 201193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/ 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 76041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 122321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/ 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/ 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 206921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-15T15:17:27.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 134265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 93673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/ 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 138721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 71281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 107905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/ 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/ 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-15T15:17:27.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/bd6107.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-15T15:17:27.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/ 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/ 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-15T15:17:27.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 129433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/acquirewdt.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/advantechwdt.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-15T15:17:27.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/dw_wdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-15T15:17:27.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/retu_wdt.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-15T15:17:27.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-15T15:17:27.361 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/ 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/ 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 213913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-scsiback.ko 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/ 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/ 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 192617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/ 2024-04-15T15:17:27.362 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/adfs.ko 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/ 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 197849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/ 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1261113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/kafs.ko 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/ 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 127377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/autofs4.ko 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/ 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/ 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/bfs.ko 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/ 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 4489593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/ 2024-04-15T15:17:27.363 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 376857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1586089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/ 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 130073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/ 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 139081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/configfs.ko 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/ 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/ 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 813225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/ 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/efs.ko 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/ 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1906817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-15T15:17:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/ 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/ 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/freevxfs.ko 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/ 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/ 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1486521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/ 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 183305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/ 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 282097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/ 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 249009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/hpfs.ko 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/ 2024-04-15T15:17:27.365 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 93033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/ 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 533073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/ 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 361369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/ 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 112609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/ 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 591585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/ 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/ 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 102561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/ 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 74353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-15T15:17:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/ 2024-04-15T15:17:27.367 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 147689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-15T15:17:27.367 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1320249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-15T15:17:27.367 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 82105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv2.ko 2024-04-15T15:17:27.367 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 151641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-15T15:17:27.367 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 2518505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-15T15:17:27.367 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/ 2024-04-15T15:17:27.367 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-15T15:17:27.367 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-15T15:17:27.367 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/ 2024-04-15T15:17:27.367 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 2024049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-15T15:17:27.417 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/ 2024-04-15T15:17:27.417 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 734025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-15T15:17:27.417 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/ 2024-04-15T15:17:27.417 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-15T15:17:27.417 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-15T15:17:27.417 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-15T15:17:27.417 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-15T15:17:27.417 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ascii.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-15T15:17:27.418 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 95625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 144209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-15T15:17:27.419 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 167137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 119513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-15T15:17:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 302073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 548169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 3245617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-15T15:17:27.421 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/ 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/omfs.ko 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/ 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 462873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/ 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/qnx4.ko 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/ 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 56097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/qnx6.ko 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/ 2024-04-15T15:17:27.422 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_tree.ko 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v1.ko 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v2.ko 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/ 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 684841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/ 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/ 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/ 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 3319041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/ 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/ 2024-04-15T15:17:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 164185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/ 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 115977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/ 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 310017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 198233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/ 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 5192705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/ 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/ 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 97625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/locktorture.ko 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/ 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/test_udelay.ko 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-15T15:17:27.424 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc7.ko 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/ 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/interval_tree_test.ko 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/ 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/ 2024-04-15T15:17:27.425 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/memory-notifier-error-inject.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/notifier-error-inject.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/percpu_test.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/pm-notifier-error-inject.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/ 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 152025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/rbtree_test.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/ 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test-kstrtox.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 4912441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_bpf.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_firmware.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_module.ko 2024-04-15T15:17:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_user_copy.ko 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/ 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/xz_dec_test.ko 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/ 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/ 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-15T15:17:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/ 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/ 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 106793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/ 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 236793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-15T15:17:27.428 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/ 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 879697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/ 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 84761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1030873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-15T15:17:27.429 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-15T15:17:27.430 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/ 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1243505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/ 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 153801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/ 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 244889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 71033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 74993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/ 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 507705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-15T15:17:27.431 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/ 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 128873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/hsr.ko 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 357425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-15T15:17:27.432 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 75489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-15T15:17:27.433 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-15T15:17:27.434 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-15T15:17:27.435 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-15T15:17:27.436 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 103177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_gre.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 118881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 71089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/mip6.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-15T15:17:27.437 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-15T15:17:27.438 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 94089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/ 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 106369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/ 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 153217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-15T15:17:27.439 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/ 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 63345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/lapb.ko 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/ 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 332889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc2.ko 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/ 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 388873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/ 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ 2024-04-15T15:17:27.440 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 147745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 124041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 124345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 126681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 126473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 137833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 133681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 139073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 138265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 136177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-15T15:17:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 139897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 534113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-15T15:17:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 496817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 134377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 140801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-15T15:17:27.443 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 79873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 117201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 118369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-15T15:17:27.444 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 807985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-15T15:17:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_osf.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_synproxy.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tproxy.ko 2024-04-15T15:17:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 108393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/x_tables.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-15T15:17:27.447 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-15T15:17:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-15T15:17:27.449 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-15T15:17:27.450 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-15T15:17:27.451 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpudp.ko 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/ 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/ 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/ 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 488825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-15T15:17:27.452 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/ 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/ 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 142025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/phonet.ko 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/pn_pep.ko 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/ 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 318617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 202305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/ 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1027897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/rxrpc.ko 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/ 2024-04-15T15:17:27.453 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_cgroup.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-15T15:17:27.454 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 79145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq_codel.ko 2024-04-15T15:17:27.455 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 81833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-15T15:17:27.456 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/ 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1187313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/ 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/ 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 432409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1940889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/ 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 890729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-15T15:17:27.457 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/ 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1122337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/ 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/ 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 105609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 90265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 123769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/ 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 165841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/x25.ko 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/ 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_algo.ko 2024-04-15T15:17:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-15T15:17:27.459 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 131865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_user.ko 2024-04-15T15:17:27.459 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 644769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-15T15:17:27.459 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 628542 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-15T15:17:27.461 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7706 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-15T15:17:27.461 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-15T15:17:27.461 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9941 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-15T15:17:27.461 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70990 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 146959 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 232835 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 210 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72602 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 879 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 258450 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 313019 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/ 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/ 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/ 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 174 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/changelog.Debian.gz 2024-04-15T15:17:27.462 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 691 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/copyright 2024-04-15T15:17:27.468 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:27.468 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:27.468 DEBUG:teuthology.orchestra.run.smithi118:> egrep '(submenu|menuentry.*6.9.0-rc3-g3f60ed14f7c1).*{' /boot/grub/grub.cfg 2024-04-15T15:17:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:27.511 INFO:teuthology.orchestra.run.smithi118.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-15T15:17:27.511 INFO:teuthology.orchestra.run.smithi118.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-15T15:17:27.511 INFO:teuthology.orchestra.run.smithi118.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-15T15:17:27.511 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-15T15:17:27.511 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:27.512 DEBUG:teuthology.orchestra.run.smithi118:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-15T15:17:27.513 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:27.554 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi118.front.sepia.ceph.com to complete... 2024-04-15T15:17:27.909 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-15T15:17:27.919 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-15T15:17:27.978 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub' 2024-04-15T15:17:27.979 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-15T15:17:27.979 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-15T15:17:27.985 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-15T15:17:28.000 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2024-04-15T15:17:28.136 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-15T15:17:28.136 INFO:teuthology.orchestra.run.smithi073.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-15T15:17:28.136 INFO:teuthology.orchestra.run.smithi073.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-15T15:17:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-04-15T15:17:28.227 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:28.233 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:28.359 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-deb -c /tmp/linux-image.deb 2024-04-15T15:17:28.411 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./ 2024-04-15T15:17:28.411 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./boot/ 2024-04-15T15:17:28.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7002012 2024-04-11 18:50 ./boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:28.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 172073 2024-04-11 18:50 ./boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:28.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13120512 2024-04-11 18:50 ./boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:28.452 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/ 2024-04-15T15:17:28.452 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/ 2024-04-15T15:17:28.452 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postinst.d/ 2024-04-15T15:17:28.452 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postrm.d/ 2024-04-15T15:17:28.452 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/preinst.d/ 2024-04-15T15:17:28.452 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/prerm.d/ 2024-04-15T15:17:28.452 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/ 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/ 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/ 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/ 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/ 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/ 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 507569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-15T15:17:28.453 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 109905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 155249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-15T15:17:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-15T15:17:28.455 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/ 2024-04-15T15:17:28.455 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/ 2024-04-15T15:17:28.455 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/ 2024-04-15T15:17:28.455 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-15T15:17:28.455 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpuid.ko 2024-04-15T15:17:28.455 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/msr.ko 2024-04-15T15:17:28.455 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/ 2024-04-15T15:17:28.455 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 444425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-15T15:17:28.455 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1035881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-15T15:17:28.456 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-15T15:17:28.456 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2849609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-15T15:17:28.464 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-15T15:17:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-15T15:17:28.510 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/af_alg.ko 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_hash.ko 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_skcipher.ko 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/ 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/ 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-15T15:17:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-15T15:17:28.552 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cryptd.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_simd.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-15T15:17:28.553 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lrw.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 169065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-15T15:17:28.554 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xts.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_extlog.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-15T15:17:28.555 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/ 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/einj.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 96825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 107737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-15T15:17:28.556 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-15T15:17:28.557 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_legacy.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-15T15:17:28.558 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_radisys.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rz1000.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-15T15:17:28.559 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-15T15:17:28.560 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/ 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 163969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/ 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/ 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 140865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/ 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1241657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 203289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/ 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 143433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-15T15:17:28.561 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/ 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 126617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 313217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/ 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 117233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/ 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/applicom.ko 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/ 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-15T15:17:28.562 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 186921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 179561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/ 2024-04-15T15:17:28.563 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/nvram.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/ 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/ 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-15T15:17:28.564 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/ 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-palmas.ko 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-si5351.ko 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-twl6040.ko 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-wm831x.ko 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/ 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ 2024-04-15T15:17:28.565 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 333657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/ 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/ 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 751713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/ 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-15T15:17:28.566 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/ 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/ 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 146769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 96145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-15T15:17:28.567 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/ 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-gpio.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max14577.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max77693.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max8997.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-palmas.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-15T15:17:28.568 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-15T15:17:28.569 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/ 2024-04-15T15:17:28.569 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-15T15:17:28.569 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/ 2024-04-15T15:17:28.569 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-15T15:17:28.569 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-15T15:17:28.569 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/ 2024-04-15T15:17:28.569 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-15T15:17:28.569 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-15T15:17:28.569 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-arizona.ko 2024-04-15T15:17:28.569 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9052.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9055.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-dln2.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-generic.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-kempld.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max7300.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max730x.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max732x.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-15T15:17:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-vx855.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-15T15:17:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/ 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-a4tech.ko 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-apple.ko 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-belkin.ko 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cherry.ko 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-chicony.ko 2024-04-15T15:17:28.572 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cp2112.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cypress.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ezkey.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-generic.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-15T15:17:28.573 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kensington.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lg-g15.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 121369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-magicmouse.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-microsoft.ko 2024-04-15T15:17:28.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-monterey.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ntrig.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 91241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-15T15:17:28.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-15T15:17:28.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 184745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-15T15:17:28.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 319921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid.ko 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/ 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 153633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 261945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/ 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 110681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 382033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-15T15:17:28.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-15T15:17:28.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 113201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-15T15:17:28.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc2103.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-15T15:17:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hih6130.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 156465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/jc42.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-15T15:17:28.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 86497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 131505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-15T15:17:28.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-15T15:17:28.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 141353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-15T15:17:28.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-15T15:17:28.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-15T15:17:28.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 96577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 116777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 134441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/ 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/ 2024-04-15T15:17:28.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/ 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-15T15:17:28.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 76969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-15T15:17:28.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-15T15:17:28.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/ 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 329697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1119913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 408433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 120921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 347217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-15T15:17:28.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 590929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/ 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 514641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/ 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 911665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 375545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 197121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/ 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 212553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ 2024-04-15T15:17:28.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 334401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 120673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 132585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 157937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 156673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/evbug.ko 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ff-memless.ko 2024-04-15T15:17:28.594 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/ 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/ 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8323.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8333.ko 2024-04-15T15:17:28.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt1070.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt2160.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/stowaway.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-15T15:17:28.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/matrix-keymap.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/ 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 160017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 114273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 428185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/psmouse.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-15T15:17:28.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/ 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 140969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ct82c710.ko 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/parkbd.ko 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/pcips2.ko 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ps2mult.ko 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-15T15:17:28.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serport.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/ 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-88pm860x.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-adp5520.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-bd2802.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da903x.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da9052.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-gpio.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3533.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm355x.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3642.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-15T15:17:28.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp8788.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-max8997.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-mc13783.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca9532.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca955x.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca963x.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-tca6507.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm8350.ko 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ 2024-04-15T15:17:28.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/ 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/ 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 790753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-15T15:17:28.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 116825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bufio.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 199041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 134945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-era.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-mirror.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-15T15:17:28.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-region-hash.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-snapshot.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 234457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-zero.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/ 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 264329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 157681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 444665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/ 2024-04-15T15:17:28.603 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/ 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 214841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 150761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/ 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm800.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm805.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm80x.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona-i2c.ko 2024-04-15T15:17:28.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 148633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/bcm590xx.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/dln2.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/janz-cmodio.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/kempld-core.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-core.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lp3943.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/max8907.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-15T15:17:28.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/menf21bmc.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/retu-mfd.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 99425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/si476x-core.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps65010.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps6507x.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-15T15:17:28.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wm8994.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/ 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/ 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/core.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/ 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ds1682.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/dummy-irq.ko 2024-04-15T15:17:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/ 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/echo.ko 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/ 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/ 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 191649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hmc6352.ko 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ 2024-04-15T15:17:28.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 92345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ics932s401.ko 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/ 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/ 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 154169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 389033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/phantom.ko 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/ 2024-04-15T15:17:28.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 91145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/ 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 234905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/ 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 620961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/ 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/ 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-15T15:17:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 587065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/ 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 158649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-15T15:17:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 109521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/ 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/ 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/ 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/ 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/ 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-15T15:17:28.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/ 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 124497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 128409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 110345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 88953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/ 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 105633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-15T15:17:28.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 228985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1733353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 167185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 161417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 440625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/ 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 432201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/ 2024-04-15T15:17:28.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 257201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 446177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1311433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 206689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/ 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 269313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/ 2024-04-15T15:17:28.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 169089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 76209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/ 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/ 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-15T15:17:28.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 356377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/ 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 366217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 755793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 324577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-15T15:17:28.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1196297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-15T15:17:28.618 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-15T15:17:28.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 362593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-15T15:17:28.618 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/ 2024-04-15T15:17:28.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 671801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-15T15:17:28.618 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-15T15:17:28.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 121537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-15T15:17:28.618 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-15T15:17:28.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 966705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-15T15:17:28.626 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-15T15:17:28.626 INFO:teuthology.orchestra.run.smithi118.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-15T15:17:28.626 INFO:teuthology.orchestra.run.smithi118.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-15T15:17:28.647 INFO:teuthology.orchestra.run.smithi118.stderr:done 2024-04-15T15:17:28.712 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 193585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/ 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 126881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 150777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/ 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 905033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 344145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-15T15:17:28.713 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1412417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 117353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/ 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 131425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-15T15:17:28.714 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 91465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/ 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 181081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/ 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 171417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/ 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/ 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 300817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-15T15:17:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 105689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 885129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/ 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/ 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 100689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 264161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/ 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 142449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-15T15:17:28.716 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/ 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1350385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/ 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/ 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/ 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 79457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 100785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-15T15:17:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/ 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 644537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/ 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 128497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 207993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 91353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-15T15:17:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/ 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/ 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 110729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/ 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 98689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/ 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/ 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/ 2024-04-15T15:17:28.719 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/defxx.ko 2024-04-15T15:17:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/ 2024-04-15T15:17:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 275801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-15T15:17:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 91105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-15T15:17:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/ 2024-04-15T15:17:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 290441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-15T15:17:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/ 2024-04-15T15:17:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-15T15:17:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-15T15:17:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ 2024-04-15T15:17:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/ 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-15T15:17:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/ 2024-04-15T15:17:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-15T15:17:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-15T15:17:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ 2024-04-15T15:17:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-15T15:17:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-15T15:17:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-15T15:17:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-15T15:17:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-15T15:17:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-15T15:17:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 96025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 121105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-15T15:17:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-15T15:17:28.724 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-15T15:17:28.724 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/ 2024-04-15T15:17:28.724 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/plip.ko 2024-04-15T15:17:28.724 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ 2024-04-15T15:17:28.724 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-15T15:17:28.724 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-15T15:17:28.724 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-15T15:17:28.724 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-15T15:17:28.724 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sb1000.ko 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/ 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/ 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 137321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-15T15:17:28.725 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/ 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 176497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/ 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 383593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/ 2024-04-15T15:17:28.726 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 175537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-15T15:17:28.727 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ 2024-04-15T15:17:28.727 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-15T15:17:28.727 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/ 2024-04-15T15:17:28.727 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/ 2024-04-15T15:17:28.727 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 335857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-15T15:17:28.727 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 126553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-15T15:17:28.727 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/ 2024-04-15T15:17:28.727 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 168145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-15T15:17:28.727 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-15T15:17:28.727 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/ 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/ 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pci-stub.ko 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/ 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 179961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia.ko 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-15T15:17:28.728 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 133753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/ 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/ 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/ 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/ 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/ 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-15T15:17:28.729 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/ 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/ 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-15T15:17:28.730 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 164769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/ 2024-04-15T15:17:28.731 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-15T15:17:28.732 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/ 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9030_battery.ko 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9052-battery.ko 2024-04-15T15:17:28.733 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/gpio-charger.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max14577_charger.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max17042_battery.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8903_charger.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8925_power.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-15T15:17:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/sbs-battery.ko 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/test_power.ko 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_power.ko 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm8350_power.ko 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/ 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/ 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/ 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-15T15:17:28.735 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 91393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/ 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/ 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/ 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/ 2024-04-15T15:17:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-15T15:17:28.737 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-15T15:17:28.737 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-15T15:17:28.737 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9052.ko 2024-04-15T15:17:28.737 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9055.ko 2024-04-15T15:17:28.737 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9063.ko 2024-04-15T15:17:28.737 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-15T15:17:28.737 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-15T15:17:28.737 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-15T15:17:28.737 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-15T15:17:28.738 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8907.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8925.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8997.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8998.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-palmas.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-15T15:17:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-15T15:17:28.740 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 164569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/ 2024-04-15T15:17:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 340721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 120337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/ 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 468081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 380673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/ 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 243705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/ 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 135617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/ 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 304993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-15T15:17:28.742 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/ 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1527113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/ 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 297801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/ 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 144401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/ 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 390713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/ 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 88881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-15T15:17:28.743 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 117481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 173017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 91569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/ 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 267577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/ 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 95329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 194017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fdomain.ko 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/ 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 366529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-15T15:17:28.744 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 251505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/imm.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 327841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 129785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/ 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 397785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/ 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 386849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 178177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-15T15:17:28.745 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/ 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 274009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/ 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2736001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/ 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 88529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 389177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 104769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/ 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 836945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/ 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 158729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-15T15:17:28.746 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 96537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/ 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/ 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 443745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 152033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ppa.ko 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/ 2024-04-15T15:17:28.747 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2324809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/ 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 697337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qlogicfas408.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 322865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 219857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 357153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 121185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 93481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 138121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-15T15:17:28.748 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 205025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/xen-scsifront.ko 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 174913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/ 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/ 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 920169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/ 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-15T15:17:28.749 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1170033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 149721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/ 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/ 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/ 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-15T15:17:28.750 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-15T15:17:28.751 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 99313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/moxa.ko 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/mxser.ko 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 134401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/ 2024-04-15T15:17:28.752 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/ 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_uart.ko 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 91665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/ 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 120577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/rp2.ko 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/ 2024-04-15T15:17:28.753 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 693081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/ 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_mf624.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_netx.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-15T15:17:28.754 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/ 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/ 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 189209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/ 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-15T15:17:28.755 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 107417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ulpi.ko 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/ 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/ 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 574593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/ 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/ 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-15T15:17:28.756 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 131345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 146617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-15T15:17:28.757 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/ 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-15T15:17:28.758 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 204049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/ 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 182561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-15T15:17:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 94841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 95441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 195969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 104377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-15T15:17:28.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811_cs.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/ 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cytherm.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ehset.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-15T15:17:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/lvstest.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/ 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbtest.ko 2024-04-15T15:17:28.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/ 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 91529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/usbmon.ko 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/ 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 396209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/ 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-15T15:17:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/f81232.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 188609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 152305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 142833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-15T15:17:28.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 122329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/metro-usb.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mxuport.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-15T15:17:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 193857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-15T15:17:28.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 151137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usbserial.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-15T15:17:28.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 201193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/ 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 76041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 122321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/ 2024-04-15T15:17:28.768 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/ 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 206921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 134265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 93673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/ 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 138721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 107905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/ 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/ 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-15T15:17:28.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/bd6107.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-15T15:17:28.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-15T15:17:28.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-15T15:17:28.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-15T15:17:28.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-15T15:17:28.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-15T15:17:28.771 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/ 2024-04-15T15:17:28.771 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ 2024-04-15T15:17:28.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/ 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-15T15:17:28.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 129433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/acquirewdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/advantechwdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/dw_wdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-15T15:17:28.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-15T15:17:28.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/retu_wdt.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-15T15:17:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-15T15:17:28.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-15T15:17:28.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-15T15:17:28.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-15T15:17:28.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-15T15:17:28.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-15T15:17:28.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-15T15:17:28.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-15T15:17:28.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/ 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/ 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 213913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-scsiback.ko 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/ 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/ 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 192617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/ 2024-04-15T15:17:28.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/adfs.ko 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/ 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 197849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/ 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1261113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/kafs.ko 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/ 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 127377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/autofs4.ko 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/ 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/ 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/bfs.ko 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/ 2024-04-15T15:17:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 4489593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/ 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 376857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1586089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/ 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 130073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/ 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 139081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/configfs.ko 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/ 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/ 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 813225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/ 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/efs.ko 2024-04-15T15:17:28.779 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/ 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1906817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/ 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/ 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/freevxfs.ko 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/ 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/ 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1486521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/ 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 183305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/ 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 282097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-15T15:17:28.780 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/ 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 249009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/hpfs.ko 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/ 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 93033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/ 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 533073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/ 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 361369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/ 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 112609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/ 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 591585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/ 2024-04-15T15:17:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/ 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/ 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/ 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 147689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1320249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv2.ko 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 151641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2518505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/ 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-15T15:17:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/ 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2024049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/ 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 734025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/ 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-15T15:17:28.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ascii.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-15T15:17:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 95625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 144209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 167137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-15T15:17:28.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-15T15:17:28.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-15T15:17:28.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-15T15:17:28.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-15T15:17:28.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-15T15:17:28.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-15T15:17:28.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-15T15:17:28.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-15T15:17:28.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 302073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 548169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 3245617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-15T15:17:28.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/ 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/omfs.ko 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/ 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 462873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/ 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/qnx4.ko 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/ 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/qnx6.ko 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/ 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_tree.ko 2024-04-15T15:17:28.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v1.ko 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v2.ko 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/ 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 684841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/ 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/ 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/ 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 3319041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/ 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/ 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 164185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/ 2024-04-15T15:17:28.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/ 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 310017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 198233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/ 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 5192705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/ 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/ 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/locktorture.ko 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/ 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/test_udelay.ko 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-15T15:17:28.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc7.ko 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/ 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/interval_tree_test.ko 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/ 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/ 2024-04-15T15:17:28.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/memory-notifier-error-inject.ko 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/notifier-error-inject.ko 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/percpu_test.ko 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/pm-notifier-error-inject.ko 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/ 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 152025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/rbtree_test.ko 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/ 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test-kstrtox.ko 2024-04-15T15:17:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 4912441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_bpf.ko 2024-04-15T15:17:28.833 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_firmware.ko 2024-04-15T15:17:28.833 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_module.ko 2024-04-15T15:17:28.833 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_user_copy.ko 2024-04-15T15:17:28.833 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-15T15:17:28.833 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-15T15:17:28.833 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/ 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/xz_dec_test.ko 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/ 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/ 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-15T15:17:28.834 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/ 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/ 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/ 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 236793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-15T15:17:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/ 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 879697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/ 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1030873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-15T15:17:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-15T15:17:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/ 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1243505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/ 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 153801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/ 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 244889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/ 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 507705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-15T15:17:28.838 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/ 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 128873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/hsr.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 357425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-15T15:17:28.839 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-15T15:17:28.840 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-15T15:17:28.841 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-15T15:17:28.842 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_gre.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 118881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-15T15:17:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/mip6.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-15T15:17:28.844 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-15T15:17:28.845 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 94089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/ 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/ 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 153217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/ 2024-04-15T15:17:28.846 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/lapb.ko 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/ 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 332889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc2.ko 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/ 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 388873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/ 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 147745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 124041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-15T15:17:28.847 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 124345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 126681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 126473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 137833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 133681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 139073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 138265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 136177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 139897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 534113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-15T15:17:28.848 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 496817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-15T15:17:28.849 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 134377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 140801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 79873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 117201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-15T15:17:28.850 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 118369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 807985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-15T15:17:28.851 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_osf.ko 2024-04-15T15:17:28.852 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_synproxy.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tproxy.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/x_tables.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-15T15:17:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-15T15:17:28.854 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-15T15:17:28.855 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-15T15:17:28.856 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-15T15:17:28.857 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpudp.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/ 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/ 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/ 2024-04-15T15:17:28.858 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 488825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/ 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/ 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 142025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/phonet.ko 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/pn_pep.ko 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/ 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 318617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 202305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/ 2024-04-15T15:17:28.859 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1027897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/rxrpc.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/ 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_cgroup.ko 2024-04-15T15:17:28.860 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 79145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-15T15:17:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq_codel.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-15T15:17:28.862 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/ 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1187313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/ 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/ 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 432409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1940889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/ 2024-04-15T15:17:28.863 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 890729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/ 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1122337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/ 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/ 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 105609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 123769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/ 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 165841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/x25.ko 2024-04-15T15:17:28.864 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/ 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_algo.ko 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 131865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_user.ko 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 644769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 628542 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7706 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9941 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70990 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 146959 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 232835 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 210 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72602 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 879 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-15T15:17:28.865 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 258450 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-15T15:17:28.866 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 313019 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-15T15:17:28.866 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/ 2024-04-15T15:17:28.866 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/ 2024-04-15T15:17:28.866 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/ 2024-04-15T15:17:28.866 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-15T15:17:28.866 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 174 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/changelog.Debian.gz 2024-04-15T15:17:28.866 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 691 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/copyright 2024-04-15T15:17:28.870 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:28.871 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:28.871 DEBUG:teuthology.orchestra.run.smithi073:> egrep '(submenu|menuentry.*6.9.0-rc3-g3f60ed14f7c1).*{' /boot/grub/grub.cfg 2024-04-15T15:17:28.877 INFO:teuthology.orchestra.run.smithi073.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-15T15:17:28.877 INFO:teuthology.orchestra.run.smithi073.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-15T15:17:28.877 INFO:teuthology.orchestra.run.smithi073.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-15T15:17:28.878 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-15T15:17:28.878 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:28.878 DEBUG:teuthology.orchestra.run.smithi073:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-15T15:17:28.921 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi073.front.sepia.ceph.com to complete... 2024-04-15T15:17:29.326 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2024-04-15T15:17:29.327 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-15T15:17:29.362 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-04-15T15:17:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:29.611 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:17:29.921 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-15T15:17:29.927 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-15T15:17:29.969 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-15T15:17:29.975 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-15T15:17:30.111 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-15T15:17:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-15T15:17:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-15T15:17:30.128 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-04-15T15:17:59.788 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-15T15:17:59.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-15T15:17:59.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:18:01.243 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-15T15:18:01.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-15T15:18:01.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:18:18.147 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-15T15:18:27.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-15T15:18:27.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:18:30.214 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-15T15:18:35.806 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-15T15:18:42.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-15T15:18:42.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:18:44.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-15T15:18:44.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:18:45.282 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-15T15:19:00.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-15T15:19:00.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:19:03.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-04-15T15:19:15.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-15T15:19:15.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:19:15.592 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-04-15T15:19:18.814 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-15T15:19:19.675 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-04-15T15:19:20.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-15T15:19:20.589 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-15T15:19:20.589 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-04-15T15:19:20.641 INFO:teuthology.orchestra.run.smithi073.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:19:20.641 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:19:20.641 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T15:19:20.641 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-15T15:19:21.643 DEBUG:teuthology.parallel:result is None 2024-04-15T15:19:36.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-15T15:19:36.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:19:37.065 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-04-15T15:19:37.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-15T15:19:37.681 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-15T15:19:37.681 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-04-15T15:19:37.729 INFO:teuthology.orchestra.run.smithi118.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:19:37.729 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-15T15:19:37.729 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T15:19:37.729 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-15T15:19:38.732 DEBUG:teuthology.parallel:result is None 2024-04-15T15:19:38.732 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-15T15:19:38.739 INFO:teuthology.task.internal:Creating test directory... 2024-04-15T15:19:38.740 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T15:19:38.743 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T15:19:38.751 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-15T15:19:38.770 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-15T15:19:38.778 INFO:teuthology.task.internal:Creating archive directory... 2024-04-15T15:19:38.778 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T15:19:38.795 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T15:19:38.825 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-15T15:19:38.832 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-15T15:19:38.832 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T15:19:38.863 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T15:19:38.947 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T15:19:38.961 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T15:19:38.964 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T15:19:38.987 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T15:19:38.990 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-15T15:19:38.997 INFO:teuthology.task.internal:Configuring sudo... 2024-04-15T15:19:38.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T15:19:39.001 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T15:19:39.021 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-15T15:19:39.031 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-15T15:19:39.031 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T15:19:39.063 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T15:19:39.074 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T15:19:39.122 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T15:19:39.173 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:19:39.173 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T15:19:39.243 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T15:19:39.252 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T15:19:39.306 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:19:39.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T15:19:39.377 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-04-15T15:19:39.380 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2024-04-15T15:19:39.500 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-15T15:19:39.508 INFO:teuthology.task.internal:Starting timer... 2024-04-15T15:19:39.508 INFO:teuthology.run_tasks:Running task pcp... 2024-04-15T15:19:39.518 INFO:teuthology.run_tasks:Running task selinux... 2024-04-15T15:19:39.526 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2024-04-15T15:19:39.526 DEBUG:teuthology.task.selinux:Excluding smithi118: OS 'ubuntu' does not support SELinux 2024-04-15T15:19:39.527 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-15T15:19:39.527 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-15T15:19:39.527 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-15T15:19:39.527 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-15T15:19:39.536 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-15T15:19:39.542 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-15T15:19:39.659 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-15T15:19:39.675 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-15T15:19:39.677 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-15T15:27:15.336 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com')] 2024-04-15T15:27:15.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-15T15:27:15.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:27:15.418 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-04-15T15:27:15.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-15T15:27:15.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-15T15:27:15.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:27:15.631 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-04-15T15:27:15.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-15T15:27:15.761 INFO:teuthology.run_tasks:Running task clock... 2024-04-15T15:27:15.772 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-15T15:27:15.772 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T15:27:15.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T15:27:15.775 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T15:27:15.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T15:27:15.810 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-15T15:27:15.810 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: Command line: ntpd -gq 2024-04-15T15:27:15.810 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: ---------------------------------------------------- 2024-04-15T15:27:15.811 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: ntp-4 is maintained by Network Time Foundation, 2024-04-15T15:27:15.811 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-15T15:27:15.811 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: corporation. Support and training for ntp-4 are 2024-04-15T15:27:15.811 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: available at https://www.nwtime.org/support 2024-04-15T15:27:15.811 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: ---------------------------------------------------- 2024-04-15T15:27:15.811 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: proto: precision = 0.040 usec (-24) 2024-04-15T15:27:15.812 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: basedate set to 2022-02-04 2024-04-15T15:27:15.812 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: gps base set to 2022-02-06 (week 2196) 2024-04-15T15:27:15.812 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-15T15:27:15.812 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-15T15:27:15.812 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: restrict ::: KOD does nothing without LIMITED. 2024-04-15T15:27:15.812 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-15T15:27:15.813 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: Listen and drop on 0 v6wildcard [::]:123 2024-04-15T15:27:15.814 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-15T15:27:15.814 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: Listen normally on 2 lo 127.0.0.1:123 2024-04-15T15:27:15.814 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2024-04-15T15:27:15.814 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: Listen normally on 4 lo [::1]:123 2024-04-15T15:27:15.814 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2024-04-15T15:27:15.814 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:15 ntpd[17185]: Listening on routing socket on fd #22 for interface updates 2024-04-15T15:27:15.843 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-15T15:27:15.843 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: Command line: ntpd -gq 2024-04-15T15:27:15.843 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: ---------------------------------------------------- 2024-04-15T15:27:15.843 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: ntp-4 is maintained by Network Time Foundation, 2024-04-15T15:27:15.843 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-15T15:27:15.843 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: corporation. Support and training for ntp-4 are 2024-04-15T15:27:15.843 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: available at https://www.nwtime.org/support 2024-04-15T15:27:15.843 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: ---------------------------------------------------- 2024-04-15T15:27:15.844 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: proto: precision = 0.043 usec (-24) 2024-04-15T15:27:15.844 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: basedate set to 2022-02-04 2024-04-15T15:27:15.844 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: gps base set to 2022-02-06 (week 2196) 2024-04-15T15:27:15.844 INFO:teuthology.orchestra.run.smithi118.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-15T15:27:15.845 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-15T15:27:15.845 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: restrict ::: KOD does nothing without LIMITED. 2024-04-15T15:27:15.845 INFO:teuthology.orchestra.run.smithi118.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-15T15:27:15.846 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: Listen and drop on 0 v6wildcard [::]:123 2024-04-15T15:27:15.846 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-15T15:27:15.846 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: Listen normally on 2 lo 127.0.0.1:123 2024-04-15T15:27:15.846 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: Listen normally on 3 enp3s0f1 172.21.15.118:123 2024-04-15T15:27:15.846 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: Listen normally on 4 lo [::1]:123 2024-04-15T15:27:15.847 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d725%5]:123 2024-04-15T15:27:15.847 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:15 ntpd[17170]: Listening on routing socket on fd #22 for interface updates 2024-04-15T15:27:16.811 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:16 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:16.811 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:16 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:16.811 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:16 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:16.811 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:16 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:16.812 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:16 ntpd[17185]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:16.812 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:16 ntpd[17185]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:16.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:16.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:16 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:18.812 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:18.812 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:18 ntpd[17185]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:18.846 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:18.846 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:18.846 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:18 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:19.811 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:19 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:19.811 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:19 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.812 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.812 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:20.814 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:20 ntpd[17185]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:20.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:20.846 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:20.846 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:20.846 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:20.846 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:20 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:22.812 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:22.812 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:22.813 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:22.814 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:22.814 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:22.814 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:22.814 INFO:teuthology.orchestra.run.smithi073.stdout:15 Apr 15:27:22 ntpd[17185]: ntpd: time slew -0.002772 s 2024-04-15T15:27:22.814 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.002772s 2024-04-15T15:27:22.814 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-15T15:27:22.815 INFO:teuthology.orchestra.run.smithi073.stderr:15 Apr 15:27:22 ntpd[17185]: can't open /var/log/ntpstats/loopstats.20240415: Permission denied 2024-04-15T15:27:22.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:22.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:22.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:22.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:22.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:22.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:22.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-15T15:27:22.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240415: Permission denied 2024-04-15T15:27:22.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-15T15:27:22.844 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240415: Permission denied 2024-04-15T15:27:22.845 INFO:teuthology.orchestra.run.smithi118.stdout:15 Apr 15:27:22 ntpd[17170]: ntpd: time slew -0.001716 s 2024-04-15T15:27:22.845 INFO:teuthology.orchestra.run.smithi118.stdout:ntpd: time slew -0.001716s 2024-04-15T15:27:22.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-15T15:27:22.845 INFO:teuthology.orchestra.run.smithi118.stderr:15 Apr 15:27:22 ntpd[17170]: can't open /var/log/ntpstats/loopstats.20240415: Permission denied 2024-04-15T15:27:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-04-15T15:27:22.920 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-04-15T15:27:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-15T15:27:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-15T15:27:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-15T15:27:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-15T15:27:22.959 INFO:teuthology.orchestra.run.smithi118.stdout: remote refid st t when poll reach delay offset jitter 2024-04-15T15:27:22.959 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================== 2024-04-15T15:27:22.959 INFO:teuthology.orchestra.run.smithi118.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-15T15:27:22.959 INFO:teuthology.orchestra.run.smithi118.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-15T15:27:22.959 INFO:teuthology.orchestra.run.smithi118.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-15T15:27:22.959 INFO:teuthology.orchestra.run.smithi118.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-15T15:27:22.960 INFO:teuthology.run_tasks:Running task install... 2024-04-15T15:27:22.972 DEBUG:teuthology.task.install:project ceph 2024-04-15T15:27:22.973 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9bf1c4ba967dd24077be6e5b87edda4ca87a6e14'}} 2024-04-15T15:27:22.973 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9bf1c4ba967dd24077be6e5b87edda4ca87a6e14'} 2024-04-15T15:27:22.973 INFO:teuthology.task.install:Using flavor: default 2024-04-15T15:27:22.979 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-15T15:27:22.979 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-15T15:27:22.979 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2024-04-15T15:27:22.979 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-key list | grep Ceph 2024-04-15T15:27:23.081 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-15T15:27:23.105 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-15T15:27:23.131 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-15T15:27:23.131 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2024-04-15T15:27:23.132 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-15T15:27:23.132 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-15T15:27:23.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9bf1c4ba967dd24077be6e5b87edda4ca87a6e14 2024-04-15T15:27:23.156 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-15T15:27:23.156 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph.com (release key) 2024-04-15T15:27:23.157 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-15T15:27:23.157 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-15T15:27:23.157 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9bf1c4ba967dd24077be6e5b87edda4ca87a6e14 2024-04-15T15:27:23.305 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default/ 2024-04-15T15:27:23.305 INFO:teuthology.task.install.deb:Package version is 19.0.0-2861-g9bf1c4ba-1jammy 2024-04-15T15:27:23.359 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default/ 2024-04-15T15:27:23.359 INFO:teuthology.task.install.deb:Package version is 19.0.0-2861-g9bf1c4ba-1jammy 2024-04-15T15:27:23.467 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:27:23.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-15T15:27:23.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-04-15T15:27:23.504 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:27:23.504 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-15T15:27:23.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get update 2024-04-15T15:27:23.682 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-15T15:27:23.692 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-15T15:27:23.713 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-15T15:27:23.715 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-15T15:27:23.715 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-15T15:27:23.726 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-15T15:27:23.747 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-15T15:27:23.758 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy InRelease 2024-04-15T15:27:23.779 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-15T15:27:23.781 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy InRelease 2024-04-15T15:27:23.790 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-15T15:27:23.801 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-15T15:27:23.818 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-15T15:27:23.822 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-15T15:27:23.855 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-15T15:27:23.857 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2024-04-15T15:27:23.891 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2024-04-15T15:27:23.939 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-15T15:27:24.270 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 29.2 kB in 1s (52.2 kB/s) 2024-04-15T15:27:24.302 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 29.2 kB in 1s (52.6 kB/s) 2024-04-15T15:27:25.233 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-15T15:27:25.248 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2861-g9bf1c4ba-1jammy cephadm=19.0.0-2861-g9bf1c4ba-1jammy ceph-mds=19.0.0-2861-g9bf1c4ba-1jammy ceph-mgr=19.0.0-2861-g9bf1c4ba-1jammy ceph-common=19.0.0-2861-g9bf1c4ba-1jammy ceph-fuse=19.0.0-2861-g9bf1c4ba-1jammy ceph-test=19.0.0-2861-g9bf1c4ba-1jammy ceph-volume=19.0.0-2861-g9bf1c4ba-1jammy radosgw=19.0.0-2861-g9bf1c4ba-1jammy python3-rados=19.0.0-2861-g9bf1c4ba-1jammy python3-rgw=19.0.0-2861-g9bf1c4ba-1jammy python3-cephfs=19.0.0-2861-g9bf1c4ba-1jammy python3-rbd=19.0.0-2861-g9bf1c4ba-1jammy libcephfs2=19.0.0-2861-g9bf1c4ba-1jammy libcephfs-dev=19.0.0-2861-g9bf1c4ba-1jammy librados2=19.0.0-2861-g9bf1c4ba-1jammy librbd1=19.0.0-2861-g9bf1c4ba-1jammy rbd-fuse=19.0.0-2861-g9bf1c4ba-1jammy python3-cephfs=19.0.0-2861-g9bf1c4ba-1jammy cephfs-shell=19.0.0-2861-g9bf1c4ba-1jammy cephfs-top=19.0.0-2861-g9bf1c4ba-1jammy cephfs-mirror=19.0.0-2861-g9bf1c4ba-1jammy 2024-04-15T15:27:25.273 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2024-04-15T15:27:25.288 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2861-g9bf1c4ba-1jammy cephadm=19.0.0-2861-g9bf1c4ba-1jammy ceph-mds=19.0.0-2861-g9bf1c4ba-1jammy ceph-mgr=19.0.0-2861-g9bf1c4ba-1jammy ceph-common=19.0.0-2861-g9bf1c4ba-1jammy ceph-fuse=19.0.0-2861-g9bf1c4ba-1jammy ceph-test=19.0.0-2861-g9bf1c4ba-1jammy ceph-volume=19.0.0-2861-g9bf1c4ba-1jammy radosgw=19.0.0-2861-g9bf1c4ba-1jammy python3-rados=19.0.0-2861-g9bf1c4ba-1jammy python3-rgw=19.0.0-2861-g9bf1c4ba-1jammy python3-cephfs=19.0.0-2861-g9bf1c4ba-1jammy python3-rbd=19.0.0-2861-g9bf1c4ba-1jammy libcephfs2=19.0.0-2861-g9bf1c4ba-1jammy libcephfs-dev=19.0.0-2861-g9bf1c4ba-1jammy librados2=19.0.0-2861-g9bf1c4ba-1jammy librbd1=19.0.0-2861-g9bf1c4ba-1jammy rbd-fuse=19.0.0-2861-g9bf1c4ba-1jammy python3-cephfs=19.0.0-2861-g9bf1c4ba-1jammy cephfs-shell=19.0.0-2861-g9bf1c4ba-1jammy cephfs-top=19.0.0-2861-g9bf1c4ba-1jammy cephfs-mirror=19.0.0-2861-g9bf1c4ba-1jammy 2024-04-15T15:27:25.321 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-15T15:27:25.361 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2024-04-15T15:27:25.493 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-15T15:27:25.494 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-15T15:27:25.533 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2024-04-15T15:27:25.533 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2024-04-15T15:27:25.666 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-15T15:27:25.666 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-15T15:27:25.666 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-15T15:27:25.666 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-15T15:27:25.666 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-15T15:27:25.666 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-15T15:27:25.667 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-15T15:27:25.667 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-04-15T15:27:25.667 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-15T15:27:25.667 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-15T15:27:25.667 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-15T15:27:25.668 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-15T15:27:25.669 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-15T15:27:25.669 INFO:teuthology.orchestra.run.smithi073.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-15T15:27:25.669 INFO:teuthology.orchestra.run.smithi073.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-15T15:27:25.669 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-15T15:27:25.669 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-15T15:27:25.669 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-15T15:27:25.669 INFO:teuthology.orchestra.run.smithi073.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-15T15:27:25.669 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-15T15:27:25.669 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-15T15:27:25.670 INFO:teuthology.orchestra.run.smithi073.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-15T15:27:25.671 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-04-15T15:27:25.671 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-15T15:27:25.671 INFO:teuthology.orchestra.run.smithi073.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-15T15:27:25.671 INFO:teuthology.orchestra.run.smithi073.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-15T15:27:25.671 INFO:teuthology.orchestra.run.smithi073.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-15T15:27:25.671 INFO:teuthology.orchestra.run.smithi073.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-15T15:27:25.671 INFO:teuthology.orchestra.run.smithi073.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-15T15:27:25.671 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-15T15:27:25.671 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-04-15T15:27:25.671 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2024-04-15T15:27:25.703 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages were automatically installed and are no longer required: 2024-04-15T15:27:25.703 INFO:teuthology.orchestra.run.smithi118.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-15T15:27:25.703 INFO:teuthology.orchestra.run.smithi118.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-15T15:27:25.703 INFO:teuthology.orchestra.run.smithi118.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-15T15:27:25.704 INFO:teuthology.orchestra.run.smithi118.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-15T15:27:25.704 INFO:teuthology.orchestra.run.smithi118.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-15T15:27:25.704 INFO:teuthology.orchestra.run.smithi118.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-15T15:27:25.704 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2024-04-15T15:27:25.704 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-15T15:27:25.706 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-15T15:27:25.706 INFO:teuthology.orchestra.run.smithi118.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-15T15:27:25.706 INFO:teuthology.orchestra.run.smithi118.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-15T15:27:25.706 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-15T15:27:25.706 INFO:teuthology.orchestra.run.smithi118.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-15T15:27:25.706 INFO:teuthology.orchestra.run.smithi118.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-15T15:27:25.706 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-15T15:27:25.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-15T15:27:25.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-15T15:27:25.708 INFO:teuthology.orchestra.run.smithi118.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-15T15:27:25.708 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2024-04-15T15:27:25.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-15T15:27:25.708 INFO:teuthology.orchestra.run.smithi118.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-15T15:27:25.708 INFO:teuthology.orchestra.run.smithi118.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-15T15:27:25.708 INFO:teuthology.orchestra.run.smithi118.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-15T15:27:25.708 INFO:teuthology.orchestra.run.smithi118.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-15T15:27:25.708 INFO:teuthology.orchestra.run.smithi118.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-15T15:27:25.708 INFO:teuthology.orchestra.run.smithi118.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-15T15:27:25.709 INFO:teuthology.orchestra.run.smithi118.stdout:Recommended packages: 2024-04-15T15:27:25.709 INFO:teuthology.orchestra.run.smithi118.stdout: btrfs-tools 2024-04-15T15:27:25.820 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-04-15T15:27:25.820 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-15T15:27:25.820 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-15T15:27:25.820 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-15T15:27:25.820 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-15T15:27:25.822 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-15T15:27:25.823 INFO:teuthology.orchestra.run.smithi073.stdout: socat unzip xmlstarlet zip 2024-04-15T15:27:25.856 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2024-04-15T15:27:25.856 INFO:teuthology.orchestra.run.smithi118.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-15T15:27:25.856 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-15T15:27:25.856 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-15T15:27:25.856 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-15T15:27:25.858 INFO:teuthology.orchestra.run.smithi118.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-15T15:27:25.858 INFO:teuthology.orchestra.run.smithi118.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-15T15:27:25.858 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-15T15:27:25.858 INFO:teuthology.orchestra.run.smithi118.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-15T15:27:25.859 INFO:teuthology.orchestra.run.smithi118.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-15T15:27:25.860 INFO:teuthology.orchestra.run.smithi118.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-15T15:27:25.860 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-15T15:27:25.860 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-15T15:27:25.860 INFO:teuthology.orchestra.run.smithi118.stdout: socat unzip xmlstarlet zip 2024-04-15T15:27:25.895 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 124 newly installed, 0 to remove and 303 not upgraded. 2024-04-15T15:27:25.895 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 180 MB of archives. 2024-04-15T15:27:25.895 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 825 MB of additional disk space will be used. 2024-04-15T15:27:25.895 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-15T15:27:25.915 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-15T15:27:25.927 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-15T15:27:25.975 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-15T15:27:25.999 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-15T15:27:26.002 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-15T15:27:26.007 INFO:teuthology.orchestra.run.smithi118.stdout:0 upgraded, 124 newly installed, 0 to remove and 303 not upgraded. 2024-04-15T15:27:26.007 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 180 MB of archives. 2024-04-15T15:27:26.007 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 825 MB of additional disk space will be used. 2024-04-15T15:27:26.007 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2861-g9bf1c4ba-1jammy [3,554 kB] 2024-04-15T15:27:26.015 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-15T15:27:26.045 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2861-g9bf1c4ba-1jammy [3,554 kB] 2024-04-15T15:27:26.054 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-15T15:27:26.059 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-15T15:27:26.062 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-15T15:27:26.074 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-15T15:27:26.077 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-15T15:27:26.078 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-15T15:27:26.085 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-15T15:27:26.086 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-15T15:27:26.088 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-15T15:27:26.089 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-15T15:27:26.090 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-15T15:27:26.110 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-15T15:27:26.112 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-15T15:27:26.114 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-15T15:27:26.115 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-15T15:27:26.115 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-15T15:27:26.116 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-15T15:27:26.116 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-15T15:27:26.117 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-15T15:27:26.117 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-15T15:27:26.129 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-15T15:27:26.137 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-15T15:27:26.138 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-15T15:27:26.138 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-15T15:27:26.141 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-15T15:27:26.141 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-15T15:27:26.142 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-15T15:27:26.142 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-15T15:27:26.143 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-15T15:27:26.143 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-15T15:27:26.149 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-15T15:27:26.166 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-15T15:27:26.167 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-15T15:27:26.167 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-15T15:27:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-15T15:27:26.172 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-15T15:27:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-15T15:27:26.173 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-15T15:27:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-15T15:27:26.176 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-15T15:27:26.182 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-15T15:27:26.195 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-15T15:27:26.196 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-15T15:27:26.197 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-15T15:27:26.199 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-15T15:27:26.199 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-15T15:27:26.200 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-15T15:27:26.214 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-15T15:27:26.253 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2861-g9bf1c4ba-1jammy [3,223 kB] 2024-04-15T15:27:26.274 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-15T15:27:26.277 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-15T15:27:26.279 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-15T15:27:26.279 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-15T15:27:26.280 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-15T15:27:26.302 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-15T15:27:26.305 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-15T15:27:26.306 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-15T15:27:26.330 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-15T15:27:26.330 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-15T15:27:26.338 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-15T15:27:26.339 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-15T15:27:26.339 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-15T15:27:26.339 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-15T15:27:26.340 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-15T15:27:26.340 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-15T15:27:26.344 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-15T15:27:26.357 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-15T15:27:26.359 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-15T15:27:26.360 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-15T15:27:26.365 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2861-g9bf1c4ba-1jammy [712 kB] 2024-04-15T15:27:26.377 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-15T15:27:26.380 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-15T15:27:26.380 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-15T15:27:26.381 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-15T15:27:26.382 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-15T15:27:26.387 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-15T15:27:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-15T15:27:26.388 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-15T15:27:26.401 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2861-g9bf1c4ba-1jammy [356 kB] 2024-04-15T15:27:26.401 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-15T15:27:26.401 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-15T15:27:26.402 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-15T15:27:26.412 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2861-g9bf1c4ba-1jammy [32.8 kB] 2024-04-15T15:27:26.413 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2861-g9bf1c4ba-1jammy [180 kB] 2024-04-15T15:27:26.419 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2861-g9bf1c4ba-1jammy [66.9 kB] 2024-04-15T15:27:26.420 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-15T15:27:26.422 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-15T15:27:26.423 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-15T15:27:26.423 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2861-g9bf1c4ba-1jammy [330 kB] 2024-04-15T15:27:26.430 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-15T15:27:26.431 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-15T15:27:26.431 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-15T15:27:26.434 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-15T15:27:26.438 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2861-g9bf1c4ba-1jammy [6,729 kB] 2024-04-15T15:27:26.440 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-15T15:27:26.487 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-15T15:27:26.500 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-15T15:27:26.553 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-15T15:27:26.709 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2861-g9bf1c4ba-1jammy [112 kB] 2024-04-15T15:27:26.711 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2861-g9bf1c4ba-1jammy [466 kB] 2024-04-15T15:27:26.726 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2861-g9bf1c4ba-1jammy [3,223 kB] 2024-04-15T15:27:26.727 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-15T15:27:26.736 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-15T15:27:26.744 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2861-g9bf1c4ba-1jammy [25.5 MB] 2024-04-15T15:27:26.763 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-15T15:27:26.772 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-15T15:27:26.937 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-15T15:27:27.216 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2861-g9bf1c4ba-1jammy [712 kB] 2024-04-15T15:27:27.229 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2861-g9bf1c4ba-1jammy [356 kB] 2024-04-15T15:27:27.296 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2861-g9bf1c4ba-1jammy [32.8 kB] 2024-04-15T15:27:27.300 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2861-g9bf1c4ba-1jammy [180 kB] 2024-04-15T15:27:27.339 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2861-g9bf1c4ba-1jammy [66.9 kB] 2024-04-15T15:27:27.350 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2861-g9bf1c4ba-1jammy [330 kB] 2024-04-15T15:27:27.378 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2861-g9bf1c4ba-1jammy [6,729 kB] 2024-04-15T15:27:27.520 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-15T15:27:27.535 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-15T15:27:27.551 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-15T15:27:27.560 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-15T15:27:27.560 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-15T15:27:27.577 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-15T15:27:27.614 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-15T15:27:27.628 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-15T15:27:27.631 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-15T15:27:27.632 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-15T15:27:27.802 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-15T15:27:27.826 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2861-g9bf1c4ba-1jammy [5,087 kB] 2024-04-15T15:27:27.885 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-15T15:27:27.906 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-15T15:27:27.966 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-15T15:27:28.009 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-15T15:27:28.031 INFO:teuthology.orchestra.run.smithi118.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-15T15:27:28.034 INFO:teuthology.orchestra.run.smithi118.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2861-g9bf1c4ba-1jammy [244 kB] 2024-04-15T15:27:28.043 INFO:teuthology.orchestra.run.smithi118.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2861-g9bf1c4ba-1jammy [124 kB] 2024-04-15T15:27:28.049 INFO:teuthology.orchestra.run.smithi118.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2861-g9bf1c4ba-1jammy [1,525 kB] 2024-04-15T15:27:28.052 INFO:teuthology.orchestra.run.smithi118.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-15T15:27:28.114 INFO:teuthology.orchestra.run.smithi118.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2861-g9bf1c4ba-1jammy [6,258 kB] 2024-04-15T15:27:28.224 INFO:teuthology.orchestra.run.smithi118.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-15T15:27:28.241 INFO:teuthology.orchestra.run.smithi118.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-15T15:27:28.247 INFO:teuthology.orchestra.run.smithi118.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-15T15:27:28.252 INFO:teuthology.orchestra.run.smithi118.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-15T15:27:28.382 INFO:teuthology.orchestra.run.smithi118.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2861-g9bf1c4ba-1jammy [22.8 MB] 2024-04-15T15:27:28.392 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2861-g9bf1c4ba-1jammy [112 kB] 2024-04-15T15:27:28.400 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2861-g9bf1c4ba-1jammy [466 kB] 2024-04-15T15:27:28.437 INFO:teuthology.orchestra.run.smithi118.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-15T15:27:28.471 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2861-g9bf1c4ba-1jammy [25.5 MB] 2024-04-15T15:27:28.519 INFO:teuthology.orchestra.run.smithi118.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-15T15:27:28.535 INFO:teuthology.orchestra.run.smithi118.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-15T15:27:28.715 INFO:teuthology.orchestra.run.smithi118.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-15T15:27:28.766 INFO:teuthology.orchestra.run.smithi118.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-15T15:27:28.778 INFO:teuthology.orchestra.run.smithi118.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-15T15:27:28.934 INFO:teuthology.orchestra.run.smithi118.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-15T15:27:28.934 INFO:teuthology.orchestra.run.smithi118.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-15T15:27:28.940 INFO:teuthology.orchestra.run.smithi118.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-15T15:27:28.944 INFO:teuthology.orchestra.run.smithi118.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-15T15:27:28.958 INFO:teuthology.orchestra.run.smithi118.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-15T15:27:29.143 INFO:teuthology.orchestra.run.smithi118.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-15T15:27:29.353 INFO:teuthology.orchestra.run.smithi118.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2861-g9bf1c4ba-1jammy [14.1 kB] 2024-04-15T15:27:29.354 INFO:teuthology.orchestra.run.smithi118.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2861-g9bf1c4ba-1jammy [870 kB] 2024-04-15T15:27:29.382 INFO:teuthology.orchestra.run.smithi118.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2861-g9bf1c4ba-1jammy [2,437 kB] 2024-04-15T15:27:29.407 INFO:teuthology.orchestra.run.smithi118.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-15T15:27:29.488 INFO:teuthology.orchestra.run.smithi118.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2861-g9bf1c4ba-1jammy [791 kB] 2024-04-15T15:27:29.522 INFO:teuthology.orchestra.run.smithi118.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2861-g9bf1c4ba-1jammy [148 kB] 2024-04-15T15:27:29.528 INFO:teuthology.orchestra.run.smithi118.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2861-g9bf1c4ba-1jammy [2,312 kB] 2024-04-15T15:27:29.535 INFO:teuthology.orchestra.run.smithi118.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-15T15:27:29.578 INFO:teuthology.orchestra.run.smithi118.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-15T15:27:29.626 INFO:teuthology.orchestra.run.smithi118.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2861-g9bf1c4ba-1jammy [8,625 kB] 2024-04-15T15:27:29.667 INFO:teuthology.orchestra.run.smithi118.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-15T15:27:29.676 INFO:teuthology.orchestra.run.smithi118.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-15T15:27:29.689 INFO:teuthology.orchestra.run.smithi118.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-15T15:27:29.730 INFO:teuthology.orchestra.run.smithi118.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-15T15:27:29.979 INFO:teuthology.orchestra.run.smithi118.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2861-g9bf1c4ba-1jammy [14.2 kB] 2024-04-15T15:27:29.980 INFO:teuthology.orchestra.run.smithi118.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2861-g9bf1c4ba-1jammy [51.0 MB] 2024-04-15T15:27:29.992 INFO:teuthology.orchestra.run.smithi118.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-15T15:27:29.993 INFO:teuthology.orchestra.run.smithi118.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-15T15:27:29.994 INFO:teuthology.orchestra.run.smithi118.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-15T15:27:30.159 INFO:teuthology.orchestra.run.smithi118.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-15T15:27:30.507 INFO:teuthology.orchestra.run.smithi118.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-15T15:27:30.927 INFO:teuthology.orchestra.run.smithi118.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-15T15:27:30.945 INFO:teuthology.orchestra.run.smithi118.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-15T15:27:30.947 INFO:teuthology.orchestra.run.smithi118.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-15T15:27:31.043 INFO:teuthology.orchestra.run.smithi118.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-15T15:27:31.044 INFO:teuthology.orchestra.run.smithi118.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-15T15:27:31.045 INFO:teuthology.orchestra.run.smithi118.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-15T15:27:31.046 INFO:teuthology.orchestra.run.smithi118.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-15T15:27:31.047 INFO:teuthology.orchestra.run.smithi118.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-15T15:27:31.048 INFO:teuthology.orchestra.run.smithi118.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-15T15:27:31.213 INFO:teuthology.orchestra.run.smithi118.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-15T15:27:31.430 INFO:teuthology.orchestra.run.smithi118.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-15T15:27:31.759 INFO:teuthology.orchestra.run.smithi118.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-15T15:27:31.806 INFO:teuthology.orchestra.run.smithi118.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-15T15:27:31.833 INFO:teuthology.orchestra.run.smithi118.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-15T15:27:31.842 INFO:teuthology.orchestra.run.smithi118.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-15T15:27:31.887 INFO:teuthology.orchestra.run.smithi118.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-15T15:27:31.913 INFO:teuthology.orchestra.run.smithi118.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-15T15:27:31.915 INFO:teuthology.orchestra.run.smithi118.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-15T15:27:31.922 INFO:teuthology.orchestra.run.smithi118.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-15T15:27:31.925 INFO:teuthology.orchestra.run.smithi118.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-15T15:27:32.084 INFO:teuthology.orchestra.run.smithi118.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2861-g9bf1c4ba-1jammy [121 kB] 2024-04-15T15:27:32.085 INFO:teuthology.orchestra.run.smithi118.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2861-g9bf1c4ba-1jammy [232 kB] 2024-04-15T15:27:32.087 INFO:teuthology.orchestra.run.smithi118.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2861-g9bf1c4ba-1jammy [34.0 kB] 2024-04-15T15:27:32.087 INFO:teuthology.orchestra.run.smithi118.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2861-g9bf1c4ba-1jammy [23.4 kB] 2024-04-15T15:27:32.088 INFO:teuthology.orchestra.run.smithi118.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2861-g9bf1c4ba-1jammy [38.9 kB] 2024-04-15T15:27:32.088 INFO:teuthology.orchestra.run.smithi118.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2861-g9bf1c4ba-1jammy [13.3 MB] 2024-04-15T15:27:32.121 INFO:teuthology.orchestra.run.smithi118.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-15T15:27:32.375 INFO:teuthology.orchestra.run.smithi118.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-15T15:27:32.607 INFO:teuthology.orchestra.run.smithi118.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2861-g9bf1c4ba-1jammy [91.2 kB] 2024-04-15T15:27:32.644 INFO:teuthology.orchestra.run.smithi118.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-15T15:27:32.646 INFO:teuthology.orchestra.run.smithi118.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-15T15:27:32.651 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2861-g9bf1c4ba-1jammy [5,087 kB] 2024-04-15T15:27:32.662 INFO:teuthology.orchestra.run.smithi118.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-15T15:27:32.668 INFO:teuthology.orchestra.run.smithi118.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-15T15:27:32.707 INFO:teuthology.orchestra.run.smithi118.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-15T15:27:32.722 INFO:teuthology.orchestra.run.smithi118.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-15T15:27:32.812 INFO:teuthology.orchestra.run.smithi118.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-15T15:27:32.814 INFO:teuthology.orchestra.run.smithi118.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-15T15:27:32.815 INFO:teuthology.orchestra.run.smithi118.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-15T15:27:32.996 INFO:teuthology.orchestra.run.smithi118.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-15T15:27:33.236 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2861-g9bf1c4ba-1jammy [244 kB] 2024-04-15T15:27:33.252 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2861-g9bf1c4ba-1jammy [124 kB] 2024-04-15T15:27:33.269 INFO:teuthology.orchestra.run.smithi118.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-15T15:27:33.273 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2861-g9bf1c4ba-1jammy [1,525 kB] 2024-04-15T15:27:33.463 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2861-g9bf1c4ba-1jammy [6,258 kB] 2024-04-15T15:27:34.355 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 180 MB in 8s (23.0 MB/s) 2024-04-15T15:27:34.438 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2861-g9bf1c4ba-1jammy [22.8 MB] 2024-04-15T15:27:34.484 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-15T15:27:34.550 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-15T15:27:34.554 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-15T15:27:34.600 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-15T15:27:34.869 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-15T15:27:34.882 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-15T15:27:34.919 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-15T15:27:35.239 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cmd2. 2024-04-15T15:27:35.252 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-15T15:27:35.297 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-15T15:27:35.642 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-15T15:27:35.655 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-15T15:27:35.750 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-15T15:27:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-15T15:27:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-15T15:27:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-15T15:27:36.457 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-15T15:27:36.471 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-15T15:27:36.515 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-15T15:27:36.969 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-15T15:27:36.984 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-15T15:27:37.035 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:27:37.481 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-15T15:27:37.495 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-15T15:27:37.530 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:27:37.842 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-15T15:27:37.857 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-15T15:27:37.900 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:27:38.320 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-15T15:27:38.335 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-15T15:27:38.378 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-15T15:27:38.698 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librados2. 2024-04-15T15:27:38.713 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../010-librados2_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:39.048 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librados2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:39.434 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librbd1. 2024-04-15T15:27:39.449 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../011-librbd1_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:39.493 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librbd1 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:39.945 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libcephfs2. 2024-04-15T15:27:39.960 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:40.004 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:40.265 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rados. 2024-04-15T15:27:40.279 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:40.323 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rados (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:40.504 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2861-g9bf1c4ba-1jammy [14.1 kB] 2024-04-15T15:27:40.505 INFO:teuthology.orchestra.run.smithi073.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2861-g9bf1c4ba-1jammy [870 kB] 2024-04-15T15:27:40.676 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-15T15:27:40.681 INFO:teuthology.orchestra.run.smithi073.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2861-g9bf1c4ba-1jammy [2,437 kB] 2024-04-15T15:27:40.690 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:27:40.734 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-argparse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:40.987 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cephfs. 2024-04-15T15:27:41.001 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:41.045 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cephfs (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:41.201 INFO:teuthology.orchestra.run.smithi073.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2861-g9bf1c4ba-1jammy [791 kB] 2024-04-15T15:27:41.356 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-15T15:27:41.362 INFO:teuthology.orchestra.run.smithi073.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2861-g9bf1c4ba-1jammy [148 kB] 2024-04-15T15:27:41.371 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:27:41.381 INFO:teuthology.orchestra.run.smithi073.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2861-g9bf1c4ba-1jammy [2,312 kB] 2024-04-15T15:27:41.406 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-common (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:41.684 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-prettytable. 2024-04-15T15:27:41.699 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-15T15:27:41.734 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-15T15:27:41.848 INFO:teuthology.orchestra.run.smithi073.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2861-g9bf1c4ba-1jammy [8,625 kB] 2024-04-15T15:27:42.046 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rbd. 2024-04-15T15:27:42.066 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:42.112 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rbd (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:42.465 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-15T15:27:42.479 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-15T15:27:42.523 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-15T15:27:42.835 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-15T15:27:42.849 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-15T15:27:42.884 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-15T15:27:43.112 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-15T15:27:43.126 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-15T15:27:43.179 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-15T15:27:43.516 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package lua5.1. 2024-04-15T15:27:43.530 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-15T15:27:43.574 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-15T15:27:43.886 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package lua-any. 2024-04-15T15:27:43.901 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-15T15:27:43.944 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-15T15:27:44.230 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package zip. 2024-04-15T15:27:44.245 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-15T15:27:44.288 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking zip (3.0-12build2) ... 2024-04-15T15:27:44.559 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package unzip. 2024-04-15T15:27:44.573 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-15T15:27:44.608 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-15T15:27:45.029 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package luarocks. 2024-04-15T15:27:45.044 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-15T15:27:45.087 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-15T15:27:45.089 INFO:teuthology.orchestra.run.smithi073.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2861-g9bf1c4ba-1jammy [14.2 kB] 2024-04-15T15:27:45.096 INFO:teuthology.orchestra.run.smithi073.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2861-g9bf1c4ba-1jammy [51.0 MB] 2024-04-15T15:27:45.487 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librgw2. 2024-04-15T15:27:45.501 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../027-librgw2_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:45.570 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librgw2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:46.040 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rgw. 2024-04-15T15:27:46.054 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:46.106 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rgw (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:46.434 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-15T15:27:46.449 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-15T15:27:46.493 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-15T15:27:46.804 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libradosstriper1. 2024-04-15T15:27:46.819 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:46.862 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libradosstriper1 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:47.318 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-common. 2024-04-15T15:27:47.333 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:47.376 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-common (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:48.533 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-base. 2024-04-15T15:27:48.547 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:27:48.591 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-base (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:27:49.295 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-15T15:27:49.309 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-15T15:27:49.345 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-15T15:27:49.631 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cheroot. 2024-04-15T15:27:49.645 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-15T15:27:49.698 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-15T15:27:50.052 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-15T15:27:50.066 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-15T15:27:50.110 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-15T15:27:50.388 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-15T15:27:50.403 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-15T15:27:50.437 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-15T15:27:50.750 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-15T15:27:50.764 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-15T15:27:50.807 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-15T15:27:51.110 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-tempora. 2024-04-15T15:27:51.125 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-15T15:27:51.169 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-15T15:27:51.505 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-portend. 2024-04-15T15:27:51.520 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-15T15:27:51.563 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-15T15:27:51.834 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-15T15:27:51.848 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-15T15:27:51.892 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-15T15:27:52.203 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-15T15:27:52.218 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-15T15:27:52.261 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-15T15:27:52.590 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-natsort. 2024-04-15T15:27:52.604 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-15T15:27:52.648 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-15T15:27:52.994 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-logutils. 2024-04-15T15:27:53.008 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-15T15:27:53.052 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-15T15:27:53.313 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-15T15:27:53.328 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-15T15:27:53.363 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-15T15:27:53.691 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-mako. 2024-04-15T15:27:53.706 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-15T15:27:53.749 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-15T15:27:54.078 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-15T15:27:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-15T15:27:54.236 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-15T15:27:54.589 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-15T15:27:54.604 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-15T15:27:54.647 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-15T15:27:54.909 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webob. 2024-04-15T15:27:54.924 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-15T15:27:54.967 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-15T15:27:55.312 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-waitress. 2024-04-15T15:27:55.327 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-15T15:27:55.373 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-15T15:27:55.682 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-tempita. 2024-04-15T15:27:55.697 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-15T15:27:55.740 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-15T15:27:56.027 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-paste. 2024-04-15T15:27:56.041 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-15T15:27:56.076 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-15T15:27:56.363 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-15T15:27:56.377 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-15T15:27:56.413 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-15T15:27:56.758 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-15T15:27:56.773 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-15T15:27:56.816 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-15T15:27:57.111 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webtest. 2024-04-15T15:27:57.126 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-15T15:27:57.161 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-15T15:27:57.456 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pecan. 2024-04-15T15:27:57.471 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-15T15:27:57.506 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-15T15:27:57.836 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-certifi. 2024-04-15T15:27:57.850 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-15T15:27:57.894 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-15T15:27:58.247 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-idna. 2024-04-15T15:27:58.263 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-15T15:27:58.306 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-15T15:27:58.609 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-urllib3. 2024-04-15T15:27:58.624 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-15T15:27:58.667 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-15T15:27:59.938 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-requests. 2024-04-15T15:27:59.953 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-15T15:27:59.996 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-15T15:28:00.291 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-15T15:28:00.305 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-15T15:28:00.382 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-15T15:28:00.652 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-15T15:28:00.666 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:00.711 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:01.049 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-15T15:28:01.063 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:01.124 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:01.410 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-15T15:28:01.424 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-15T15:28:01.469 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-15T15:28:01.755 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-openssl. 2024-04-15T15:28:01.769 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-15T15:28:01.830 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-15T15:28:02.133 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr. 2024-04-15T15:28:02.148 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:02.191 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:02.637 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mon. 2024-04-15T15:28:02.651 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:02.695 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mon (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:03.332 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-osd. 2024-04-15T15:28:03.346 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:03.398 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-osd (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:04.194 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph. 2024-04-15T15:28:04.204 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../068-ceph_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:04.243 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:04.563 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-fuse. 2024-04-15T15:28:04.573 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:04.613 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-fuse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:04.741 INFO:teuthology.orchestra.run.smithi073.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2861-g9bf1c4ba-1jammy [121 kB] 2024-04-15T15:28:04.742 INFO:teuthology.orchestra.run.smithi073.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2861-g9bf1c4ba-1jammy [232 kB] 2024-04-15T15:28:04.744 INFO:teuthology.orchestra.run.smithi073.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2861-g9bf1c4ba-1jammy [34.0 kB] 2024-04-15T15:28:04.745 INFO:teuthology.orchestra.run.smithi073.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2861-g9bf1c4ba-1jammy [23.4 kB] 2024-04-15T15:28:04.745 INFO:teuthology.orchestra.run.smithi073.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2861-g9bf1c4ba-1jammy [38.9 kB] 2024-04-15T15:28:04.746 INFO:teuthology.orchestra.run.smithi073.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2861-g9bf1c4ba-1jammy [13.3 MB] 2024-04-15T15:28:05.008 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mds. 2024-04-15T15:28:05.018 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:05.057 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mds (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:05.402 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephadm. 2024-04-15T15:28:05.413 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../071-cephadm_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:05.444 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephadm (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:05.531 INFO:teuthology.orchestra.run.smithi073.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-xlock/9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2861-g9bf1c4ba-1jammy [91.2 kB] 2024-04-15T15:28:05.780 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-15T15:28:05.791 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-15T15:28:05.830 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-15T15:28:06.108 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-15T15:28:06.118 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-15T15:28:06.158 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-15T15:28:06.169 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 180 MB in 40s (4,537 kB/s) 2024-04-15T15:28:06.316 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-15T15:28:06.382 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-15T15:28:06.386 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-15T15:28:06.431 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-15T15:28:06.709 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-15T15:28:06.722 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-15T15:28:06.759 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-15T15:28:07.070 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cmd2. 2024-04-15T15:28:07.084 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-15T15:28:07.128 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-15T15:28:07.155 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-babel. 2024-04-15T15:28:07.164 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-15T15:28:07.205 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-15T15:28:07.465 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-15T15:28:07.478 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-15T15:28:07.533 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jinja2. 2024-04-15T15:28:07.542 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-15T15:28:07.565 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-15T15:28:07.591 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-15T15:28:07.887 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-15T15:28:07.901 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-15T15:28:07.937 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-15T15:28:07.961 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-15T15:28:07.972 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:08.011 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:08.249 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-15T15:28:08.262 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-15T15:28:08.299 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-15T15:28:08.348 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-15T15:28:08.361 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-15T15:28:08.423 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-15T15:28:08.726 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-routes. 2024-04-15T15:28:08.738 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-15T15:28:08.761 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-15T15:28:08.775 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-15T15:28:08.775 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-15T15:28:08.827 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:28:09.146 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-15T15:28:09.157 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:09.189 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-15T15:28:09.196 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:09.203 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-15T15:28:09.239 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:28:09.576 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-15T15:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-15T15:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:28:09.995 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-15T15:28:10.009 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-15T15:28:10.054 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-15T15:28:10.348 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librados2. 2024-04-15T15:28:10.362 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-librados2_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:10.398 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:10.560 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-15T15:28:10.571 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-15T15:28:10.609 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-15T15:28:11.001 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librbd1. 2024-04-15T15:28:11.016 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-librbd1_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:11.068 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:11.088 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-joblib. 2024-04-15T15:28:11.099 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-15T15:28:11.130 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-15T15:28:11.471 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2024-04-15T15:28:11.485 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:11.500 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-15T15:28:11.511 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-15T15:28:11.529 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:11.661 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-15T15:28:11.782 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2024-04-15T15:28:11.795 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:11.857 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:11.939 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sklearn. 2024-04-15T15:28:11.951 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-15T15:28:11.989 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-15T15:28:12.159 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-15T15:28:12.173 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:12.226 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:12.479 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2024-04-15T15:28:12.493 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:12.537 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:12.682 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-15T15:28:12.693 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:12.732 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:12.815 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-15T15:28:12.829 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:12.898 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:13.185 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2024-04-15T15:28:13.198 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-15T15:28:13.243 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-15T15:28:13.496 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2024-04-15T15:28:13.510 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:13.554 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:13.786 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cachetools. 2024-04-15T15:28:13.797 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-15T15:28:13.827 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-15T15:28:13.899 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-15T15:28:13.912 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-15T15:28:13.974 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-15T15:28:14.113 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-15T15:28:14.128 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-15T15:28:14.171 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-15T15:28:14.235 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-15T15:28:14.249 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-15T15:28:14.293 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-15T15:28:14.542 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-15T15:28:14.549 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-15T15:28:14.571 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-15T15:28:14.585 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-15T15:28:14.592 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-15T15:28:14.629 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-15T15:28:14.887 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rsa. 2024-04-15T15:28:14.893 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-15T15:28:14.928 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-15T15:28:14.941 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua5.1. 2024-04-15T15:28:14.954 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-15T15:28:15.024 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-15T15:28:15.274 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-google-auth. 2024-04-15T15:28:15.283 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-15T15:28:15.324 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-15T15:28:15.328 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-any. 2024-04-15T15:28:15.341 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-15T15:28:15.386 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-15T15:28:15.605 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package zip. 2024-04-15T15:28:15.619 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-15T15:28:15.619 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-15T15:28:15.627 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-15T15:28:15.661 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-15T15:28:15.663 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking zip (3.0-12build2) ... 2024-04-15T15:28:15.975 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package unzip. 2024-04-15T15:28:15.990 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-15T15:28:16.006 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-websocket. 2024-04-15T15:28:16.013 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-15T15:28:16.054 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-15T15:28:16.056 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-15T15:28:16.385 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-15T15:28:16.392 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-15T15:28:16.434 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-15T15:28:16.596 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package luarocks. 2024-04-15T15:28:16.609 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-15T15:28:16.646 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-15T15:28:17.054 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2024-04-15T15:28:17.067 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-librgw2_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:17.145 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:17.157 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-15T15:28:17.163 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:17.207 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:17.568 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-15T15:28:17.574 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-15T15:28:17.618 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-15T15:28:17.757 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2024-04-15T15:28:17.771 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:17.815 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:17.888 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-15T15:28:17.894 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-15T15:28:17.930 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-15T15:28:18.118 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-15T15:28:18.132 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-15T15:28:18.193 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-15T15:28:18.207 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package jq. 2024-04-15T15:28:18.217 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-15T15:28:18.257 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-15T15:28:18.496 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2024-04-15T15:28:18.510 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:18.519 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package socat. 2024-04-15T15:28:18.527 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-15T15:28:18.554 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:18.569 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-15T15:28:18.905 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package xmlstarlet. 2024-04-15T15:28:18.914 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-15T15:28:18.947 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-15T15:28:18.974 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2024-04-15T15:28:18.989 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:19.032 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:19.285 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-test. 2024-04-15T15:28:19.292 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:19.335 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-test (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:20.155 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2024-04-15T15:28:20.170 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:20.222 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:20.809 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-15T15:28:20.823 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-15T15:28:20.867 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-15T15:28:21.137 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cheroot. 2024-04-15T15:28:21.151 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-15T15:28:21.196 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-15T15:28:21.673 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-volume. 2024-04-15T15:28:21.673 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-15T15:28:21.681 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:21.687 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-15T15:28:21.731 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-volume (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:21.732 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-15T15:28:22.035 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-15T15:28:22.048 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-15T15:28:22.093 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-15T15:28:22.202 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-15T15:28:22.210 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:22.260 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephfs-mirror (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:22.380 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-15T15:28:22.393 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-15T15:28:22.438 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-15T15:28:22.647 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-colorama. 2024-04-15T15:28:22.655 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-15T15:28:22.705 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-15T15:28:22.741 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempora. 2024-04-15T15:28:22.754 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-15T15:28:22.799 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-15T15:28:23.008 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephfs-shell. 2024-04-15T15:28:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephfs-shell (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:23.077 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-portend. 2024-04-15T15:28:23.091 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-15T15:28:23.127 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-15T15:28:23.352 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephfs-top. 2024-04-15T15:28:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:23.411 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephfs-top (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:23.422 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-15T15:28:23.433 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-15T15:28:23.472 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-15T15:28:23.738 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-15T15:28:23.750 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:23.797 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs-dev (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:23.808 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-15T15:28:23.820 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-15T15:28:23.858 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-15T15:28:24.175 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-15T15:28:24.182 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-15T15:28:24.220 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2024-04-15T15:28:24.224 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-15T15:28:24.231 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-15T15:28:24.270 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-15T15:28:24.538 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-15T15:28:24.546 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-15T15:28:24.587 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-15T15:28:24.598 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2024-04-15T15:28:24.609 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-15T15:28:24.680 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-15T15:28:24.951 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-15T15:28:24.958 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package nvme-cli. 2024-04-15T15:28:24.962 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-15T15:28:24.970 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-15T15:28:24.992 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-15T15:28:25.041 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-15T15:28:25.279 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2024-04-15T15:28:25.290 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-15T15:28:25.329 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-15T15:28:25.432 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package pkg-config. 2024-04-15T15:28:25.441 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-15T15:28:25.473 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-15T15:28:25.657 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-15T15:28:25.669 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-15T15:28:25.732 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-15T15:28:25.858 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-15T15:28:25.868 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-15T15:28:25.909 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-15T15:28:26.035 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-15T15:28:26.049 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-15T15:28:26.093 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-15T15:28:26.304 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-15T15:28:26.314 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-15T15:28:26.354 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-15T15:28:26.354 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2024-04-15T15:28:26.367 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-15T15:28:26.404 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-15T15:28:26.682 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pastescript. 2024-04-15T15:28:26.691 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-15T15:28:26.716 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2024-04-15T15:28:26.729 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-15T15:28:26.731 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-15T15:28:26.794 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-15T15:28:27.051 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pluggy. 2024-04-15T15:28:27.061 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-15T15:28:27.101 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-15T15:28:27.102 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2024-04-15T15:28:27.118 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-15T15:28:27.161 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-15T15:28:27.446 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-psutil. 2024-04-15T15:28:27.447 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2024-04-15T15:28:27.458 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-15T15:28:27.460 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-15T15:28:27.495 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-15T15:28:27.505 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-15T15:28:27.809 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-15T15:28:27.821 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-15T15:28:27.824 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-py. 2024-04-15T15:28:27.834 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-15T15:28:27.873 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-15T15:28:27.883 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-15T15:28:28.170 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-15T15:28:28.183 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-15T15:28:28.210 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pygments. 2024-04-15T15:28:28.220 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-15T15:28:28.220 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-15T15:28:28.259 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-15T15:28:28.523 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2024-04-15T15:28:28.536 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-15T15:28:28.581 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-15T15:28:28.714 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-15T15:28:28.723 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-15T15:28:28.755 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-15T15:28:28.926 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2024-04-15T15:28:28.939 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-15T15:28:28.984 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-15T15:28:29.057 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-toml. 2024-04-15T15:28:29.067 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-15T15:28:29.107 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-15T15:28:29.322 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-certifi. 2024-04-15T15:28:29.335 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-15T15:28:29.372 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-15T15:28:29.443 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pytest. 2024-04-15T15:28:29.453 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-15T15:28:29.493 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-15T15:28:29.675 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-idna. 2024-04-15T15:28:29.687 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-15T15:28:29.725 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-15T15:28:29.780 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-simplejson. 2024-04-15T15:28:29.790 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-15T15:28:29.830 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-15T15:28:30.062 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-urllib3. 2024-04-15T15:28:30.074 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-15T15:28:30.074 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-15T15:28:30.086 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-15T15:28:30.111 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-15T15:28:30.157 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-15T15:28:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests. 2024-04-15T15:28:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-15T15:28:30.481 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-15T15:28:30.751 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-15T15:28:30.764 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-15T15:28:30.792 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-15T15:28:30.861 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package radosgw. 2024-04-15T15:28:30.871 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../122-radosgw_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:30.911 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking radosgw (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:31.113 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-15T15:28:31.125 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:31.162 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:31.548 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package rbd-fuse. 2024-04-15T15:28:31.551 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-15T15:28:31.558 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:31.566 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:31.609 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:31.630 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking rbd-fuse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:31.870 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-15T15:28:31.883 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-15T15:28:31.937 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-15T15:28:31.946 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-15T15:28:32.223 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2024-04-15T15:28:32.227 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-15T15:28:32.236 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-15T15:28:32.281 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-15T15:28:32.387 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-15T15:28:32.618 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2024-04-15T15:28:32.631 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-15T15:28:32.632 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:32.693 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:33.033 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-15T15:28:33.071 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2024-04-15T15:28:33.085 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:33.146 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:33.691 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2024-04-15T15:28:33.703 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:33.721 INFO:teuthology.orchestra.run.smithi118.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-15T15:28:33.735 INFO:teuthology.orchestra.run.smithi118.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-15T15:28:33.741 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:33.839 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephadm (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:34.349 INFO:teuthology.orchestra.run.smithi118.stdout:Adding system user cephadm....done 2024-04-15T15:28:34.528 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2024-04-15T15:28:34.528 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-15T15:28:34.542 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-ceph_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:34.586 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:34.821 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-15T15:28:34.864 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2024-04-15T15:28:34.877 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:34.913 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:35.072 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-15T15:28:35.231 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-15T15:28:35.292 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2024-04-15T15:28:35.305 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:35.350 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:35.499 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-15T15:28:35.728 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2024-04-15T15:28:35.741 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-cephadm_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:35.775 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-15T15:28:35.778 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:35.951 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-15T15:28:36.089 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-15T15:28:36.102 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-15T15:28:36.139 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-15T15:28:36.286 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-15T15:28:36.483 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-15T15:28:36.496 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-15T15:28:36.533 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-15T15:28:36.646 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-15T15:28:36.947 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-15T15:28:37.232 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-15T15:28:37.516 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-15T15:28:37.722 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-babel. 2024-04-15T15:28:37.734 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-15T15:28:37.772 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-15T15:28:37.776 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-15T15:28:38.027 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-15T15:28:38.092 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2024-04-15T15:28:38.103 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-15T15:28:38.141 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-15T15:28:38.337 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-15T15:28:38.520 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-15T15:28:38.531 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:38.569 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:38.621 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-argparse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:38.905 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-15T15:28:38.906 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-15T15:28:38.918 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-15T15:28:38.956 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-15T15:28:39.056 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-15T15:28:39.182 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-15T15:28:39.259 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2024-04-15T15:28:39.271 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-15T15:28:39.309 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-15T15:28:39.450 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-15T15:28:39.584 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-15T15:28:39.671 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-15T15:28:39.683 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:39.721 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:39.843 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-15T15:28:40.289 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-15T15:28:40.341 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-15T15:28:40.414 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-15T15:28:40.565 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-15T15:28:40.901 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-15T15:28:40.913 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-15T15:28:40.951 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-15T15:28:40.982 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-15T15:28:41.100 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-15T15:28:41.384 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-15T15:28:41.421 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2024-04-15T15:28:41.433 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-15T15:28:41.471 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-15T15:28:41.727 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-15T15:28:41.858 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-15T15:28:41.870 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-15T15:28:41.985 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-15T15:28:42.070 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up zip (3.0-12build2) ... 2024-04-15T15:28:42.213 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-15T15:28:42.255 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2024-04-15T15:28:42.267 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-15T15:28:42.296 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-15T15:28:42.907 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-15T15:28:42.925 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-15T15:28:42.937 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:42.966 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:43.182 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-15T15:28:43.308 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-15T15:28:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-15T15:28:43.785 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-15T15:28:43.936 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2024-04-15T15:28:43.949 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-15T15:28:43.994 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-15T15:28:44.220 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-15T15:28:44.297 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-15T15:28:44.313 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-15T15:28:44.355 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-15T15:28:44.496 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-15T15:28:44.683 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-15T15:28:44.698 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-15T15:28:44.742 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-15T15:28:44.906 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-15T15:28:45.070 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2024-04-15T15:28:45.084 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-15T15:28:45.136 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-15T15:28:45.215 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-15T15:28:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2024-04-15T15:28:45.478 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-15T15:28:45.523 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-15T15:28:45.575 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-15T15:28:45.801 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-15T15:28:45.815 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-15T15:28:45.892 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-15T15:28:45.935 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-15T15:28:46.179 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2024-04-15T15:28:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-15T15:28:46.236 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-15T15:28:46.237 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-15T15:28:46.395 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-common (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:46.566 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-15T15:28:46.580 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-15T15:28:46.624 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-15T15:28:46.771 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-idna (3.3-1) ... 2024-04-15T15:28:47.131 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-15T15:28:47.329 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-15T15:28:47.342 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:47.379 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:47.707 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-15T15:28:47.720 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-15T15:28:47.765 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-15T15:28:48.110 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-15T15:28:48.124 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-15T15:28:48.168 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-15T15:28:48.395 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-15T15:28:48.396 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2024-04-15T15:28:48.410 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-15T15:28:48.454 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-15T15:28:48.646 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:28:48.706 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2024-04-15T15:28:48.721 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-15T15:28:48.773 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-15T15:28:48.780 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-15T15:28:49.057 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-15T15:28:49.093 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2024-04-15T15:28:49.107 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-15T15:28:49.151 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-15T15:28:49.183 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-15T15:28:49.325 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-15T15:28:49.497 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2024-04-15T15:28:49.510 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:49.555 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-15T15:28:49.945 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-15T15:28:50.237 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:28:50.413 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-15T15:28:50.757 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-15T15:28:51.024 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-15T15:28:51.317 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-15T15:28:51.559 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2024-04-15T15:28:51.574 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:51.609 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:51.851 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-15T15:28:51.963 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-15T15:28:51.977 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:52.013 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-mirror (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:52.152 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-15T15:28:52.308 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-colorama. 2024-04-15T15:28:52.322 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-15T15:28:52.382 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-15T15:28:52.437 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-15T15:28:52.621 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-15T15:28:52.893 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-shell. 2024-04-15T15:28:52.908 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:52.930 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-15T15:28:52.951 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-shell (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:53.056 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-15T15:28:53.213 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-top. 2024-04-15T15:28:53.227 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2861-g9bf1c4ba-1jammy_all.deb ... 2024-04-15T15:28:53.270 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-top (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:53.357 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-15T15:28:53.515 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-15T15:28:53.530 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:28:53.573 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:53.684 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-15T15:28:53.893 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-15T15:28:53.907 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-15T15:28:53.943 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-15T15:28:53.951 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-15T15:28:54.111 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-15T15:28:54.237 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-15T15:28:54.280 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-15T15:28:54.295 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-15T15:28:54.325 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-15T15:28:54.338 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-15T15:28:54.613 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-15T15:28:54.701 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2024-04-15T15:28:54.715 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-15T15:28:54.751 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-15T15:28:54.781 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-15T15:28:55.106 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package pkg-config. 2024-04-15T15:28:55.120 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-15T15:28:55.155 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-15T15:28:55.182 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-15T15:28:55.400 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-15T15:28:55.414 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-15T15:28:55.458 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-15T15:28:55.525 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-15T15:28:55.676 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-15T15:28:55.870 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-15T15:28:55.883 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-15T15:28:55.928 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-15T15:28:55.977 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:28:56.120 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-15T15:28:56.230 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2024-04-15T15:28:56.244 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-15T15:28:56.289 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-15T15:28:56.505 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-15T15:28:56.626 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2024-04-15T15:28:56.640 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-15T15:28:56.684 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-15T15:28:56.847 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-15T15:28:56.995 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2024-04-15T15:28:57.009 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-15T15:28:57.053 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-15T15:28:57.190 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-15T15:28:57.384 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-15T15:28:57.389 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2024-04-15T15:28:57.404 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-15T15:28:57.447 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-15T15:28:57.702 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-15T15:28:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pygments. 2024-04-15T15:28:57.824 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-15T15:28:57.867 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-15T15:28:58.004 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-15T15:28:58.305 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-15T15:28:58.330 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-15T15:28:58.343 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-15T15:28:58.388 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-15T15:28:58.699 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-toml. 2024-04-15T15:28:58.713 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-15T15:28:58.732 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-15T15:28:58.757 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-15T15:28:59.025 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-15T15:28:59.060 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2024-04-15T15:28:59.074 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-15T15:28:59.118 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-15T15:28:59.385 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-15T15:28:59.422 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2024-04-15T15:28:59.436 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-15T15:28:59.471 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-15T15:28:59.545 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librados2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:59.704 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:28:59.754 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-15T15:28:59.769 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-15T15:28:59.807 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-15T15:28:59.872 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-15T15:29:00.224 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:00.375 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libradosstriper1 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:00.453 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2024-04-15T15:29:00.466 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../122-radosgw_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:29:00.511 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:00.551 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-15T15:29:00.870 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librbd1 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:00.996 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-modules-core (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:01.121 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-fuse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:01.148 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2024-04-15T15:29:01.162 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2861-g9bf1c4ba-1jammy_amd64.deb ... 2024-04-15T15:29:01.206 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:01.333 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-15T15:29:01.333 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-15T15:29:01.490 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-15T15:29:01.753 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-15T15:29:01.878 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-15T15:29:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs-dev (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:02.090 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rados (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:02.166 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-15T15:29:02.208 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librgw2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:02.309 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephfs-top (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:02.426 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-15T15:29:02.555 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-15T15:29:03.114 INFO:teuthology.orchestra.run.smithi073.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-15T15:29:03.161 INFO:teuthology.orchestra.run.smithi073.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-15T15:29:03.272 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:03.714 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rbd (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:03.765 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2024-04-15T15:29:03.873 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up rbd-fuse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:03.919 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-15T15:29:04.024 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rgw (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:04.158 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cephfs (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:04.195 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-15T15:29:04.259 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephfs-shell (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:04.377 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-common (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:04.455 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-15T15:29:04.581 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-15T15:29:04.824 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-15T15:29:04.920 INFO:teuthology.orchestra.run.smithi118.stdout:Adding group ceph....done 2024-04-15T15:29:05.067 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-15T15:29:05.226 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-15T15:29:05.271 INFO:teuthology.orchestra.run.smithi118.stdout:Adding system user ceph....done 2024-04-15T15:29:05.432 INFO:teuthology.orchestra.run.smithi118.stdout:Setting system user ceph properties....done 2024-04-15T15:29:05.449 INFO:teuthology.orchestra.run.smithi118.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-15T15:29:05.536 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-15T15:29:05.588 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-15T15:29:05.904 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-15T15:29:05.981 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-15T15:29:06.206 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-15T15:29:06.490 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-15T15:29:06.661 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephfs-mirror (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:06.750 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-15T15:29:06.869 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-15T15:29:06.870 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-15T15:29:06.984 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-15T15:29:07.261 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-15T15:29:07.504 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-test (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:07.537 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-15T15:29:07.680 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up radosgw (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:07.804 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:08.072 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-15T15:29:08.250 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-15T15:29:08.250 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-15T15:29:08.473 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-15T15:29:08.607 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-15T15:29:08.875 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-15T15:29:08.915 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-base (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:09.001 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-15T15:29:09.269 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-15T15:29:09.358 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-15T15:29:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-15T15:29:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-15T15:29:09.772 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-15T15:29:09.898 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-15T15:29:10.008 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mds (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:10.230 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-15T15:29:10.231 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-15T15:29:10.274 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-15T15:29:10.384 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-15T15:29:10.651 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-15T15:29:10.851 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:10.919 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-15T15:29:11.074 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-15T15:29:11.074 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-15T15:29:11.254 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up zip (3.0-12build2) ... 2024-04-15T15:29:11.379 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-15T15:29:11.728 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-osd (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:12.073 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-15T15:29:12.095 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-15T15:29:12.095 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-15T15:29:12.341 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-15T15:29:12.450 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-15T15:29:12.559 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-15T15:29:12.738 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:12.852 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-15T15:29:12.864 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:12.998 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mon (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:13.190 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-15T15:29:13.190 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-15T15:29:13.253 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-15T15:29:13.513 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-15T15:29:13.841 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-cephadm (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:13.914 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-15T15:29:13.992 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:14.185 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-dashboard (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:14.224 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-15T15:29:14.344 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-volume (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:14.542 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-15T15:29:14.705 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-15T15:29:14.822 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-15T15:29:14.902 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-15T15:29:14.999 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-15T15:29:15.152 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-15T15:29:15.262 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:15.563 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-idna (3.3-1) ... 2024-04-15T15:29:15.906 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-15T15:29:16.084 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-15T15:29:16.838 INFO:teuthology.orchestra.run.smithi118.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-15T15:29:16.843 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-15T15:29:16.916 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2024-04-15T15:29:17.089 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2024-04-15T15:29:17.089 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2024-04-15T15:29:17.120 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-15T15:29:17.257 INFO:teuthology.orchestra.run.smithi118.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-15T15:29:17.257 INFO:teuthology.orchestra.run.smithi118.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-15T15:29:17.257 INFO:teuthology.orchestra.run.smithi118.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-15T15:29:17.257 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages were automatically installed and are no longer required: 2024-04-15T15:29:17.257 INFO:teuthology.orchestra.run.smithi118.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-15T15:29:17.257 INFO:teuthology.orchestra.run.smithi118.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-15T15:29:17.257 INFO:teuthology.orchestra.run.smithi118.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-15T15:29:17.257 INFO:teuthology.orchestra.run.smithi118.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-15T15:29:17.258 INFO:teuthology.orchestra.run.smithi118.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-15T15:29:17.258 INFO:teuthology.orchestra.run.smithi118.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-15T15:29:17.258 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2024-04-15T15:29:17.258 INFO:teuthology.orchestra.run.smithi118.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-15T15:29:17.258 INFO:teuthology.orchestra.run.smithi118.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-15T15:29:17.259 INFO:teuthology.orchestra.run.smithi118.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-15T15:29:17.259 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-15T15:29:17.259 INFO:teuthology.orchestra.run.smithi118.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-15T15:29:17.260 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2024-04-15T15:29:17.260 INFO:teuthology.orchestra.run.smithi118.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-15T15:29:17.260 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-15T15:29:17.260 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-15T15:29:17.314 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2024-04-15T15:29:17.315 INFO:teuthology.orchestra.run.smithi118.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-15T15:29:17.315 INFO:teuthology.orchestra.run.smithi118.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-15T15:29:17.316 INFO:teuthology.orchestra.run.smithi118.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-15T15:29:17.316 INFO:teuthology.orchestra.run.smithi118.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-15T15:29:17.316 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-15T15:29:17.316 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-15T15:29:17.316 INFO:teuthology.orchestra.run.smithi118.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-15T15:29:17.317 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages will be upgraded: 2024-04-15T15:29:17.317 INFO:teuthology.orchestra.run.smithi118.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-15T15:29:17.363 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:29:17.498 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-15T15:29:17.501 INFO:teuthology.orchestra.run.smithi118.stdout:4 upgraded, 39 newly installed, 0 to remove and 299 not upgraded. 2024-04-15T15:29:17.501 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 55.7 MB of archives. 2024-04-15T15:29:17.501 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-15T15:29:17.502 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-15T15:29:17.782 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-15T15:29:17.900 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-15T15:29:18.051 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-15T15:29:18.149 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-15T15:29:18.166 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-15T15:29:18.292 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-15T15:29:18.293 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-15T15:29:18.293 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-15T15:29:18.322 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-15T15:29:18.323 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-15T15:29:18.326 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-15T15:29:18.328 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-15T15:29:18.329 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-15T15:29:18.352 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-15T15:29:18.495 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-15T15:29:18.620 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-15T15:29:18.788 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-15T15:29:18.797 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-15T15:29:18.802 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-15T15:29:18.887 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-15T15:29:18.887 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:29:19.030 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-15T15:29:19.340 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-15T15:29:19.599 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-15T15:29:19.854 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-15T15:29:19.856 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-15T15:29:19.856 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-15T15:29:19.883 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-15T15:29:19.883 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-15T15:29:19.883 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-15T15:29:19.887 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-15T15:29:20.052 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-15T15:29:20.143 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-15T15:29:20.394 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-15T15:29:20.657 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-15T15:29:20.658 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-15T15:29:20.662 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-15T15:29:20.787 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-15T15:29:20.837 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-15T15:29:20.838 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-15T15:29:20.876 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-15T15:29:20.933 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-15T15:29:20.939 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-15T15:29:20.940 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-15T15:29:20.940 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-15T15:29:20.941 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-15T15:29:21.081 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-15T15:29:21.146 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-15T15:29:21.206 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-15T15:29:21.491 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-15T15:29:21.567 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-15T15:29:21.800 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-15T15:29:22.077 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-15T15:29:22.236 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-15T15:29:22.320 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-15T15:29:22.320 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-15T15:29:22.320 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-15T15:29:22.321 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-15T15:29:22.321 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-15T15:29:22.321 INFO:teuthology.orchestra.run.smithi118.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-15T15:29:22.357 INFO:teuthology.orchestra.run.smithi118.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-15T15:29:22.357 INFO:teuthology.orchestra.run.smithi118.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-15T15:29:22.362 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-15T15:29:22.450 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-15T15:29:22.680 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-15T15:29:22.743 INFO:teuthology.orchestra.run.smithi118.stdout:Preconfiguring packages ... 2024-04-15T15:29:22.806 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-15T15:29:23.125 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 55.7 MB in 5s (11.1 MB/s) 2024-04-15T15:29:23.225 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-15T15:29:23.353 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140915 files and directories currently installed.) 2024-04-15T15:29:23.357 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-15T15:29:23.483 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-15T15:29:23.492 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-15T15:29:23.618 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-15T15:29:23.886 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-15T15:29:24.012 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-15T15:29:24.166 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-15T15:29:24.338 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-15T15:29:24.647 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-15T15:29:24.932 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-15T15:29:25.143 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-15T15:29:25.281 INFO:teuthology.orchestra.run.smithi118.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-15T15:29:25.402 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-15T15:29:25.540 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package flex. 2024-04-15T15:29:25.611 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140915 files and directories currently installed.) 2024-04-15T15:29:25.615 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-15T15:29:25.663 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-15T15:29:25.696 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-15T15:29:25.963 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-15T15:29:26.216 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-15T15:29:26.349 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-15T15:29:26.385 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-15T15:29:26.658 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-15T15:29:26.826 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-15T15:29:27.011 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-15T15:29:27.137 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:27.263 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:27.389 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-15T15:29:27.411 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140988 files and directories currently installed.) 2024-04-15T15:29:27.414 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-15T15:29:27.534 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-15T15:29:27.708 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:27.834 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:27.929 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-15T15:29:27.960 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-15T15:29:28.133 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-15T15:29:28.246 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:28.371 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:28.457 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-15T15:29:28.531 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-15T15:29:28.741 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-15T15:29:28.850 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package bison. 2024-04-15T15:29:28.926 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140988 files and directories currently installed.) 2024-04-15T15:29:28.930 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-15T15:29:28.977 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-15T15:29:29.351 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:29.394 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-15T15:29:29.408 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-15T15:29:29.476 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:29.478 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-15T15:29:29.744 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:29.870 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-top (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:29.940 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package dump. 2024-04-15T15:29:29.955 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-15T15:29:29.996 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-15T15:29:29.997 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking dump (0.4b47-3) ... 2024-04-15T15:29:30.293 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package indent. 2024-04-15T15:29:30.308 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:29:30.351 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-15T15:29:30.613 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-15T15:29:30.628 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-15T15:29:30.671 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-15T15:29:31.000 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-15T15:29:31.015 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-15T15:29:31.049 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-15T15:29:31.283 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:31.285 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-15T15:29:31.301 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-15T15:29:31.343 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-15T15:29:31.409 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:31.510 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:31.636 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:31.722 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-15T15:29:31.737 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-15T15:29:31.780 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-15T15:29:31.787 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-shell (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:31.913 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:32.033 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-15T15:29:32.048 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-15T15:29:32.091 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-15T15:29:32.327 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjson-perl. 2024-04-15T15:29:32.342 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-15T15:29:32.419 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-15T15:29:32.449 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2024-04-15T15:29:32.731 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-15T15:29:32.746 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-15T15:29:32.789 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-15T15:29:32.833 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2024-04-15T15:29:33.011 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2024-04-15T15:29:33.029 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-15T15:29:33.169 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-15T15:29:33.557 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-15T15:29:34.368 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-mirror (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:34.409 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-15T15:29:34.425 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-15T15:29:34.476 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-15T15:29:34.578 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-15T15:29:34.578 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-15T15:29:34.745 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-15T15:29:34.760 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-15T15:29:34.794 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-15T15:29:35.106 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-15T15:29:35.121 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-15T15:29:35.162 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:35.164 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-15T15:29:35.278 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:35.525 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-15T15:29:35.541 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-15T15:29:35.584 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-15T15:29:35.813 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-15T15:29:35.813 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-15T15:29:35.886 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-15T15:29:35.901 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-15T15:29:35.936 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-15T15:29:36.281 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-15T15:29:36.297 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:29:36.339 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:29:36.413 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:36.667 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-15T15:29:36.683 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:29:36.725 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-15T15:29:36.765 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-15T15:29:37.070 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-15T15:29:37.085 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:29:37.128 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-15T15:29:37.347 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-15T15:29:37.362 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-15T15:29:37.390 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:37.405 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-15T15:29:37.630 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-15T15:29:37.630 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-15T15:29:37.942 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-15T15:29:37.958 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-15T15:29:38.000 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-15T15:29:38.242 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:38.445 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-15T15:29:38.445 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-15T15:29:38.471 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package modemmanager. 2024-04-15T15:29:38.487 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-15T15:29:38.529 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-15T15:29:39.052 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:39.211 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package network-manager. 2024-04-15T15:29:39.227 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-15T15:29:39.278 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-15T15:29:39.427 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-15T15:29:39.427 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-15T15:29:39.835 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ppp. 2024-04-15T15:29:39.851 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-15T15:29:40.054 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:40.180 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:40.207 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-15T15:29:40.347 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:40.558 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-15T15:29:40.558 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-15T15:29:40.573 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package pptp-linux. 2024-04-15T15:29:40.587 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-15T15:29:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-15T15:29:40.867 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-15T15:29:40.881 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-15T15:29:40.925 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-15T15:29:41.157 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:41.261 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-15T15:29:41.276 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-15T15:29:41.317 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:41.320 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-client-common (238) ... 2024-04-15T15:29:41.443 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:41.574 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-15T15:29:41.585 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (19.0.0-2861-g9bf1c4ba-1jammy) ... 2024-04-15T15:29:41.589 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:29:41.632 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:29:41.921 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-15T15:29:42.038 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-15T15:29:42.190 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-15T15:29:42.228 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-common. 2024-04-15T15:29:42.243 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-15T15:29:42.304 INFO:teuthology.orchestra.run.smithi118.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-15T15:29:42.335 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-common (238) ... 2024-04-15T15:29:42.827 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-14. 2024-04-15T15:29:42.842 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:29:42.888 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:29:43.316 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-15T15:29:43.947 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql. 2024-04-15T15:29:43.962 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-15T15:29:43.992 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-15T15:29:43.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-15T15:29:43.997 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql (14+238) ... 2024-04-15T15:29:44.070 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-15T15:29:44.207 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-client. 2024-04-15T15:29:44.221 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-15T15:29:44.243 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-15T15:29:44.244 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-15T15:29:44.298 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-client (14+238) ... 2024-04-15T15:29:44.418 INFO:teuthology.orchestra.run.smithi073.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-15T15:29:44.418 INFO:teuthology.orchestra.run.smithi073.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-15T15:29:44.418 INFO:teuthology.orchestra.run.smithi073.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-15T15:29:44.418 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-15T15:29:44.418 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-15T15:29:44.418 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-15T15:29:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-15T15:29:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-15T15:29:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-15T15:29:44.420 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-15T15:29:44.420 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-04-15T15:29:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-15T15:29:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-15T15:29:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-15T15:29:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-15T15:29:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-15T15:29:44.421 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-04-15T15:29:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-15T15:29:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-15T15:29:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-15T15:29:44.475 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-04-15T15:29:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-15T15:29:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-15T15:29:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-15T15:29:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-15T15:29:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-15T15:29:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-15T15:29:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-15T15:29:44.478 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-04-15T15:29:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-15T15:29:44.542 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-15T15:29:44.556 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-15T15:29:44.566 INFO:teuthology.orchestra.run.smithi073.stdout:4 upgraded, 39 newly installed, 0 to remove and 299 not upgraded. 2024-04-15T15:29:44.566 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 55.7 MB of archives. 2024-04-15T15:29:44.566 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-15T15:29:44.566 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-15T15:29:44.601 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-15T15:29:44.733 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-15T15:29:44.741 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-15T15:29:44.772 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-15T15:29:44.772 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-15T15:29:44.773 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-15T15:29:44.782 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-15T15:29:44.783 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-15T15:29:44.785 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-15T15:29:44.786 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-15T15:29:44.787 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-15T15:29:44.788 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-15T15:29:44.799 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-15T15:29:44.799 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-15T15:29:44.800 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-15T15:29:44.820 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-15T15:29:44.919 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package tcl8.6. 2024-04-15T15:29:44.935 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-15T15:29:45.002 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-15T15:29:45.146 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-15T15:29:45.148 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-15T15:29:45.148 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-15T15:29:45.151 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-15T15:29:45.152 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-15T15:29:45.156 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-15T15:29:45.158 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-15T15:29:45.167 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-15T15:29:45.167 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-15T15:29:45.190 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-15T15:29:45.196 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-15T15:29:45.207 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-15T15:29:45.229 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-15T15:29:45.233 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-15T15:29:45.234 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-15T15:29:45.235 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-15T15:29:45.236 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-15T15:29:45.248 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-15T15:29:45.252 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-15T15:29:45.289 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package tcl. 2024-04-15T15:29:45.304 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-15T15:29:45.344 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-15T15:29:45.439 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-15T15:29:45.439 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-15T15:29:45.439 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-15T15:29:45.439 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-15T15:29:45.440 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-15T15:29:45.440 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-15T15:29:45.453 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-15T15:29:45.453 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-15T15:29:45.692 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package wpasupplicant. 2024-04-15T15:29:45.707 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-15T15:29:45.750 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-15T15:29:45.826 INFO:teuthology.orchestra.run.smithi073.stdout:Preconfiguring packages ... 2024-04-15T15:29:45.964 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 55.7 MB in 1s (57.6 MB/s) 2024-04-15T15:29:46.095 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-15T15:29:46.111 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-15T15:29:46.153 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-15T15:29:46.243 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140915 files and directories currently installed.) 2024-04-15T15:29:46.246 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-15T15:29:46.389 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-15T15:29:46.549 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-15T15:29:46.564 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-15T15:29:46.616 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-15T15:29:46.925 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-client-common (238) ... 2024-04-15T15:29:47.022 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-15T15:29:47.171 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-15T15:29:47.306 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-15T15:29:47.431 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:29:47.557 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-15T15:29:47.683 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-15T15:29:47.801 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:29:48.065 INFO:teuthology.orchestra.run.smithi073.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-15T15:29:48.336 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package flex. 2024-04-15T15:29:48.407 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140915 files and directories currently installed.) 2024-04-15T15:29:48.410 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-15T15:29:48.467 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-15T15:29:48.769 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-15T15:29:48.961 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-15T15:29:48.998 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-15T15:29:49.114 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-15T15:29:49.382 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-15T15:29:49.383 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-15T15:29:49.470 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-15T15:29:50.019 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140988 files and directories currently installed.) 2024-04-15T15:29:50.023 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-15T15:29:50.101 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-15T15:29:50.130 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-15T15:29:50.235 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-15T15:29:50.344 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-15T15:29:50.470 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-15T15:29:50.517 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-15T15:29:50.596 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-15T15:29:50.653 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-15T15:29:50.722 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-15T15:29:50.848 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-15T15:29:50.985 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-15T15:29:50.999 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-15T15:29:51.329 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package bison. 2024-04-15T15:29:51.407 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140988 files and directories currently installed.) 2024-04-15T15:29:51.411 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-15T15:29:51.456 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-15T15:29:51.654 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-15T15:29:51.789 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up dump (0.4b47-3) ... 2024-04-15T15:29:51.873 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-15T15:29:51.883 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-15T15:29:51.888 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-15T15:29:51.932 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-15T15:29:51.948 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-15T15:29:52.074 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-15T15:29:52.201 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-15T15:29:52.268 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package dump. 2024-04-15T15:29:52.284 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-15T15:29:52.326 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking dump (0.4b47-3) ... 2024-04-15T15:29:52.343 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-15T15:29:52.460 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-15T15:29:52.533 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-15T15:29:52.595 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-15T15:29:52.605 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package indent. 2024-04-15T15:29:52.621 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:29:52.663 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-15T15:29:52.729 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-15T15:29:52.906 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-15T15:29:52.933 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-15T15:29:52.948 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-15T15:29:52.983 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-15T15:29:53.049 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-15T15:29:53.174 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-15T15:29:53.312 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-15T15:29:53.326 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-15T15:29:53.342 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-client (14+238) ... 2024-04-15T15:29:53.370 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-15T15:29:53.468 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-15T15:29:53.633 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-15T15:29:53.646 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-15T15:29:53.689 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-15T15:29:54.026 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-15T15:29:54.042 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-15T15:29:54.076 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-15T15:29:54.304 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-15T15:29:54.318 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-15T15:29:54.359 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:29:54.359 INFO:teuthology.orchestra.run.smithi118.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-15T15:29:54.359 INFO:teuthology.orchestra.run.smithi118.stdout:which means they are currently configured by ifupdown: 2024-04-15T15:29:54.359 INFO:teuthology.orchestra.run.smithi118.stdout:- enp3s0f1 2024-04-15T15:29:54.360 INFO:teuthology.orchestra.run.smithi118.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-15T15:29:54.360 INFO:teuthology.orchestra.run.smithi118.stdout:remove their configuration from /etc/network/interfaces. 2024-04-15T15:29:54.360 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:29:54.362 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-15T15:29:54.491 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-15T15:29:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjson-perl. 2024-04-15T15:29:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-15T15:29:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-15T15:29:54.899 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-15T15:29:55.007 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-15T15:29:55.023 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-15T15:29:55.068 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-15T15:29:55.307 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-15T15:29:56.038 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-15T15:29:56.189 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-15T15:29:56.348 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-15T15:29:56.474 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-common (238) ... 2024-04-15T15:29:56.537 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-15T15:29:56.553 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-15T15:29:56.604 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-15T15:29:56.915 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-15T15:29:56.931 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-15T15:29:56.981 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-15T15:29:57.393 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-15T15:29:57.409 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-15T15:29:57.425 INFO:teuthology.orchestra.run.smithi118.stdout:Adding user postgres to group ssl-cert 2024-04-15T15:29:57.459 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-15T15:29:57.679 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:29:57.679 INFO:teuthology.orchestra.run.smithi118.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-15T15:29:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-15T15:29:57.820 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-15T15:29:57.870 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-15T15:29:57.932 INFO:teuthology.orchestra.run.smithi118.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-15T15:29:57.932 INFO:teuthology.orchestra.run.smithi118.stdout:Removing obsolete dictionary files: 2024-04-15T15:29:58.282 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-15T15:29:58.298 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-15T15:29:58.348 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-15T15:29:58.664 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-15T15:29:58.760 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-15T15:29:58.776 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:29:58.826 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:29:59.175 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:29:59.187 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-15T15:29:59.204 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:29:59.271 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-15T15:29:59.518 INFO:teuthology.orchestra.run.smithi118.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-15T15:29:59.542 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-15T15:29:59.651 INFO:teuthology.orchestra.run.smithi118.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-15T15:29:59.652 INFO:teuthology.orchestra.run.smithi118.stdout:This user must also own the server process. 2024-04-15T15:29:59.652 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:29:59.652 INFO:teuthology.orchestra.run.smithi118.stdout:The database cluster will be initialized with locale "en_US". 2024-04-15T15:29:59.652 INFO:teuthology.orchestra.run.smithi118.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-15T15:29:59.653 INFO:teuthology.orchestra.run.smithi118.stdout:The default text search configuration will be set to "english". 2024-04-15T15:29:59.653 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:29:59.653 INFO:teuthology.orchestra.run.smithi118.stdout:Data page checksums are disabled. 2024-04-15T15:29:59.653 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:29:59.653 INFO:teuthology.orchestra.run.smithi118.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-15T15:29:59.653 INFO:teuthology.orchestra.run.smithi118.stdout:creating subdirectories ... ok 2024-04-15T15:29:59.653 INFO:teuthology.orchestra.run.smithi118.stdout:selecting dynamic shared memory implementation ... posix 2024-04-15T15:29:59.676 INFO:teuthology.orchestra.run.smithi118.stdout:selecting default max_connections ... 100 2024-04-15T15:29:59.709 INFO:teuthology.orchestra.run.smithi118.stdout:selecting default shared_buffers ... 128MB 2024-04-15T15:29:59.723 INFO:teuthology.orchestra.run.smithi118.stdout:selecting default time zone ... Etc/UTC 2024-04-15T15:29:59.724 INFO:teuthology.orchestra.run.smithi118.stdout:creating configuration files ... ok 2024-04-15T15:29:59.791 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-15T15:29:59.806 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:29:59.857 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-15T15:29:59.889 INFO:teuthology.orchestra.run.smithi118.stdout:running bootstrap script ... ok 2024-04-15T15:30:00.152 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-15T15:30:00.167 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-15T15:30:00.226 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-15T15:30:00.620 INFO:teuthology.orchestra.run.smithi118.stdout:performing post-bootstrap initialization ... ok 2024-04-15T15:30:00.738 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-15T15:30:00.753 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-15T15:30:00.805 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-15T15:30:01.206 INFO:teuthology.orchestra.run.smithi118.stdout:syncing data to disk ... ok 2024-04-15T15:30:01.233 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package modemmanager. 2024-04-15T15:30:01.248 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-15T15:30:01.299 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-15T15:30:01.716 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-15T15:30:02.006 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package network-manager. 2024-04-15T15:30:02.022 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-15T15:30:02.072 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-15T15:30:02.689 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ppp. 2024-04-15T15:30:02.705 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-15T15:30:03.017 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-15T15:30:03.343 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package pptp-linux. 2024-04-15T15:30:03.357 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-15T15:30:03.401 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-15T15:30:03.679 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-15T15:30:03.693 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-15T15:30:03.746 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-15T15:30:04.016 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-15T15:30:04.030 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-15T15:30:04.065 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client-common (238) ... 2024-04-15T15:30:04.369 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-15T15:30:04.384 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:30:04.428 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:30:04.649 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-15T15:30:04.796 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-15T15:30:04.926 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql (14+238) ... 2024-04-15T15:30:05.051 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-15T15:30:05.178 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-15T15:30:05.445 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-15T15:30:05.445 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-15T15:30:05.499 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-common. 2024-04-15T15:30:05.514 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-15T15:30:05.576 INFO:teuthology.orchestra.run.smithi073.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-15T15:30:05.598 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-common (238) ... 2024-04-15T15:30:06.014 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-14. 2024-04-15T15:30:06.029 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-15T15:30:06.075 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:30:06.180 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-15T15:30:06.297 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-15T15:30:06.641 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-15T15:30:06.793 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-15T15:30:07.184 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql. 2024-04-15T15:30:07.198 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-15T15:30:07.242 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql (14+238) ... 2024-04-15T15:30:07.461 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client. 2024-04-15T15:30:07.476 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-15T15:30:07.511 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client (14+238) ... 2024-04-15T15:30:07.738 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-15T15:30:07.753 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-15T15:30:07.830 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-15T15:30:08.149 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package tcl8.6. 2024-04-15T15:30:08.164 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-15T15:30:08.203 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-15T15:30:08.207 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-15T15:30:08.303 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-15T15:30:08.493 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package tcl. 2024-04-15T15:30:08.509 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-15T15:30:08.556 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-15T15:30:08.821 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package wpasupplicant. 2024-04-15T15:30:08.837 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-15T15:30:08.860 INFO:teuthology.orchestra.run.smithi118.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-15T15:30:08.869 DEBUG:teuthology.parallel:result is None 2024-04-15T15:30:08.904 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-15T15:30:09.225 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-15T15:30:09.241 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-15T15:30:09.283 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-15T15:30:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-15T15:30:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-15T15:30:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-15T15:30:10.005 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client-common (238) ... 2024-04-15T15:30:10.217 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-15T15:30:10.343 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-15T15:30:10.478 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:30:10.604 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-15T15:30:10.730 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-15T15:30:10.856 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:30:11.807 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-15T15:30:11.903 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-15T15:30:12.300 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-15T15:30:12.301 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-15T15:30:12.923 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-15T15:30:13.040 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-15T15:30:13.183 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-15T15:30:13.309 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-15T15:30:13.435 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-15T15:30:13.563 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-15T15:30:13.689 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-15T15:30:13.806 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-15T15:30:14.462 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-15T15:30:14.597 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up dump (0.4b47-3) ... 2024-04-15T15:30:14.692 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-15T15:30:14.757 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-15T15:30:14.874 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-15T15:30:15.159 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-15T15:30:15.518 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-15T15:30:15.636 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-15T15:30:15.709 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-15T15:30:15.779 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-15T15:30:15.906 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-15T15:30:16.082 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-15T15:30:16.208 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-15T15:30:16.334 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-15T15:30:16.535 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client (14+238) ... 2024-04-15T15:30:16.661 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-15T15:30:17.254 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:17.255 INFO:teuthology.orchestra.run.smithi073.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-15T15:30:17.255 INFO:teuthology.orchestra.run.smithi073.stdout:which means they are currently configured by ifupdown: 2024-04-15T15:30:17.255 INFO:teuthology.orchestra.run.smithi073.stdout:- enp3s0f1 2024-04-15T15:30:17.255 INFO:teuthology.orchestra.run.smithi073.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-15T15:30:17.255 INFO:teuthology.orchestra.run.smithi073.stdout:remove their configuration from /etc/network/interfaces. 2024-04-15T15:30:17.255 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:17.386 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-15T15:30:17.770 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-15T15:30:18.173 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-15T15:30:18.847 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-15T15:30:18.965 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-15T15:30:19.100 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-15T15:30:19.226 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-common (238) ... 2024-04-15T15:30:20.201 INFO:teuthology.orchestra.run.smithi073.stdout:Adding user postgres to group ssl-cert 2024-04-15T15:30:20.430 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:20.431 INFO:teuthology.orchestra.run.smithi073.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-15T15:30:20.682 INFO:teuthology.orchestra.run.smithi073.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-15T15:30:20.682 INFO:teuthology.orchestra.run.smithi073.stdout:Removing obsolete dictionary files: 2024-04-15T15:30:21.391 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-15T15:30:21.869 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-15T15:30:22.214 INFO:teuthology.orchestra.run.smithi073.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-15T15:30:22.244 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-15T15:30:22.293 INFO:teuthology.orchestra.run.smithi073.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-15T15:30:22.293 INFO:teuthology.orchestra.run.smithi073.stdout:This user must also own the server process. 2024-04-15T15:30:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:22.293 INFO:teuthology.orchestra.run.smithi073.stdout:The database cluster will be initialized with locale "en_US". 2024-04-15T15:30:22.293 INFO:teuthology.orchestra.run.smithi073.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-15T15:30:22.293 INFO:teuthology.orchestra.run.smithi073.stdout:The default text search configuration will be set to "english". 2024-04-15T15:30:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:22.293 INFO:teuthology.orchestra.run.smithi073.stdout:Data page checksums are disabled. 2024-04-15T15:30:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:22.293 INFO:teuthology.orchestra.run.smithi073.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-15T15:30:22.294 INFO:teuthology.orchestra.run.smithi073.stdout:creating subdirectories ... ok 2024-04-15T15:30:22.294 INFO:teuthology.orchestra.run.smithi073.stdout:selecting dynamic shared memory implementation ... posix 2024-04-15T15:30:22.318 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default max_connections ... 100 2024-04-15T15:30:22.351 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default shared_buffers ... 128MB 2024-04-15T15:30:22.365 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default time zone ... Etc/UTC 2024-04-15T15:30:22.366 INFO:teuthology.orchestra.run.smithi073.stdout:creating configuration files ... ok 2024-04-15T15:30:22.532 INFO:teuthology.orchestra.run.smithi073.stdout:running bootstrap script ... ok 2024-04-15T15:30:23.176 INFO:teuthology.orchestra.run.smithi073.stdout:performing post-bootstrap initialization ... ok 2024-04-15T15:30:23.718 INFO:teuthology.orchestra.run.smithi073.stdout:syncing data to disk ... ok 2024-04-15T15:30:24.235 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-15T15:30:27.294 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-15T15:30:27.420 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-15T15:30:27.554 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql (14+238) ... 2024-04-15T15:30:27.680 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-15T15:30:27.798 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-15T15:30:28.042 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-15T15:30:28.042 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-15T15:30:28.775 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-15T15:30:28.876 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-15T15:30:29.212 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-15T15:30:29.363 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-15T15:30:30.809 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-15T15:30:30.909 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-15T15:30:31.429 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-15T15:30:31.436 DEBUG:teuthology.parallel:result is None 2024-04-15T15:30:31.437 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9bf1c4ba967dd24077be6e5b87edda4ca87a6e14 2024-04-15T15:30:31.587 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2024-04-15T15:30:31.609 INFO:teuthology.orchestra.run.smithi073.stdout:19.0.0-2861-g9bf1c4ba-1jammy 2024-04-15T15:30:31.609 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2861-g9bf1c4ba-1jammy 2024-04-15T15:30:31.609 INFO:teuthology.task.install:The correct ceph version 19.0.0-2861-g9bf1c4ba-1jammy is installed. 2024-04-15T15:30:31.612 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9bf1c4ba967dd24077be6e5b87edda4ca87a6e14 2024-04-15T15:30:31.887 DEBUG:teuthology.orchestra.run.smithi118:> dpkg-query -W -f '${Version}' ceph 2024-04-15T15:30:31.911 INFO:teuthology.orchestra.run.smithi118.stdout:19.0.0-2861-g9bf1c4ba-1jammy 2024-04-15T15:30:31.911 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2861-g9bf1c4ba-1jammy 2024-04-15T15:30:31.911 INFO:teuthology.task.install:The correct ceph version 19.0.0-2861-g9bf1c4ba-1jammy is installed. 2024-04-15T15:30:31.913 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-15T15:30:31.913 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:31.913 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T15:30:31.934 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:30:31.934 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T15:30:31.974 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-15T15:30:31.974 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:31.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T15:30:31.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T15:30:32.060 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:30:32.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T15:30:32.082 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T15:30:32.145 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-15T15:30:32.145 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:32.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T15:30:32.164 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T15:30:32.224 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:30:32.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T15:30:32.245 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T15:30:32.305 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-15T15:30:32.305 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:32.305 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T15:30:32.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T15:30:32.384 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:30:32.384 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T15:30:32.404 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T15:30:32.469 INFO:teuthology.run_tasks:Running task ceph... 2024-04-15T15:30:32.553 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-15T15:30:32.554 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-04-15T15:30:32.557 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2024-04-15T15:30:32.577 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-15T15:30:32.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-15T15:30:32.616 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-15T15:30:32.640 INFO:tasks.ceph:Creating extra log directories... 2024-04-15T15:30:32.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-15T15:30:32.676 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-15T15:30:32.708 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-15T15:30:32.708 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-15T15:30:32.708 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-15T15:30:32.708 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:32.708 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-15T15:30:32.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-15T15:30:32.827 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:30:32.827 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-15T15:30:32.835 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-15T15:30:32.931 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-15T15:30:32.931 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-15T15:30:32.931 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149', 'branch': 'wip-lusov-quiesce-xlock', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/quiesce}', 'email': None, 'first_in_suite': False, 'job_id': '7657149', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiesce-xlock'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request'], 'sha1': '9bf1c4ba967dd24077be6e5b87edda4ca87a6e14'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9bf1c4ba967dd24077be6e5b87edda4ca87a6e14'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiesce-xlock', 'sha1': '9bf1c4ba967dd24077be6e5b87edda4ca87a6e14'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5929, 'sha1': '9bf1c4ba967dd24077be6e5b87edda4ca87a6e14', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-lusov-quiesce-xlock', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '9bf1c4ba967dd24077be6e5b87edda4ca87a6e14', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP1yFPtNF4djnER2a5Tzj8HISpSxE2ok0zR9L2l4VyzfhRoRvmw2aI6dyBxFOcpTYbp+gzX6e4WOksp1idelL28=', 'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbsZRMhhQTg2OkI3DiREEAPxKc834j7fqByWOCKhckGRXPuwOMkjZ42tBj+67zXyu8FZWM7Ph+skG80R37dbqU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9bf1c4ba967dd24077be6e5b87edda4ca87a6e14'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request'], 'sha1': '9bf1c4ba967dd24077be6e5b87edda4ca87a6e14', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_quiesce']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-15_14:54:08', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-15T15:30:32.932 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-15T15:30:32.935 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-15T15:30:32.944 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T15:30:32.988 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T15:30:33.009 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:33.009 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T15:30:33.053 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T15:30:33.053 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-04-15T15:30:33.102 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T15:30:33.102 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T15:30:33.102 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 895 Links: 1 2024-04-15T15:30:33.102 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T15:30:33.102 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-04-15 15:23:45.460105964 +0000 2024-04-15T15:30:33.102 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-04-15 15:23:45.196116507 +0000 2024-04-15T15:30:33.102 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-04-15 15:23:45.196116507 +0000 2024-04-15T15:30:33.102 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-04-15 15:23:45.196116507 +0000 2024-04-15T15:30:33.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T15:30:33.162 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-04-15T15:30:33.162 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-04-15T15:30:33.162 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000373549 s, 1.4 MB/s 2024-04-15T15:30:33.164 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T15:30:33.219 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-04-15T15:30:33.273 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T15:30:33.273 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T15:30:33.273 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 911 Links: 1 2024-04-15T15:30:33.274 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T15:30:33.274 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-04-15 15:23:46.040082842 +0000 2024-04-15T15:30:33.274 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-04-15 15:23:45.768093667 +0000 2024-04-15T15:30:33.274 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-04-15 15:23:45.768093667 +0000 2024-04-15T15:30:33.274 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-04-15 15:23:45.768093667 +0000 2024-04-15T15:30:33.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T15:30:33.335 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-04-15T15:30:33.335 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-04-15T15:30:33.335 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000356887 s, 1.4 MB/s 2024-04-15T15:30:33.337 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T15:30:33.387 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-04-15T15:30:33.438 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T15:30:33.438 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T15:30:33.438 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 931 Links: 1 2024-04-15T15:30:33.438 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T15:30:33.438 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-04-15 15:23:46.588061506 +0000 2024-04-15T15:30:33.438 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-04-15 15:23:46.336071318 +0000 2024-04-15T15:30:33.438 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-04-15 15:23:46.336071318 +0000 2024-04-15T15:30:33.438 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-04-15 15:23:46.336071318 +0000 2024-04-15T15:30:33.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T15:30:33.503 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-04-15T15:30:33.503 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-04-15T15:30:33.503 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000356296 s, 1.4 MB/s 2024-04-15T15:30:33.505 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T15:30:33.556 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-04-15T15:30:33.611 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T15:30:33.612 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T15:30:33.612 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 945 Links: 1 2024-04-15T15:30:33.612 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T15:30:33.612 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-04-15 15:23:47.172038940 +0000 2024-04-15T15:30:33.612 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-04-15 15:23:46.896049516 +0000 2024-04-15T15:30:33.612 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-04-15 15:23:46.896049516 +0000 2024-04-15T15:30:33.612 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-04-15 15:23:46.896049516 +0000 2024-04-15T15:30:33.613 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T15:30:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-04-15T15:30:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-04-15T15:30:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00037243 s, 1.4 MB/s 2024-04-15T15:30:33.677 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T15:30:33.732 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T15:30:33.732 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:30:33.732 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T15:30:33.741 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T15:30:33.741 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2024-04-15T15:30:33.790 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T15:30:33.790 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T15:30:33.790 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 902 Links: 1 2024-04-15T15:30:33.790 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T15:30:33.790 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-04-15 15:23:44.696653138 +0000 2024-04-15T15:30:33.790 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-04-15 15:23:44.384655925 +0000 2024-04-15T15:30:33.790 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-04-15 15:23:44.384655925 +0000 2024-04-15T15:30:33.790 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-04-15 15:23:44.384655925 +0000 2024-04-15T15:30:33.790 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T15:30:33.852 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-04-15T15:30:33.852 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-04-15T15:30:33.852 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000272882 s, 1.9 MB/s 2024-04-15T15:30:33.854 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T15:30:33.907 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2024-04-15T15:30:33.958 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T15:30:33.958 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T15:30:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 921 Links: 1 2024-04-15T15:30:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T15:30:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-04-15 15:23:45.248648208 +0000 2024-04-15T15:30:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-04-15 15:23:44.992650494 +0000 2024-04-15T15:30:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-04-15 15:23:44.992650494 +0000 2024-04-15T15:30:33.958 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-04-15 15:23:44.992650494 +0000 2024-04-15T15:30:33.959 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T15:30:34.020 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-04-15T15:30:34.020 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-04-15T15:30:34.020 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000273507 s, 1.9 MB/s 2024-04-15T15:30:34.021 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T15:30:34.075 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2024-04-15T15:30:34.125 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T15:30:34.126 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T15:30:34.126 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 935 Links: 1 2024-04-15T15:30:34.126 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T15:30:34.126 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-04-15 15:23:45.568645349 +0000 2024-04-15T15:30:34.126 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-04-15 15:23:45.564645384 +0000 2024-04-15T15:30:34.126 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-04-15 15:23:45.564645384 +0000 2024-04-15T15:30:34.126 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-04-15 15:23:45.564645384 +0000 2024-04-15T15:30:34.126 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T15:30:34.191 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-04-15T15:30:34.191 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-04-15T15:30:34.191 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000272428 s, 1.9 MB/s 2024-04-15T15:30:34.193 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T15:30:34.251 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2024-04-15T15:30:34.305 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T15:30:34.306 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T15:30:34.306 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 955 Links: 1 2024-04-15T15:30:34.306 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T15:30:34.306 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-04-15 15:23:46.392637989 +0000 2024-04-15T15:30:34.306 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-04-15 15:23:46.136640276 +0000 2024-04-15T15:30:34.306 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-04-15 15:23:46.136640276 +0000 2024-04-15T15:30:34.306 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-04-15 15:23:46.136640276 +0000 2024-04-15T15:30:34.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T15:30:34.367 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-04-15T15:30:34.367 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-04-15T15:30:34.367 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000268498 s, 1.9 MB/s 2024-04-15T15:30:34.370 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T15:30:34.423 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T15:30:34.423 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-15T15:30:34.423 INFO:tasks.ceph:Generating config... 2024-04-15T15:30:34.425 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-15T15:30:34.425 INFO:tasks.ceph:[client] debug client = 20 2024-04-15T15:30:34.425 INFO:tasks.ceph:[client] debug ms = 1 2024-04-15T15:30:34.425 INFO:tasks.ceph:[client] pid file = 2024-04-15T15:30:34.425 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-15T15:30:34.425 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-15T15:30:34.425 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-15T15:30:34.425 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-15T15:30:34.425 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-15T15:30:34.425 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-15T15:30:34.425 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-15T15:30:34.425 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-15T15:30:34.425 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-15T15:30:34.426 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-15T15:30:34.426 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-15T15:30:34.426 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-15T15:30:34.427 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-15T15:30:34.427 INFO:tasks.ceph:Setting up mon.a... 2024-04-15T15:30:34.428 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-15T15:30:34.473 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-04-15T15:30:34.483 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-15T15:30:34.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T15:30:34.594 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '172.21.15.118'), ('mon.c', '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]')] 2024-04-15T15:30:34.594 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-15T15:30:34.595 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:34.595 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-15T15:30:34.645 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --add b 172.21.15.118 --addv c '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:34.731 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:34.731 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid a72de584-7db8-4f62-b310-5ee655143eeb 2024-04-15T15:30:34.731 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = quincy 2024-04-15T15:30:34.731 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-04-15T15:30:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:fsid a72de584-7db8-4f62-b310-5ee655143eeb 2024-04-15T15:30:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-04-15T15:30:34.732085+0000 2024-04-15T15:30:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-04-15T15:30:34.732085+0000 2024-04-15T15:30:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 17 (quincy) 2024-04-15T15:30:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-04-15T15:30:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-04-15T15:30:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-04-15T15:30:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] mon.c 2024-04-15T15:30:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-15T15:30:34.734 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-15T15:30:34.742 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a72de584-7db8-4f62-b310-5ee655143eeb... 2024-04-15T15:30:34.743 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-15T15:30:34.788 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-15T15:30:34.827 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-04-15T15:30:34.827 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-04-15T15:30:34.827 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-15T15:30:34.827 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-04-15T15:30:34.827 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.827 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-04-15T15:30:34.827 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.827 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-04-15T15:30:34.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-04-15T15:30:34.829 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = a72de584-7db8-4f62-b310-5ee655143eeb 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-04-15T15:30:34.830 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-04-15T15:30:34.831 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-15T15:30:34.832 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-04-15T15:30:34.833 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2024-04-15T15:30:34.833 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-04-15T15:30:34.833 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-04-15T15:30:34.833 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-04-15T15:30:34.833 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-04-15T15:30:34.833 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-04-15T15:30:34.833 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-04-15T15:30:34.833 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.833 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-04-15T15:30:34.833 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-04-15T15:30:34.834 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.835 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: mon down mkfs grace = 300 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-04-15T15:30:34.836 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-15T15:30:34.837 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2024-04-15T15:30:34.838 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2024-04-15T15:30:34.838 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2024-04-15T15:30:34.838 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2024-04-15T15:30:34.838 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-04-15T15:30:34.838 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-04-15T15:30:34.838 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-04-15T15:30:34.838 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2024-04-15T15:30:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2024-04-15T15:30:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2024-04-15T15:30:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-15T15:30:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.73,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on skipped message = False 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = a72de584-7db8-4f62-b310-5ee655143eeb 2024-04-15T15:30:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2024-04-15T15:30:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug trim objects = true 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2024-04-15T15:30:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 20 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 20 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 10 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.844 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-04-15T15:30:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: mon down mkfs grace = 300 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-04-15T15:30:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = "" 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds balancer = 20 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2024-04-15T15:30:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2024-04-15T15:30:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2024-04-15T15:30:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2024-04-15T15:30:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2024-04-15T15:30:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2024-04-15T15:30:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2024-04-15T15:30:34.850 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-15T15:30:34.850 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-15T15:30:34.949 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-15T15:30:34.949 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:34.949 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-15T15:30:34.957 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:34.957 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-15T15:30:35.005 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:30:35.005 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:35.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-15T15:30:35.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T15:30:35.076 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:30:35.076 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:35.125 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:30:35.125 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:30:35.126 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-15T15:30:35.126 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T15:30:35.194 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:30:35.194 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:35.245 INFO:tasks.ceph:Setting up mon nodes... 2024-04-15T15:30:35.246 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-15T15:30:35.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-15T15:30:35.301 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-15T15:30:35.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-15T15:30:35.364 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-15T15:30:35.382 INFO:tasks.ceph:Setting up mds nodes... 2024-04-15T15:30:35.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-15T15:30:35.436 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-15T15:30:35.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-15T15:30:35.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-15T15:30:35.558 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-15T15:30:35.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-15T15:30:35.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-15T15:30:35.642 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-15T15:30:35.646 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-15T15:30:35.667 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-15T15:30:35.768 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-15T15:30:35.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-15T15:30:35.792 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-15T15:30:35.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-15T15:30:35.834 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-15T15:30:35.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-15T15:30:35.935 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-15T15:30:35.951 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-15T15:30:35.994 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-15T15:30:36.008 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-15T15:30:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-15T15:30:36.111 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-15T15:30:36.111 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-15T15:30:36.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-15T15:30:36.130 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T15:30:36.130 INFO:tasks.ceph:role: osd.0 2024-04-15T15:30:36.130 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:30:36.131 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-15T15:30:36.200 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T15:30:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T15:30:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T15:30:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-15T15:30:36.200 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T15:30:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-04-15T15:30:36.200 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T15:30:36.200 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-15T15:30:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T15:30:36.200 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T15:30:36.611 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-04-15T15:30:36.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-04-15T15:30:36.614 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-15T15:30:36.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-15T15:30:36.728 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-04-15T15:30:36.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:30:36.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-15T15:30:36.792 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T15:30:36.792 INFO:tasks.ceph:role: osd.1 2024-04-15T15:30:36.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:30:36.792 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-15T15:30:36.864 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T15:30:36.864 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T15:30:36.864 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T15:30:36.865 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-15T15:30:36.865 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T15:30:36.865 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-04-15T15:30:36.865 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T15:30:36.865 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-15T15:30:36.865 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T15:30:36.865 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T15:30:37.266 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-04-15T15:30:37.268 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-04-15T15:30:37.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-15T15:30:37.392 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-15T15:30:37.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:30:37.410 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-04-15T15:30:37.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-15T15:30:37.477 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T15:30:37.477 INFO:tasks.ceph:role: osd.2 2024-04-15T15:30:37.477 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:30:37.477 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-15T15:30:37.544 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T15:30:37.545 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T15:30:37.545 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T15:30:37.545 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-15T15:30:37.545 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T15:30:37.545 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-04-15T15:30:37.545 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T15:30:37.545 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-15T15:30:37.545 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T15:30:37.545 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T15:30:37.959 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-04-15T15:30:37.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-04-15T15:30:37.963 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-15T15:30:38.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-15T15:30:38.127 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-04-15T15:30:38.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:30:38.129 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-15T15:30:38.190 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T15:30:38.190 INFO:tasks.ceph:role: osd.3 2024-04-15T15:30:38.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:30:38.191 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-15T15:30:38.266 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T15:30:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T15:30:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T15:30:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-15T15:30:38.266 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T15:30:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-04-15T15:30:38.266 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T15:30:38.266 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-15T15:30:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T15:30:38.266 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T15:30:38.629 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-04-15T15:30:38.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-04-15T15:30:38.632 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-15T15:30:38.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-15T15:30:38.774 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-04-15T15:30:38.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:30:38.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:38.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:38.898+0000 7f475d7437c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-15T15:30:38.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:38.902+0000 7f475d7437c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-15T15:30:38.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:38.902+0000 7f475d7437c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T15:30:38.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:38.902+0000 7f475d7437c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T15:30:38.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:38.902+0000 7f475d7437c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T15:30:38.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:38.910+0000 7f475d7437c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-15T15:30:41.949 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-15T15:30:41.970 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:42.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:42.066+0000 7fee6e4047c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-15T15:30:42.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:42.066+0000 7fee6e4047c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-15T15:30:42.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:42.066+0000 7fee6e4047c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T15:30:42.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:42.070+0000 7fee6e4047c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T15:30:42.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:42.070+0000 7fee6e4047c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T15:30:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:42.070+0000 7fee6e4047c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-15T15:30:45.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-15T15:30:45.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:45.226+0000 7f0c7042b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-15T15:30:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:45.226+0000 7f0c7042b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-15T15:30:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:45.226+0000 7f0c7042b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T15:30:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:45.226+0000 7f0c7042b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T15:30:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:45.226+0000 7f0c7042b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T15:30:45.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:45.230+0000 7f0c7042b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-15T15:30:48.271 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-15T15:30:48.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:48.382+0000 7fa2f1f017c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-15T15:30:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:48.382+0000 7fa2f1f017c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-15T15:30:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:48.382+0000 7fa2f1f017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T15:30:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:48.382+0000 7fa2f1f017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T15:30:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:48.382+0000 7fa2f1f017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T15:30:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:30:48.386+0000 7fa2f1f017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-15T15:30:51.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-15T15:30:51.461 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-15T15:30:51.483 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T15:30:51.484 INFO:tasks.ceph:role: osd.4 2024-04-15T15:30:51.484 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:30:51.484 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-15T15:30:51.546 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T15:30:51.546 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T15:30:51.546 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T15:30:51.546 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-15T15:30:51.547 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T15:30:51.547 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-04-15T15:30:51.547 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T15:30:51.547 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-15T15:30:51.547 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T15:30:51.547 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T15:30:51.572 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-04-15T15:30:51.573 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-04-15T15:30:51.574 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-15T15:30:51.639 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-15T15:30:51.701 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2024-04-15T15:30:51.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:30:51.703 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-15T15:30:51.765 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T15:30:51.765 INFO:tasks.ceph:role: osd.5 2024-04-15T15:30:51.765 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:30:51.765 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-15T15:30:51.827 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T15:30:51.827 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T15:30:51.827 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T15:30:51.828 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-15T15:30:51.828 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T15:30:51.828 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-04-15T15:30:51.828 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T15:30:51.828 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-15T15:30:51.828 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T15:30:51.828 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T15:30:51.852 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-04-15T15:30:51.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-04-15T15:30:51.855 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-15T15:30:51.922 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-15T15:30:51.985 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2024-04-15T15:30:51.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:30:51.987 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-15T15:30:52.048 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T15:30:52.048 INFO:tasks.ceph:role: osd.6 2024-04-15T15:30:52.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:30:52.048 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-15T15:30:52.108 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T15:30:52.108 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T15:30:52.108 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T15:30:52.108 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-15T15:30:52.108 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T15:30:52.108 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-04-15T15:30:52.108 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T15:30:52.109 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-15T15:30:52.109 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T15:30:52.109 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T15:30:52.133 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-04-15T15:30:52.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-04-15T15:30:52.137 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-15T15:30:52.202 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-15T15:30:52.261 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2024-04-15T15:30:52.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:30:52.262 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-15T15:30:52.326 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T15:30:52.326 INFO:tasks.ceph:role: osd.7 2024-04-15T15:30:52.326 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:30:52.326 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-15T15:30:52.388 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T15:30:52.388 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T15:30:52.388 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T15:30:52.388 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-15T15:30:52.388 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T15:30:52.388 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-04-15T15:30:52.388 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T15:30:52.388 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-15T15:30:52.388 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T15:30:52.388 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T15:30:52.412 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-04-15T15:30:52.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-04-15T15:30:52.414 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-15T15:30:52.486 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-15T15:30:52.545 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2024-04-15T15:30:52.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:30:52.546 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:52.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:52.676+0000 7f626443d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-15T15:30:52.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:52.676+0000 7f626443d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-15T15:30:52.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:52.676+0000 7f626443d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T15:30:52.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:52.676+0000 7f626443d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T15:30:52.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:52.676+0000 7f626443d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T15:30:52.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:52.676+0000 7f626443d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-15T15:30:55.728 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-15T15:30:55.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:55.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:55.839+0000 7fc18fe707c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-15T15:30:55.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:55.839+0000 7fc18fe707c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-15T15:30:55.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:55.839+0000 7fc18fe707c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T15:30:55.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:55.839+0000 7fc18fe707c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T15:30:55.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:55.839+0000 7fc18fe707c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T15:30:55.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:55.843+0000 7fc18fe707c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-15T15:30:58.877 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-15T15:30:58.899 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:30:58.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:58.995+0000 7fd405c397c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-15T15:30:58.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:58.995+0000 7fd405c397c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-15T15:30:58.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:58.995+0000 7fd405c397c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T15:30:58.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:58.995+0000 7fd405c397c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T15:30:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:58.995+0000 7fd405c397c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T15:30:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:30:58.999+0000 7fd405c397c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-15T15:31:02.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-15T15:31:02.069 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:31:02.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:02.159+0000 7fa50db677c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-15T15:31:02.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:02.159+0000 7fa50db677c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-15T15:31:02.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:02.159+0000 7fa50db677c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T15:31:02.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:02.159+0000 7fa50db677c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T15:31:02.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:02.159+0000 7fa50db677c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T15:31:02.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:02.159+0000 7fa50db677c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-15T15:31:02.933 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:31:02.938 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:31:05.169 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:05.189 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-15T15:31:05.189 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:05.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-15T15:31:05.211 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:05.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-15T15:31:05.278 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:05.278 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-15T15:31:05.341 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:05.342 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-15T15:31:05.405 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:05.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-15T15:31:05.469 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:05.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-15T15:31:05.533 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:05.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-15T15:31:05.597 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:05.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-15T15:31:05.617 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:05.617 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-15T15:31:05.677 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:05.677 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-15T15:31:05.737 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:05.737 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-15T15:31:05.801 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:05.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-15T15:31:05.861 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:05.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-15T15:31:05.921 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:05.921 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-15T15:31:05.981 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:05.981 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-15T15:31:05.990 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:05.990 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-15T15:31:06.042 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:06.042 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-15T15:31:06.050 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:06.050 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-15T15:31:06.098 INFO:tasks.ceph:Adding keys to all mons... 2024-04-15T15:31:06.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-15T15:31:06.102 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-15T15:31:06.142 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-04-15T15:31:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAbSB1mFL0DEhAACcwKtDj+vQSJpBRVSAIBhw== 2024-04-15T15:31:06.142 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-04-15T15:31:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAbSB1mE/8OGhAAjTzwB87bnkwdxGQOU1NTQw== 2024-04-15T15:31:06.142 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-04-15T15:31:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAbSB1m4zpXIRAAPaJNSQuTI/1zYGE5W57+XA== 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAeSB1m0aXJNRAAluOSe91ime2Lmw5arAxjVQ== 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAiSB1mpzIxBBAAVmRcjWCwy2l0w9a4ByisRQ== 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAlSB1mItisDRAA77ztxcsPX24ZuyjD401k2A== 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAoSB1mUpX9FhAA1iRcGp/5zUVBC1tD5LI3uQ== 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAbSB1mRf/hFRAAAYGd3wzdUvONb2qwwcm7Ag== 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAbSB1mDtttJhAA6VNBgxvlM9+s5ESEiC4uhQ== 2024-04-15T15:31:06.143 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAbSB1mbUP3LRAAZfeG5ghHXihslXSCYoUqJg== 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAsSB1mxNxZKBAAZEowCNbSBkfXdi/HHjSvTw== 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAvSB1mOj5DMhAADWQxVRwLZtj0zuRykn8QcA== 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAySB1mxQOTOxAAMO6eJOcJlY2YJ2pYK+Jk1w== 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQA2SB1mI8SoCRAAnZqLgor4fri4I4wrkcWLiA== 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAbSB1mysrBMRAASR9v0p/QS/vXby5B449DsA== 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:[client.2] 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAbSB1mlmzJNxAAB8iXUEkqY9VSNaQWH1SypA== 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2024-04-15T15:31:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAbSB1mfzxIOxAA7FDp5dmIqBfa3e5obY6fjA== 2024-04-15T15:31:06.145 INFO:teuthology.orchestra.run.smithi073.stdout:[client.3] 2024-04-15T15:31:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAcSB1mUsrCBRAApqSqvkHxPNS7UqpVKupYjA== 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAbSB1mFL0DEhAACcwKtDj+vQSJpBRVSAIBhw== 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAbSB1mE/8OGhAAjTzwB87bnkwdxGQOU1NTQw== 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAbSB1m4zpXIRAAPaJNSQuTI/1zYGE5W57+XA== 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAeSB1m0aXJNRAAluOSe91ime2Lmw5arAxjVQ== 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAiSB1mpzIxBBAAVmRcjWCwy2l0w9a4ByisRQ== 2024-04-15T15:31:06.155 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAlSB1mItisDRAA77ztxcsPX24ZuyjD401k2A== 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAoSB1mUpX9FhAA1iRcGp/5zUVBC1tD5LI3uQ== 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAbSB1mRf/hFRAAAYGd3wzdUvONb2qwwcm7Ag== 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAbSB1mDtttJhAA6VNBgxvlM9+s5ESEiC4uhQ== 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAbSB1mbUP3LRAAZfeG5ghHXihslXSCYoUqJg== 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAsSB1mxNxZKBAAZEowCNbSBkfXdi/HHjSvTw== 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAvSB1mOj5DMhAADWQxVRwLZtj0zuRykn8QcA== 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2024-04-15T15:31:06.156 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAySB1mxQOTOxAAMO6eJOcJlY2YJ2pYK+Jk1w== 2024-04-15T15:31:06.157 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2024-04-15T15:31:06.157 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA2SB1mI8SoCRAAnZqLgor4fri4I4wrkcWLiA== 2024-04-15T15:31:06.157 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-04-15T15:31:06.157 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAbSB1mysrBMRAASR9v0p/QS/vXby5B449DsA== 2024-04-15T15:31:06.157 INFO:teuthology.orchestra.run.smithi118.stdout:[client.2] 2024-04-15T15:31:06.157 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAbSB1mlmzJNxAAB8iXUEkqY9VSNaQWH1SypA== 2024-04-15T15:31:06.157 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2024-04-15T15:31:06.157 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAbSB1mfzxIOxAA7FDp5dmIqBfa3e5obY6fjA== 2024-04-15T15:31:06.157 INFO:teuthology.orchestra.run.smithi118.stdout:[client.3] 2024-04-15T15:31:06.157 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAcSB1mUsrCBRAApqSqvkHxPNS7UqpVKupYjA== 2024-04-15T15:31:06.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T15:31:06.194 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T15:31:06.289 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T15:31:06.293 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T15:31:06.536 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T15:31:06.540 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T15:31:06.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:06.602 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:06.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:06.658 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:06.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:06.714 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:06.767 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:06.770 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:06.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T15:31:06.827 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T15:31:06.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T15:31:06.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T15:31:06.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T15:31:06.942 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T15:31:06.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:07.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:07.055 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:07.058 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:07.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:07.115 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:07.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:07.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T15:31:07.224 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T15:31:07.227 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T15:31:07.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T15:31:07.287 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T15:31:07.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T15:31:07.346 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T15:31:07.402 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T15:31:07.409 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T15:31:07.466 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-15T15:31:07.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-15T15:31:07.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T15:31:07.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-15T15:31:07.616 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-15T15:31:07.636 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T15:31:07.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-15T15:31:07.764 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-15T15:31:07.825 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T15:31:07.933 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-15T15:31:07.952 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:31:07.957 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-15T15:31:08.002 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-15T15:31:08.002 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-15T15:31:08.002 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-15T15:31:08.011 INFO:tasks.ceph.mon.a:Started 2024-04-15T15:31:08.012 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-15T15:31:08.012 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-15T15:31:08.048 INFO:tasks.ceph.mon.b:Started 2024-04-15T15:31:08.048 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-15T15:31:08.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-15T15:31:08.052 INFO:tasks.ceph.mon.c:Started 2024-04-15T15:31:08.053 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-15T15:31:08.053 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-15T15:31:08.053 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-15T15:31:08.056 INFO:tasks.ceph.mgr.y:Started 2024-04-15T15:31:08.056 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-15T15:31:08.056 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-15T15:31:08.059 INFO:tasks.ceph.mgr.x:Started 2024-04-15T15:31:08.059 INFO:tasks.ceph:Setting crush tunables to default 2024-04-15T15:31:08.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-04-15T15:31:08.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b3400640 1 Processor -- start 2024-04-15T15:31:08.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b3400640 1 -- start start 2024-04-15T15:31:08.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b3400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79ac146110 0x7f79ac0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:08.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b3400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79ac0b2530 0x7f79ac072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b3400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ac0cd3a0 con 0x7f79ac0b20b0 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b3400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f79ac0b5160 con 0x7f79ac146110 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b3400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f79ac0b40c0 con 0x7f79ac0b2530 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b0a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79ac146110 0x7f79ac0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b0a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79ac146110 0x7f79ac0cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38118/0 (socket says 172.21.15.73:38118) 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b0a00640 1 -- 172.21.15.73:0/2672540450 learned_addr learned my addr 172.21.15.73:0/2672540450 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b0a00640 1 -- 172.21.15.73:0/2672540450 >> v2:172.21.15.73:3300/0 conn(0x7f79ac146110 msgr2=0x7f79ac0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b0a00640 1 -- 172.21.15.73:0/2672540450 >> v2:172.21.15.73:3300/0 conn(0x7f79ac146110 msgr2=0x7f79ac0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b0a00640 1 --2- 172.21.15.73:0/2672540450 >> v2:172.21.15.73:3300/0 conn(0x7f79ac146110 0x7f79ac0cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b1400640 1 --2- 172.21.15.73:0/2672540450 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0b2530 0x7f79ac072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b0a00640 1 --2- 172.21.15.73:0/2672540450 >> v2:172.21.15.73:3300/0 conn(0x7f79ac146110 0x7f79ac0cd7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b1400640 1 -- 172.21.15.73:0/2672540450 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0b2530 msgr2=0x7f79ac072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-15T15:31:08.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b1400640 1 -- 172.21.15.73:0/2672540450 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0b2530 msgr2=0x7f79ac072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T15:31:08.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b1400640 1 --2- 172.21.15.73:0/2672540450 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0b2530 0x7f79ac072520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T15:31:08.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.198+0000 7f79b1400640 1 --2- 172.21.15.73:0/2672540450 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0b2530 0x7f79ac072520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T15:31:08.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.350+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807199363 0 0) 0x7f79ac0cd3a0 con 0x7f79ac0b20b0 2024-04-15T15:31:08.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.350+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7990003530 con 0x7f79ac0b20b0 2024-04-15T15:31:08.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 536728120 0 0) 0x7f7990003530 con 0x7f79ac0b20b0 2024-04-15T15:31:08.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0b2530 msgr2=0x7f79ac072520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T15:31:08.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 --2- 172.21.15.73:0/2672540450 >> v2:172.21.15.118:3300/0 conn(0x7f79ac0b2530 0x7f79ac072520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 >> v2:172.21.15.73:3300/0 conn(0x7f79ac146110 msgr2=0x7f79ac0cd7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T15:31:08.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 --2- 172.21.15.73:0/2672540450 >> v2:172.21.15.73:3300/0 conn(0x7f79ac146110 0x7f79ac0cd7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac0b43a0 con 0x7f79ac0b20b0 2024-04-15T15:31:08.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f7994001680 con 0x7f79ac0b20b0 2024-04-15T15:31:08.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 >> v1:172.21.15.118:6789/0 conn(0x7f79ac0b20b0 legacy=0x7f79ac071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:08.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7990003a10 0x7f7990003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7990004810 0x7f7990004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79900051d0 0x7f799000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac0b5160 con 0x7f79900051d0 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac0b40c0 con 0x7f7990003a10 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f799000c150 con 0x7f7990004810 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79b0a00640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7990003a10 0x7f7990003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79a3e00640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7990004810 0x7f7990004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79b1400640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79900051d0 0x7f799000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79b0a00640 1 -- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7990004810 msgr2=0x7f7990004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79b0a00640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7990004810 0x7f7990004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79b0a00640 1 -- 172.21.15.73:0/2672540450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79900051d0 msgr2=0x7f799000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79b0a00640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79900051d0 0x7f799000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79b0a00640 1 -- 172.21.15.73:0/2672540450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7990003530 con 0x7f7990003a10 2024-04-15T15:31:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79b1400640 1 -- 172.21.15.73:0/2672540450 reap_dead start 2024-04-15T15:31:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.354+0000 7f79a3e00640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7990004810 0x7f7990004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79b0a00640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7990003a10 0x7f7990003e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f799c009890 tx=0x7f799c01c5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc7b07a5707cb4dd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:08.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c00f040 con 0x7f7990003a10 2024-04-15T15:31:08.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c0a8660 con 0x7f7990003a10 2024-04-15T15:31:08.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79abe00640 1 -- 172.21.15.73:0/2672540450 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c0a8a50 con 0x7f7990003a10 2024-04-15T15:31:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79b3400640 1 -- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7990003a10 msgr2=0x7f7990003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79b3400640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7990003a10 0x7f7990003e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f799c009890 tx=0x7f799c01c5f0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79b3400640 1 -- 172.21.15.73:0/2672540450 shutdown_connections 2024-04-15T15:31:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79b3400640 1 --2- 172.21.15.73:0/2672540450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7990003a10 0x7f7990003e50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79b3400640 1 -- 172.21.15.73:0/2672540450 >> 172.21.15.73:0/2672540450 conn(0x7f79ac067dd0 msgr2=0x7f79ac0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79b3400640 1 -- 172.21.15.73:0/2672540450 shutdown_connections 2024-04-15T15:31:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.358+0000 7f79b3400640 1 -- 172.21.15.73:0/2672540450 wait complete. 2024-04-15T15:31:08.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 Processor -- start 2024-04-15T15:31:08.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 -- start start 2024-04-15T15:31:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7990003a10 0x7f79ac15e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:08.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79ac071e10 0x7f79ac072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79ac143d80 0x7f79ac144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac0b4c40 con 0x7f7990003a10 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac0b4960 con 0x7f79ac143d80 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac0b2980 con 0x7f79ac071e10 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b0a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7990003a10 0x7f79ac15e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b0a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7990003a10 0x7f79ac15e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38158/0 (socket says 172.21.15.73:38158) 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b0a00640 1 -- 172.21.15.73:0/2674596118 learned_addr learned my addr 172.21.15.73:0/2674596118 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b0a00640 1 -- 172.21.15.73:0/2674596118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79ac071e10 msgr2=0x7f79ac072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b0a00640 1 --2- 172.21.15.73:0/2674596118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79ac071e10 0x7f79ac072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b0a00640 1 -- 172.21.15.73:0/2674596118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79ac143d80 msgr2=0x7f79ac144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b0a00640 1 --2- 172.21.15.73:0/2674596118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79ac143d80 0x7f79ac144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b0a00640 1 -- 172.21.15.73:0/2674596118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac144ad0 con 0x7f7990003a10 2024-04-15T15:31:08.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b0a00640 1 --2- 172.21.15.73:0/2674596118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7990003a10 0x7f79ac15e9a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f799c01c630 tx=0x7f7990005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:08.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79a9600640 1 -- 172.21.15.73:0/2674596118 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c00f000 con 0x7f7990003a10 2024-04-15T15:31:08.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79a9600640 1 -- 172.21.15.73:0/2674596118 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c0b0610 con 0x7f7990003a10 2024-04-15T15:31:08.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79a9600640 1 -- 172.21.15.73:0/2674596118 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c0b09c0 con 0x7f7990003a10 2024-04-15T15:31:08.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 -- 172.21.15.73:0/2674596118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ac144db0 con 0x7f7990003a10 2024-04-15T15:31:08.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 -- 172.21.15.73:0/2674596118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ac145370 con 0x7f7990003a10 2024-04-15T15:31:08.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79a9600640 1 -- 172.21.15.73:0/2674596118 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f799c0c0060 con 0x7f7990003a10 2024-04-15T15:31:08.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79a9600640 1 -- 172.21.15.73:0/2674596118 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f799c006360 con 0x7f7990003a10 2024-04-15T15:31:08.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.362+0000 7f79b3400640 1 -- 172.21.15.73:0/2674596118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ac068ab0 con 0x7f7990003a10 2024-04-15T15:31:08.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.378+0000 7f79a9600640 1 -- 172.21.15.73:0/2674596118 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f799c0ac030 con 0x7f7990003a10 2024-04-15T15:31:08.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.438+0000 7f79b3400640 1 -- 172.21.15.73:0/2674596118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f79ac141960 con 0x7f7990003a10 2024-04-15T15:31:08.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.442+0000 7f79a9600640 1 -- 172.21.15.73:0/2674596118 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f799c016300 con 0x7f7990003a10 2024-04-15T15:31:08.445 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-04-15T15:31:08.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.446+0000 7f79b3400640 1 -- 172.21.15.73:0/2674596118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7990003a10 msgr2=0x7f79ac15e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.446+0000 7f79b3400640 1 --2- 172.21.15.73:0/2674596118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7990003a10 0x7f79ac15e9a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f799c01c630 tx=0x7f7990005840 comp rx=0 tx=0).stop 2024-04-15T15:31:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.446+0000 7f79b3400640 1 -- 172.21.15.73:0/2674596118 shutdown_connections 2024-04-15T15:31:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.446+0000 7f79b3400640 1 --2- 172.21.15.73:0/2674596118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79ac143d80 0x7f79ac144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.446+0000 7f79b3400640 1 --2- 172.21.15.73:0/2674596118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79ac071e10 0x7f79ac072290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.446+0000 7f79b3400640 1 --2- 172.21.15.73:0/2674596118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7990003a10 0x7f79ac15e9a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.446+0000 7f79b3400640 1 -- 172.21.15.73:0/2674596118 >> 172.21.15.73:0/2674596118 conn(0x7f79ac067dd0 msgr2=0x7f79ac0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.446+0000 7f79b3400640 1 -- 172.21.15.73:0/2674596118 shutdown_connections 2024-04-15T15:31:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:08.446+0000 7f79b3400640 1 -- 172.21.15.73:0/2674596118 wait complete. 2024-04-15T15:31:08.465 INFO:tasks.ceph:check_enable_crimson: False 2024-04-15T15:31:08.465 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-15T15:31:08.465 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:08.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-15T15:31:08.485 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:08.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-15T15:31:08.548 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:08.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-15T15:31:08.568 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:08.566+0000 7f02cf918180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-15T15:31:08.595 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:08.594+0000 7fa4a7248180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-15T15:31:08.608 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:08.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-15T15:31:08.669 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:08.669 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-15T15:31:08.689 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:08.689 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-15T15:31:08.751 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:08.751 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-15T15:31:08.817 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:31:08.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-15T15:31:08.882 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 29d58176-fa13-4426-aed4-b6df16d11210 0 2024-04-15T15:31:09.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2283000640 1 Processor -- start 2024-04-15T15:31:09.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2283000640 1 -- start start 2024-04-15T15:31:09.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2283000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c0cd1b0 0x7f227c09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2283000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f227c15cab0 0x7f227c09afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2283000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227c0cd690 con 0x7f227c15c6d0 2024-04-15T15:31:09.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2283000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f227c0cd970 con 0x7f227c15cab0 2024-04-15T15:31:09.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2283000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f227c0cdc50 con 0x7f227c0cd1b0 2024-04-15T15:31:09.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2273e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c0cd1b0 0x7f227c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2273e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c0cd1b0 0x7f227c09aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:36534/0 (socket says 172.21.15.118:36534) 2024-04-15T15:31:09.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2273e00640 1 -- 172.21.15.118:0/1120524308 learned_addr learned my addr 172.21.15.118:0/1120524308 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:09.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2281000640 1 --2- 172.21.15.118:0/1120524308 >> v2:172.21.15.73:3300/0 conn(0x7f227c15cab0 0x7f227c09afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2273e00640 1 -- 172.21.15.118:0/1120524308 >> v2:172.21.15.73:3300/0 conn(0x7f227c15cab0 msgr2=0x7f227c09afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:09.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2273e00640 1 --2- 172.21.15.118:0/1120524308 >> v2:172.21.15.73:3300/0 conn(0x7f227c15cab0 0x7f227c09afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2273e00640 1 -- 172.21.15.118:0/1120524308 >> v1:172.21.15.73:6789/0 conn(0x7f227c15c6d0 legacy=0x7f227c0d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.058+0000 7f2273e00640 1 -- 172.21.15.118:0/1120524308 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227c0cdf30 con 0x7f227c0cd1b0 2024-04-15T15:31:09.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f2273e00640 1 --2- 172.21.15.118:0/1120524308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c0cd1b0 0x7f227c09aa60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2264009870 tx=0x7f226401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa5429d5cdbf141e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:09.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f227b400640 1 -- 172.21.15.118:0/1120524308 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22640a9610 con 0x7f227c0cd1b0 2024-04-15T15:31:09.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f227b400640 1 -- 172.21.15.118:0/1120524308 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c0d1690 con 0x7f227c0cd1b0 2024-04-15T15:31:09.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f227b400640 1 -- 172.21.15.118:0/1120524308 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22640a99d0 con 0x7f227c0cd1b0 2024-04-15T15:31:09.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f2283000640 1 -- 172.21.15.118:0/1120524308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c0cd1b0 msgr2=0x7f227c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f2283000640 1 --2- 172.21.15.118:0/1120524308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c0cd1b0 0x7f227c09aa60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2264009870 tx=0x7f226401c530 comp rx=0 tx=0).stop 2024-04-15T15:31:09.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f2283000640 1 -- 172.21.15.118:0/1120524308 shutdown_connections 2024-04-15T15:31:09.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f2283000640 1 --2- 172.21.15.118:0/1120524308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c0cd1b0 0x7f227c09aa60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f2283000640 1 --2- 172.21.15.118:0/1120524308 >> v2:172.21.15.73:3300/0 conn(0x7f227c15cab0 0x7f227c09afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f2283000640 1 -- 172.21.15.118:0/1120524308 >> 172.21.15.118:0/1120524308 conn(0x7f227c0b3fe0 msgr2=0x7f227c0b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:09.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f2283000640 1 -- 172.21.15.118:0/1120524308 shutdown_connections 2024-04-15T15:31:09.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.062+0000 7f2283000640 1 -- 172.21.15.118:0/1120524308 wait complete. 2024-04-15T15:31:09.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2283000640 1 Processor -- start 2024-04-15T15:31:09.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2283000640 1 -- start start 2024-04-15T15:31:09.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2283000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f227c0cd1b0 0x7f227c06e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2283000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c15c6d0 0x7f227c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2283000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c15cab0 0x7f227c150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2283000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f227c0b1c20 con 0x7f227c0cd1b0 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2283000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f227c0b1aa0 con 0x7f227c15c6d0 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2283000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f227c0b1da0 con 0x7f227c15cab0 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2273e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c15c6d0 0x7f227c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f227be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f227c0cd1b0 0x7f227c06e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2273e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c15c6d0 0x7f227c156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54010/0 (socket says 172.21.15.118:54010) 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2273e00640 1 -- 172.21.15.118:0/2566741479 learned_addr learned my addr 172.21.15.118:0/2566741479 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2281000640 1 --2- 172.21.15.118:0/2566741479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c15cab0 0x7f227c150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2273e00640 1 -- 172.21.15.118:0/2566741479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c15cab0 msgr2=0x7f227c150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2273e00640 1 --2- 172.21.15.118:0/2566741479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c15cab0 0x7f227c150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2273e00640 1 -- 172.21.15.118:0/2566741479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f227c0cd1b0 msgr2=0x7f227c06e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2273e00640 1 --2- 172.21.15.118:0/2566741479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f227c0cd1b0 0x7f227c06e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2273e00640 1 -- 172.21.15.118:0/2566741479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227c1f8660 con 0x7f227c15c6d0 2024-04-15T15:31:09.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2281000640 1 --2- 172.21.15.118:0/2566741479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c15cab0 0x7f227c150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:09.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2273e00640 1 --2- 172.21.15.118:0/2566741479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c15c6d0 0x7f227c156d90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f22640ab040 tx=0x7f226401ad70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:09.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2278c00640 1 -- 172.21.15.118:0/2566741479 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22640bc450 con 0x7f227c15c6d0 2024-04-15T15:31:09.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2278c00640 1 -- 172.21.15.118:0/2566741479 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22640bc610 con 0x7f227c15c6d0 2024-04-15T15:31:09.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2278c00640 1 -- 172.21.15.118:0/2566741479 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22640bca00 con 0x7f227c15c6d0 2024-04-15T15:31:09.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2283000640 1 -- 172.21.15.118:0/2566741479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227c1f7ae0 con 0x7f227c15c6d0 2024-04-15T15:31:09.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2283000640 1 -- 172.21.15.118:0/2566741479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227c1f80a0 con 0x7f227c15c6d0 2024-04-15T15:31:09.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2278c00640 1 -- 172.21.15.118:0/2566741479 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f22640c53f0 con 0x7f227c15c6d0 2024-04-15T15:31:09.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.066+0000 7f2278c00640 1 -- 172.21.15.118:0/2566741479 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f22640b1850 con 0x7f227c15c6d0 2024-04-15T15:31:09.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.070+0000 7f2283000640 1 -- 172.21.15.118:0/2566741479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f227c068ab0 con 0x7f227c15c6d0 2024-04-15T15:31:09.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.082+0000 7f2278c00640 1 -- 172.21.15.118:0/2566741479 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f22640ca020 con 0x7f227c15c6d0 2024-04-15T15:31:09.097 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:09.094+0000 7f02cf918180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-15T15:31:09.105 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:09.102+0000 7fa4a7248180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-15T15:31:09.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.150+0000 7f2283000640 1 -- 172.21.15.118:0/2566741479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "29d58176-fa13-4426-aed4-b6df16d11210", "id": 0} v 0) -- 0x7f227c0b4d80 con 0x7f227c15c6d0 2024-04-15T15:31:09.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.154+0000 7f2278c00640 1 -- 172.21.15.118:0/2566741479 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29d58176-fa13-4426-aed4-b6df16d11210", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f22640ad020 con 0x7f227c15c6d0 2024-04-15T15:31:09.158 INFO:teuthology.orchestra.run.smithi118.stdout:0 2024-04-15T15:31:09.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.154+0000 7f2283000640 1 -- 172.21.15.118:0/2566741479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c15c6d0 msgr2=0x7f227c156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.154+0000 7f2283000640 1 --2- 172.21.15.118:0/2566741479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c15c6d0 0x7f227c156d90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f22640ab040 tx=0x7f226401ad70 comp rx=0 tx=0).stop 2024-04-15T15:31:09.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.154+0000 7f2283000640 1 -- 172.21.15.118:0/2566741479 shutdown_connections 2024-04-15T15:31:09.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.154+0000 7f2283000640 1 --2- 172.21.15.118:0/2566741479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f227c15cab0 0x7f227c150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.154+0000 7f2283000640 1 --2- 172.21.15.118:0/2566741479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c15c6d0 0x7f227c156d90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.154+0000 7f2283000640 1 --2- 172.21.15.118:0/2566741479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f227c0cd1b0 0x7f227c06e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.154+0000 7f2283000640 1 -- 172.21.15.118:0/2566741479 >> 172.21.15.118:0/2566741479 conn(0x7f227c0b3fe0 msgr2=0x7f227c0d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:09.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.154+0000 7f2283000640 1 -- 172.21.15.118:0/2566741479 shutdown_connections 2024-04-15T15:31:09.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.154+0000 7f2283000640 1 -- 172.21.15.118:0/2566741479 wait complete. 2024-04-15T15:31:09.177 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 16127a63-1be1-42e9-87df-eeedf3d20fc6 1 2024-04-15T15:31:09.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.306+0000 7fd6f0800640 1 Processor -- start 2024-04-15T15:31:09.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.306+0000 7fd6f0800640 1 -- start start 2024-04-15T15:31:09.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.310+0000 7fd6f0800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd6e809b170 0x7fd6e815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.310+0000 7fd6f0800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e80d0d40 con 0x7fd6e80b17a0 2024-04-15T15:31:09.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.310+0000 7fd6f0800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e80d1000 con 0x7fd6e80d08b0 2024-04-15T15:31:09.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.310+0000 7fd6f0800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e80d12e0 con 0x7fd6e809b170 2024-04-15T15:31:09.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.310+0000 7fd6ed400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd6e80d08b0 0x7fd6e809aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55800/0 (socket says 172.21.15.118:55800) 2024-04-15T15:31:09.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.310+0000 7fd6ed400640 1 -- 172.21.15.118:0/341433783 learned_addr learned my addr 172.21.15.118:0/341433783 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-04-15T15:31:09.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.310+0000 7fd6ee800640 1 --2- 172.21.15.118:0/341433783 >> v2:172.21.15.118:3300/0 conn(0x7fd6e809b170 0x7fd6e815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.310+0000 7fd6ee800640 1 -- 172.21.15.118:0/341433783 >> v1:172.21.15.118:6789/0 conn(0x7fd6e80d08b0 legacy=0x7fd6e809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.310+0000 7fd6ee800640 1 -- 172.21.15.118:0/341433783 >> v1:172.21.15.73:6789/0 conn(0x7fd6e80b17a0 legacy=0x7fd6e806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.310+0000 7fd6ee800640 1 -- 172.21.15.118:0/341433783 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e80d15c0 con 0x7fd6e809b170 2024-04-15T15:31:09.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6ee800640 1 --2- 172.21.15.118:0/341433783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e809b170 0x7fd6e815e160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009d90 tx=0x7fd6e401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=634adc43025ba276 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:09.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6eca00640 1 -- 172.21.15.118:0/341433783 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40b2070 con 0x7fd6e809b170 2024-04-15T15:31:09.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6eca00640 1 -- 172.21.15.118:0/341433783 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e40a5a00 con 0x7fd6e809b170 2024-04-15T15:31:09.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6eca00640 1 -- 172.21.15.118:0/341433783 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40a5dd0 con 0x7fd6e809b170 2024-04-15T15:31:09.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6f0800640 1 -- 172.21.15.118:0/341433783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e809b170 msgr2=0x7fd6e815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6f0800640 1 --2- 172.21.15.118:0/341433783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e809b170 0x7fd6e815e160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009d90 tx=0x7fd6e401c940 comp rx=0 tx=0).stop 2024-04-15T15:31:09.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6f0800640 1 -- 172.21.15.118:0/341433783 shutdown_connections 2024-04-15T15:31:09.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6f0800640 1 --2- 172.21.15.118:0/341433783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e809b170 0x7fd6e815e160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6f0800640 1 -- 172.21.15.118:0/341433783 >> 172.21.15.118:0/341433783 conn(0x7fd6e80b3fe0 msgr2=0x7fd6e80b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:09.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6f0800640 1 -- 172.21.15.118:0/341433783 shutdown_connections 2024-04-15T15:31:09.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6f0800640 1 -- 172.21.15.118:0/341433783 wait complete. 2024-04-15T15:31:09.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6f0800640 1 Processor -- start 2024-04-15T15:31:09.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.314+0000 7fd6f0800640 1 -- start start 2024-04-15T15:31:09.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6f0800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e809b170 0x7fd6e80b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6f0800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e80b17a0 0x7fd6e81614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6f0800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6e80d08b0 0x7fd6e81619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6f0800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e816c890 con 0x7fd6e809b170 2024-04-15T15:31:09.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6f0800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e80b1dd0 con 0x7fd6e80b17a0 2024-04-15T15:31:09.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6f0800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e816ca10 con 0x7fd6e80d08b0 2024-04-15T15:31:09.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e80b17a0 0x7fd6e81614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e80b17a0 0x7fd6e81614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54040/0 (socket says 172.21.15.118:54040) 2024-04-15T15:31:09.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ed400640 1 -- 172.21.15.118:0/2267594206 learned_addr learned my addr 172.21.15.118:0/2267594206 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:09.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ee800640 1 --2- 172.21.15.118:0/2267594206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6e80d08b0 0x7fd6e81619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ede00640 1 --2- 172.21.15.118:0/2267594206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e809b170 0x7fd6e80b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ee800640 1 -- 172.21.15.118:0/2267594206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e80b17a0 msgr2=0x7fd6e81614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ee800640 1 --2- 172.21.15.118:0/2267594206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e80b17a0 0x7fd6e81614a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ee800640 1 -- 172.21.15.118:0/2267594206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e809b170 msgr2=0x7fd6e80b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ee800640 1 --2- 172.21.15.118:0/2267594206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e809b170 0x7fd6e80b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ee800640 1 -- 172.21.15.118:0/2267594206 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e8160010 con 0x7fd6e80d08b0 2024-04-15T15:31:09.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ede00640 1 --2- 172.21.15.118:0/2267594206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e809b170 0x7fd6e80b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:09.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6ee800640 1 --2- 172.21.15.118:0/2267594206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6e80d08b0 0x7fd6e81619e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80d0070 tx=0x7fd6e40196e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:09.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6e2000640 1 -- 172.21.15.118:0/2267594206 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40b2050 con 0x7fd6e80d08b0 2024-04-15T15:31:09.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6e2000640 1 -- 172.21.15.118:0/2267594206 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e40be070 con 0x7fd6e80d08b0 2024-04-15T15:31:09.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6e2000640 1 -- 172.21.15.118:0/2267594206 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40adc40 con 0x7fd6e80d08b0 2024-04-15T15:31:09.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6f0800640 1 -- 172.21.15.118:0/2267594206 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e81602f0 con 0x7fd6e80d08b0 2024-04-15T15:31:09.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6f0800640 1 -- 172.21.15.118:0/2267594206 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e81608b0 con 0x7fd6e80d08b0 2024-04-15T15:31:09.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6e2000640 1 -- 172.21.15.118:0/2267594206 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd6e40c3460 con 0x7fd6e80d08b0 2024-04-15T15:31:09.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6e2000640 1 -- 172.21.15.118:0/2267594206 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd6e40b9800 con 0x7fd6e80d08b0 2024-04-15T15:31:09.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.318+0000 7fd6f0800640 1 -- 172.21.15.118:0/2267594206 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e8068ab0 con 0x7fd6e80d08b0 2024-04-15T15:31:09.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.322+0000 7fd6e2000640 1 -- 172.21.15.118:0/2267594206 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd6e4016560 con 0x7fd6e80d08b0 2024-04-15T15:31:09.328 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:09.326+0000 7fa4a7248180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-15T15:31:09.352 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:09.350+0000 7f02cf918180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-15T15:31:09.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.390+0000 7fd6f0800640 1 -- 172.21.15.118:0/2267594206 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "16127a63-1be1-42e9-87df-eeedf3d20fc6", "id": 1} v 0) -- 0x7fd6e80d22b0 con 0x7fd6e80d08b0 2024-04-15T15:31:09.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.394+0000 7fd6e2000640 1 -- 172.21.15.118:0/2267594206 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16127a63-1be1-42e9-87df-eeedf3d20fc6", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd6e40b9a00 con 0x7fd6e80d08b0 2024-04-15T15:31:09.398 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-04-15T15:31:09.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.398+0000 7fd6f0800640 1 -- 172.21.15.118:0/2267594206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6e80d08b0 msgr2=0x7fd6e81619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.398+0000 7fd6f0800640 1 --2- 172.21.15.118:0/2267594206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6e80d08b0 0x7fd6e81619e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80d0070 tx=0x7fd6e40196e0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.398+0000 7fd6f0800640 1 -- 172.21.15.118:0/2267594206 shutdown_connections 2024-04-15T15:31:09.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.398+0000 7fd6f0800640 1 --2- 172.21.15.118:0/2267594206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6e80d08b0 0x7fd6e81619e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.398+0000 7fd6f0800640 1 --2- 172.21.15.118:0/2267594206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e80b17a0 0x7fd6e81614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.398+0000 7fd6f0800640 1 --2- 172.21.15.118:0/2267594206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6e809b170 0x7fd6e80b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.398+0000 7fd6f0800640 1 -- 172.21.15.118:0/2267594206 >> 172.21.15.118:0/2267594206 conn(0x7fd6e80b3fe0 msgr2=0x7fd6e806d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:09.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.398+0000 7fd6f0800640 1 -- 172.21.15.118:0/2267594206 shutdown_connections 2024-04-15T15:31:09.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.398+0000 7fd6f0800640 1 -- 172.21.15.118:0/2267594206 wait complete. 2024-04-15T15:31:09.418 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 21acd3fb-727a-4df5-a3e8-e3133372fb52 2 2024-04-15T15:31:09.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd8bc00640 1 Processor -- start 2024-04-15T15:31:09.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd8bc00640 1 -- start start 2024-04-15T15:31:09.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd8bc00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd840d08b0 0x7fcd8409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd8bc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd8409afa0 0x7fcd8415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd8bc00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd840d0d40 con 0x7fcd840b17a0 2024-04-15T15:31:09.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd8bc00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcd8409b410 con 0x7fcd840d08b0 2024-04-15T15:31:09.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd8bc00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fcd840d1000 con 0x7fcd8409afa0 2024-04-15T15:31:09.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd89c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd8409afa0 0x7fcd8415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd89c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd8409afa0 0x7fcd8415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54044/0 (socket says 172.21.15.118:54044) 2024-04-15T15:31:09.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd89c00640 1 -- 172.21.15.118:0/1580177951 learned_addr learned my addr 172.21.15.118:0/1580177951 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:09.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd83e00640 1 --2- 172.21.15.118:0/1580177951 >> v2:172.21.15.73:3300/0 conn(0x7fcd840d08b0 0x7fcd8409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd89c00640 1 -- 172.21.15.118:0/1580177951 >> v2:172.21.15.73:3300/0 conn(0x7fcd840d08b0 msgr2=0x7fcd8409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:09.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd89c00640 1 --2- 172.21.15.118:0/1580177951 >> v2:172.21.15.73:3300/0 conn(0x7fcd840d08b0 0x7fcd8409aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd89c00640 1 -- 172.21.15.118:0/1580177951 >> v1:172.21.15.73:6789/0 conn(0x7fcd840b17a0 legacy=0x7fcd8406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.550+0000 7fcd89c00640 1 -- 172.21.15.118:0/1580177951 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd840d12e0 con 0x7fcd8409afa0 2024-04-15T15:31:09.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd89c00640 1 --2- 172.21.15.118:0/1580177951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd8409afa0 0x7fcd8415e160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd841635e0 tx=0x7fcd7c01c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0c72df6a61bc2fc server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:09.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd83400640 1 -- 172.21.15.118:0/1580177951 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0a5880 con 0x7fcd8409afa0 2024-04-15T15:31:09.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd83400640 1 -- 172.21.15.118:0/1580177951 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7c0a5a20 con 0x7fcd8409afa0 2024-04-15T15:31:09.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd83400640 1 -- 172.21.15.118:0/1580177951 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0a5df0 con 0x7fcd8409afa0 2024-04-15T15:31:09.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd8bc00640 1 -- 172.21.15.118:0/1580177951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd8409afa0 msgr2=0x7fcd8415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd8bc00640 1 --2- 172.21.15.118:0/1580177951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd8409afa0 0x7fcd8415e160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd841635e0 tx=0x7fcd7c01c9c0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd8bc00640 1 -- 172.21.15.118:0/1580177951 shutdown_connections 2024-04-15T15:31:09.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd8bc00640 1 --2- 172.21.15.118:0/1580177951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd8409afa0 0x7fcd8415e160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd8bc00640 1 --2- 172.21.15.118:0/1580177951 >> v2:172.21.15.73:3300/0 conn(0x7fcd840d08b0 0x7fcd8409aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd8bc00640 1 -- 172.21.15.118:0/1580177951 >> 172.21.15.118:0/1580177951 conn(0x7fcd840b3fe0 msgr2=0x7fcd840b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:09.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd8bc00640 1 -- 172.21.15.118:0/1580177951 shutdown_connections 2024-04-15T15:31:09.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.554+0000 7fcd8bc00640 1 -- 172.21.15.118:0/1580177951 wait complete. 2024-04-15T15:31:09.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd8bc00640 1 Processor -- start 2024-04-15T15:31:09.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd8bc00640 1 -- start start 2024-04-15T15:31:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd8bc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd8409afa0 0x7fcd84153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd8bc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd840b17a0 0x7fcd840b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd8bc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd840d08b0 0x7fcd840b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd8bc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcd840b1d00 con 0x7fcd8409afa0 2024-04-15T15:31:09.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd8bc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcd840b1b80 con 0x7fcd840b17a0 2024-04-15T15:31:09.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd8bc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8406fed0 con 0x7fcd840d08b0 2024-04-15T15:31:09.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd83e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd840b17a0 0x7fcd840b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd83e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd840b17a0 0x7fcd840b7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54050/0 (socket says 172.21.15.118:54050) 2024-04-15T15:31:09.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd83e00640 1 -- 172.21.15.118:0/528752852 learned_addr learned my addr 172.21.15.118:0/528752852 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:09.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd89200640 1 --2- 172.21.15.118:0/528752852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd8409afa0 0x7fcd84153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd89c00640 1 --2- 172.21.15.118:0/528752852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd840d08b0 0x7fcd840b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd83e00640 1 -- 172.21.15.118:0/528752852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd840d08b0 msgr2=0x7fcd840b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd83e00640 1 --2- 172.21.15.118:0/528752852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd840d08b0 0x7fcd840b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd83e00640 1 -- 172.21.15.118:0/528752852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd8409afa0 msgr2=0x7fcd84153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd83e00640 1 --2- 172.21.15.118:0/528752852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd8409afa0 0x7fcd84153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd83e00640 1 -- 172.21.15.118:0/528752852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd84155df0 con 0x7fcd840b17a0 2024-04-15T15:31:09.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd83e00640 1 --2- 172.21.15.118:0/528752852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd840b17a0 0x7fcd840b7c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000d5f0 tx=0x7fcd7000dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:09.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd80c00640 1 -- 172.21.15.118:0/528752852 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd700125f0 con 0x7fcd840b17a0 2024-04-15T15:31:09.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd80c00640 1 -- 172.21.15.118:0/528752852 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd70019070 con 0x7fcd840b17a0 2024-04-15T15:31:09.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd80c00640 1 -- 172.21.15.118:0/528752852 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd700129b0 con 0x7fcd840b17a0 2024-04-15T15:31:09.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd8bc00640 1 -- 172.21.15.118:0/528752852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd84161510 con 0x7fcd840b17a0 2024-04-15T15:31:09.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd8bc00640 1 -- 172.21.15.118:0/528752852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd84154340 con 0x7fcd840b17a0 2024-04-15T15:31:09.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd80c00640 1 -- 172.21.15.118:0/528752852 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd70012b50 con 0x7fcd840b17a0 2024-04-15T15:31:09.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.558+0000 7fcd80c00640 1 -- 172.21.15.118:0/528752852 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fcd7001e880 con 0x7fcd840b17a0 2024-04-15T15:31:09.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.562+0000 7fcd8bc00640 1 -- 172.21.15.118:0/528752852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd84161a30 con 0x7fcd840b17a0 2024-04-15T15:31:09.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.562+0000 7fcd80c00640 1 -- 172.21.15.118:0/528752852 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fcd7001eb20 con 0x7fcd840b17a0 2024-04-15T15:31:09.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.666+0000 7fcd8bc00640 1 -- 172.21.15.118:0/528752852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "21acd3fb-727a-4df5-a3e8-e3133372fb52", "id": 2} v 0) -- 0x7fcd84068ab0 con 0x7fcd840b17a0 2024-04-15T15:31:09.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.670+0000 7fcd80c00640 1 -- 172.21.15.118:0/528752852 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "21acd3fb-727a-4df5-a3e8-e3133372fb52", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fcd7001e460 con 0x7fcd840b17a0 2024-04-15T15:31:09.672 INFO:teuthology.orchestra.run.smithi118.stdout:2 2024-04-15T15:31:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.670+0000 7fcd8bc00640 1 -- 172.21.15.118:0/528752852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd840b17a0 msgr2=0x7fcd840b7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.670+0000 7fcd8bc00640 1 --2- 172.21.15.118:0/528752852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd840b17a0 0x7fcd840b7c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000d5f0 tx=0x7fcd7000dab0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.670+0000 7fcd8bc00640 1 -- 172.21.15.118:0/528752852 shutdown_connections 2024-04-15T15:31:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.670+0000 7fcd8bc00640 1 --2- 172.21.15.118:0/528752852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd840d08b0 0x7fcd840b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.670+0000 7fcd8bc00640 1 --2- 172.21.15.118:0/528752852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd840b17a0 0x7fcd840b7c00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.670+0000 7fcd8bc00640 1 --2- 172.21.15.118:0/528752852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd8409afa0 0x7fcd84153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.670+0000 7fcd8bc00640 1 -- 172.21.15.118:0/528752852 >> 172.21.15.118:0/528752852 conn(0x7fcd840b3fe0 msgr2=0x7fcd840b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.670+0000 7fcd8bc00640 1 -- 172.21.15.118:0/528752852 shutdown_connections 2024-04-15T15:31:09.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.670+0000 7fcd8bc00640 1 -- 172.21.15.118:0/528752852 wait complete. 2024-04-15T15:31:09.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 4fe5e16a-be17-4938-839f-b9919f34ca8a 3 2024-04-15T15:31:09.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832f400640 1 Processor -- start 2024-04-15T15:31:09.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832f400640 1 -- start start 2024-04-15T15:31:09.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832f400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 0x7f83280d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f832806dad0 0x7f832809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832f400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83280d1000 con 0x7f832809afa0 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832f400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f83280d12e0 con 0x7f832806dad0 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832f400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f83280d15c0 con 0x7f83280b17a0 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832ca00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 0x7f83280d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832d400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f832809afa0 0x7f832815e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55810/0 (socket says 172.21.15.118:55810) 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832d400640 1 -- 172.21.15.118:0/626738705 learned_addr learned my addr 172.21.15.118:0/626738705 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f8327e00640 1 --2- 172.21.15.118:0/626738705 >> v2:172.21.15.73:3300/0 conn(0x7f832806dad0 0x7f832809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832ca00640 1 -- 172.21.15.118:0/626738705 >> v2:172.21.15.73:3300/0 conn(0x7f832806dad0 msgr2=0x7f832809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832ca00640 1 --2- 172.21.15.118:0/626738705 >> v2:172.21.15.73:3300/0 conn(0x7f832806dad0 0x7f832809aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832ca00640 1 -- 172.21.15.118:0/626738705 >> v1:172.21.15.118:6789/0 conn(0x7f832809afa0 legacy=0x7f832815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f8327400640 1 -- 172.21.15.118:0/626738705 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631537514 0 0) 0x7f83280d1000 con 0x7f832809afa0 2024-04-15T15:31:09.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.826+0000 7f832ca00640 1 -- 172.21.15.118:0/626738705 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83280d18a0 con 0x7f83280b17a0 2024-04-15T15:31:09.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832ca00640 1 --2- 172.21.15.118:0/626738705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 0x7f83280d08b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f831c0097a0 tx=0x7f831c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284b87a54c3f5153 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:09.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f8327400640 1 -- 172.21.15.118:0/626738705 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c0b0070 con 0x7f83280b17a0 2024-04-15T15:31:09.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f8327400640 1 -- 172.21.15.118:0/626738705 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831c0ab600 con 0x7f83280b17a0 2024-04-15T15:31:09.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f8327400640 1 -- 172.21.15.118:0/626738705 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c0ab9d0 con 0x7f83280b17a0 2024-04-15T15:31:09.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832f400640 1 -- 172.21.15.118:0/626738705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 msgr2=0x7f83280d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832f400640 1 --2- 172.21.15.118:0/626738705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 0x7f83280d08b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f831c0097a0 tx=0x7f831c01c480 comp rx=0 tx=0).stop 2024-04-15T15:31:09.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832f400640 1 -- 172.21.15.118:0/626738705 shutdown_connections 2024-04-15T15:31:09.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832f400640 1 --2- 172.21.15.118:0/626738705 >> v2:172.21.15.73:3300/0 conn(0x7f832806dad0 0x7f832809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832f400640 1 --2- 172.21.15.118:0/626738705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 0x7f83280d08b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832f400640 1 -- 172.21.15.118:0/626738705 >> 172.21.15.118:0/626738705 conn(0x7f83280b3fe0 msgr2=0x7f83280b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:09.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832f400640 1 -- 172.21.15.118:0/626738705 shutdown_connections 2024-04-15T15:31:09.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832f400640 1 -- 172.21.15.118:0/626738705 wait complete. 2024-04-15T15:31:09.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832f400640 1 Processor -- start 2024-04-15T15:31:09.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.830+0000 7f832f400640 1 -- start start 2024-04-15T15:31:09.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832806dad0 0x7f8328156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f832809afa0 0x7f83280af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832f400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 0x7f83280afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:09.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832f400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f83280b1d90 con 0x7f832806dad0 2024-04-15T15:31:09.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832f400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f832815ee90 con 0x7f832809afa0 2024-04-15T15:31:09.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832f400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f83280706e0 con 0x7f83280b17a0 2024-04-15T15:31:09.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8327e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f832809afa0 0x7f83280af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832d400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 0x7f83280afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8327e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f832809afa0 0x7f83280af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54058/0 (socket says 172.21.15.118:54058) 2024-04-15T15:31:09.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8327e00640 1 -- 172.21.15.118:0/527265366 learned_addr learned my addr 172.21.15.118:0/527265366 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:09.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832ca00640 1 --2- 172.21.15.118:0/527265366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832806dad0 0x7f8328156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:09.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8327e00640 1 -- 172.21.15.118:0/527265366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 msgr2=0x7f83280afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8327e00640 1 --2- 172.21.15.118:0/527265366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 0x7f83280afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8327e00640 1 -- 172.21.15.118:0/527265366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832806dad0 msgr2=0x7f8328156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8327e00640 1 --2- 172.21.15.118:0/527265366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832806dad0 0x7f8328156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8327e00640 1 -- 172.21.15.118:0/527265366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8328159320 con 0x7f832809afa0 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832d400640 1 --2- 172.21.15.118:0/527265366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 0x7f83280afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832ca00640 1 --2- 172.21.15.118:0/527265366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832806dad0 0x7f8328156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8327e00640 1 --2- 172.21.15.118:0/527265366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f832809afa0 0x7f83280af6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f831400d830 tx=0x7f831400dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8324c00640 1 -- 172.21.15.118:0/527265366 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831400b6c0 con 0x7f832809afa0 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8324c00640 1 -- 172.21.15.118:0/527265366 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8314019070 con 0x7f832809afa0 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8324c00640 1 -- 172.21.15.118:0/527265366 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831400ba60 con 0x7f832809afa0 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832f400640 1 -- 172.21.15.118:0/527265366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83280c7800 con 0x7f832809afa0 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832f400640 1 -- 172.21.15.118:0/527265366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8328156d20 con 0x7f832809afa0 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8324c00640 1 -- 172.21.15.118:0/527265366 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f831401e460 con 0x7f832809afa0 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f8324c00640 1 -- 172.21.15.118:0/527265366 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8314014b90 con 0x7f832809afa0 2024-04-15T15:31:09.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.834+0000 7f832f400640 1 -- 172.21.15.118:0/527265366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8328068ab0 con 0x7f832809afa0 2024-04-15T15:31:09.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.838+0000 7f8324c00640 1 -- 172.21.15.118:0/527265366 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8314014d90 con 0x7f832809afa0 2024-04-15T15:31:09.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.902+0000 7f832f400640 1 -- 172.21.15.118:0/527265366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4fe5e16a-be17-4938-839f-b9919f34ca8a", "id": 3} v 0) -- 0x7f83280d22b0 con 0x7f832809afa0 2024-04-15T15:31:09.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.910+0000 7f8324c00640 1 -- 172.21.15.118:0/527265366 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4fe5e16a-be17-4938-839f-b9919f34ca8a", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8314014700 con 0x7f832809afa0 2024-04-15T15:31:09.913 INFO:teuthology.orchestra.run.smithi118.stdout:3 2024-04-15T15:31:09.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.910+0000 7f832f400640 1 -- 172.21.15.118:0/527265366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f832809afa0 msgr2=0x7f83280af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:09.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.910+0000 7f832f400640 1 --2- 172.21.15.118:0/527265366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f832809afa0 0x7f83280af6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f831400d830 tx=0x7f831400dcf0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.910+0000 7f832f400640 1 -- 172.21.15.118:0/527265366 shutdown_connections 2024-04-15T15:31:09.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.910+0000 7f832f400640 1 --2- 172.21.15.118:0/527265366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83280b17a0 0x7f83280afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.910+0000 7f832f400640 1 --2- 172.21.15.118:0/527265366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f832809afa0 0x7f83280af6d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.910+0000 7f832f400640 1 --2- 172.21.15.118:0/527265366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832806dad0 0x7f8328156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:09.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.910+0000 7f832f400640 1 -- 172.21.15.118:0/527265366 >> 172.21.15.118:0/527265366 conn(0x7f83280b3fe0 msgr2=0x7f832815e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:09.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.910+0000 7f832f400640 1 -- 172.21.15.118:0/527265366 shutdown_connections 2024-04-15T15:31:09.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:09.910+0000 7f832f400640 1 -- 172.21.15.118:0/527265366 wait complete. 2024-04-15T15:31:09.932 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 94ce89f6-dd6f-4736-82fc-a2950adffe0e 4 2024-04-15T15:31:09.948 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:09.946+0000 7fa4a7248180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-15T15:31:10.011 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:10.010+0000 7fa4a7248180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-15T15:31:10.025 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:10.022+0000 7f02cf918180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-15T15:31:10.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.066+0000 7fecd3800640 1 Processor -- start 2024-04-15T15:31:10.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.066+0000 7fecd3800640 1 -- start start 2024-04-15T15:31:10.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.066+0000 7fecd3800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc0b17a0 0x7feccc0d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.066+0000 7fecd3800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feccc06dad0 0x7feccc09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.066+0000 7fecd3800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feccc0d1000 con 0x7feccc09afa0 2024-04-15T15:31:10.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.066+0000 7fecd3800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7feccc0d12e0 con 0x7feccc06dad0 2024-04-15T15:31:10.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.066+0000 7fecd3800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7feccc0d15c0 con 0x7feccc0b17a0 2024-04-15T15:31:10.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7fecd0e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc0b17a0 0x7feccc0d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7fecd1800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7feccc09afa0 0x7feccc15e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55818/0 (socket says 172.21.15.118:55818) 2024-04-15T15:31:10.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7fecd1800640 1 -- 172.21.15.118:0/6380210 learned_addr learned my addr 172.21.15.118:0/6380210 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-04-15T15:31:10.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7feccbe00640 1 --2- 172.21.15.118:0/6380210 >> v2:172.21.15.73:3300/0 conn(0x7feccc06dad0 0x7feccc09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.072 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:10.070+0000 7fa4a7248180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-15T15:31:10.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7fecd0e00640 1 -- 172.21.15.118:0/6380210 >> v2:172.21.15.73:3300/0 conn(0x7feccc06dad0 msgr2=0x7feccc09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:10.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7fecd0e00640 1 --2- 172.21.15.118:0/6380210 >> v2:172.21.15.73:3300/0 conn(0x7feccc06dad0 0x7feccc09aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7feccb400640 1 -- 172.21.15.118:0/6380210 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913571165 0 0) 0x7feccc0d1000 con 0x7feccc09afa0 2024-04-15T15:31:10.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7fecd0e00640 1 -- 172.21.15.118:0/6380210 >> v1:172.21.15.118:6789/0 conn(0x7feccc09afa0 legacy=0x7feccc15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7fecd0e00640 1 -- 172.21.15.118:0/6380210 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc0d18a0 con 0x7feccc0b17a0 2024-04-15T15:31:10.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7fecd0e00640 1 --2- 172.21.15.118:0/6380210 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc0b17a0 0x7feccc0d08b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fecc00097a0 tx=0x7fecc001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5d4eb0603d3d008 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:10.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7feccb400640 1 -- 172.21.15.118:0/6380210 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00b0070 con 0x7feccc0b17a0 2024-04-15T15:31:10.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7feccb400640 1 -- 172.21.15.118:0/6380210 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc00ab600 con 0x7feccc0b17a0 2024-04-15T15:31:10.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.070+0000 7feccb400640 1 -- 172.21.15.118:0/6380210 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00ab9d0 con 0x7feccc0b17a0 2024-04-15T15:31:10.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 -- 172.21.15.118:0/6380210 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc0b17a0 msgr2=0x7feccc0d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 --2- 172.21.15.118:0/6380210 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc0b17a0 0x7feccc0d08b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fecc00097a0 tx=0x7fecc001c480 comp rx=0 tx=0).stop 2024-04-15T15:31:10.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 -- 172.21.15.118:0/6380210 shutdown_connections 2024-04-15T15:31:10.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 --2- 172.21.15.118:0/6380210 >> v2:172.21.15.73:3300/0 conn(0x7feccc06dad0 0x7feccc09aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 --2- 172.21.15.118:0/6380210 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc0b17a0 0x7feccc0d08b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 -- 172.21.15.118:0/6380210 >> 172.21.15.118:0/6380210 conn(0x7feccc0b3fe0 msgr2=0x7feccc0b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:10.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 -- 172.21.15.118:0/6380210 shutdown_connections 2024-04-15T15:31:10.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 -- 172.21.15.118:0/6380210 wait complete. 2024-04-15T15:31:10.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 Processor -- start 2024-04-15T15:31:10.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 -- start start 2024-04-15T15:31:10.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feccc06dad0 0x7feccc156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc09afa0 0x7feccc0af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feccc0b17a0 0x7feccc0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feccc0b1d90 con 0x7feccc06dad0 2024-04-15T15:31:10.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7feccc15ee90 con 0x7feccc0b17a0 2024-04-15T15:31:10.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd3800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7feccc0706e0 con 0x7feccc09afa0 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd1800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feccc0b17a0 0x7feccc0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7feccbe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc09afa0 0x7feccc0af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7feccbe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc09afa0 0x7feccc0af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:36604/0 (socket says 172.21.15.118:36604) 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd0e00640 1 --2- 172.21.15.118:0/3982927963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feccc06dad0 0x7feccc156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7feccbe00640 1 -- 172.21.15.118:0/3982927963 learned_addr learned my addr 172.21.15.118:0/3982927963 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd1800640 1 -- 172.21.15.118:0/3982927963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc09afa0 msgr2=0x7feccc0af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.074+0000 7fecd1800640 1 --2- 172.21.15.118:0/3982927963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc09afa0 0x7feccc0af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecd1800640 1 -- 172.21.15.118:0/3982927963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feccc06dad0 msgr2=0x7feccc156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecd1800640 1 --2- 172.21.15.118:0/3982927963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feccc06dad0 0x7feccc156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecd1800640 1 -- 172.21.15.118:0/3982927963 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc159320 con 0x7feccc0b17a0 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7feccbe00640 1 --2- 172.21.15.118:0/3982927963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc09afa0 0x7feccc0af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecd0e00640 1 --2- 172.21.15.118:0/3982927963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feccc06dad0 0x7feccc156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecd1800640 1 --2- 172.21.15.118:0/3982927963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feccc0b17a0 0x7feccc0afc10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c710 tx=0x7fecc400cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:10.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecc8c00640 1 -- 172.21.15.118:0/3982927963 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4018070 con 0x7feccc0b17a0 2024-04-15T15:31:10.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecc8c00640 1 -- 172.21.15.118:0/3982927963 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc400ce20 con 0x7feccc0b17a0 2024-04-15T15:31:10.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecc8c00640 1 -- 172.21.15.118:0/3982927963 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc400a880 con 0x7feccc0b17a0 2024-04-15T15:31:10.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecd3800640 1 -- 172.21.15.118:0/3982927963 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc0c7800 con 0x7feccc0b17a0 2024-04-15T15:31:10.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecd3800640 1 -- 172.21.15.118:0/3982927963 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc156d20 con 0x7feccc0b17a0 2024-04-15T15:31:10.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecc8c00640 1 -- 172.21.15.118:0/3982927963 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fecc400aa20 con 0x7feccc0b17a0 2024-04-15T15:31:10.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecc8c00640 1 -- 172.21.15.118:0/3982927963 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fecc40075e0 con 0x7feccc0b17a0 2024-04-15T15:31:10.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.078+0000 7fecd3800640 1 -- 172.21.15.118:0/3982927963 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feccc068ab0 con 0x7feccc0b17a0 2024-04-15T15:31:10.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.082+0000 7fecc8c00640 1 -- 172.21.15.118:0/3982927963 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fecc400ad10 con 0x7feccc0b17a0 2024-04-15T15:31:10.092 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:10.090+0000 7f02cf918180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-15T15:31:10.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.146+0000 7fecd3800640 1 -- 172.21.15.118:0/3982927963 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "94ce89f6-dd6f-4736-82fc-a2950adffe0e", "id": 4} v 0) -- 0x7feccc0d22b0 con 0x7feccc0b17a0 2024-04-15T15:31:10.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.150+0000 7fecc8c00640 1 -- 172.21.15.118:0/3982927963 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94ce89f6-dd6f-4736-82fc-a2950adffe0e", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fecc40070d0 con 0x7feccc0b17a0 2024-04-15T15:31:10.154 INFO:teuthology.orchestra.run.smithi118.stdout:4 2024-04-15T15:31:10.154 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:10.150+0000 7f02cf918180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-15T15:31:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.150+0000 7fecd3800640 1 -- 172.21.15.118:0/3982927963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feccc0b17a0 msgr2=0x7feccc0afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.150+0000 7fecd3800640 1 --2- 172.21.15.118:0/3982927963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feccc0b17a0 0x7feccc0afc10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c710 tx=0x7fecc400cbd0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.150+0000 7fecd3800640 1 -- 172.21.15.118:0/3982927963 shutdown_connections 2024-04-15T15:31:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.150+0000 7fecd3800640 1 --2- 172.21.15.118:0/3982927963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feccc0b17a0 0x7feccc0afc10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.150+0000 7fecd3800640 1 --2- 172.21.15.118:0/3982927963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feccc09afa0 0x7feccc0af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.150+0000 7fecd3800640 1 --2- 172.21.15.118:0/3982927963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feccc06dad0 0x7feccc156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.150+0000 7fecd3800640 1 -- 172.21.15.118:0/3982927963 >> 172.21.15.118:0/3982927963 conn(0x7feccc0b3fe0 msgr2=0x7feccc15e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:10.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.150+0000 7fecd3800640 1 -- 172.21.15.118:0/3982927963 shutdown_connections 2024-04-15T15:31:10.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.150+0000 7fecd3800640 1 -- 172.21.15.118:0/3982927963 wait complete. 2024-04-15T15:31:10.161 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:10.162+0000 7fa4a7248180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-15T15:31:10.173 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 19eab2f9-771c-408b-85d0-410f2d6fae55 5 2024-04-15T15:31:10.222 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:10.222+0000 7fa4a7248180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-15T15:31:10.248 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:10.246+0000 7f02cf918180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-15T15:31:10.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f5087600640 1 Processor -- start 2024-04-15T15:31:10.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f5087600640 1 -- start start 2024-04-15T15:31:10.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f5087600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f508015c940 0x7f508009b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f5087600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50800cdc60 0x7f508006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f5087600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508009be00 con 0x7f5080070170 2024-04-15T15:31:10.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f5087600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f508009ab00 con 0x7f508015c940 2024-04-15T15:31:10.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f5087600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f508009ade0 con 0x7f50800cdc60 2024-04-15T15:31:10.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f507fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50800cdc60 0x7f508006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f5085600640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5080070170 0x7f5080160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55830/0 (socket says 172.21.15.118:55830) 2024-04-15T15:31:10.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f5085600640 1 -- 172.21.15.118:0/3623839366 learned_addr learned my addr 172.21.15.118:0/3623839366 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-04-15T15:31:10.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f5084c00640 1 --2- 172.21.15.118:0/3623839366 >> v2:172.21.15.73:3300/0 conn(0x7f508015c940 0x7f508009b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.311 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f02cf918180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-15T15:31:10.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f507fe00640 1 -- 172.21.15.118:0/3623839366 >> v2:172.21.15.73:3300/0 conn(0x7f508015c940 msgr2=0x7f508009b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:10.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f507fe00640 1 --2- 172.21.15.118:0/3623839366 >> v2:172.21.15.73:3300/0 conn(0x7f508015c940 0x7f508009b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f507fe00640 1 -- 172.21.15.118:0/3623839366 >> v1:172.21.15.118:6789/0 conn(0x7f5080070170 legacy=0x7f5080160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.306+0000 7f507fe00640 1 -- 172.21.15.118:0/3623839366 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508009b0c0 con 0x7f50800cdc60 2024-04-15T15:31:10.312 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:10.310+0000 7fa4a7248180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-15T15:31:10.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f507fe00640 1 --2- 172.21.15.118:0/3623839366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50800cdc60 0x7f508006fc30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50801602a0 tx=0x7f506c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f6cdf4bcbda4f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:10.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f507f400640 1 -- 172.21.15.118:0/3623839366 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c0b5070 con 0x7f50800cdc60 2024-04-15T15:31:10.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f507f400640 1 -- 172.21.15.118:0/3623839366 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f506c0a8970 con 0x7f50800cdc60 2024-04-15T15:31:10.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f507f400640 1 -- 172.21.15.118:0/3623839366 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c0a8d40 con 0x7f50800cdc60 2024-04-15T15:31:10.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f5087600640 1 -- 172.21.15.118:0/3623839366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50800cdc60 msgr2=0x7f508006fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f5087600640 1 --2- 172.21.15.118:0/3623839366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50800cdc60 0x7f508006fc30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50801602a0 tx=0x7f506c01ec70 comp rx=0 tx=0).stop 2024-04-15T15:31:10.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f5087600640 1 -- 172.21.15.118:0/3623839366 shutdown_connections 2024-04-15T15:31:10.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f5087600640 1 --2- 172.21.15.118:0/3623839366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50800cdc60 0x7f508006fc30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f5087600640 1 --2- 172.21.15.118:0/3623839366 >> v2:172.21.15.73:3300/0 conn(0x7f508015c940 0x7f508009b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f5087600640 1 -- 172.21.15.118:0/3623839366 >> 172.21.15.118:0/3623839366 conn(0x7f50800b40c0 msgr2=0x7f50800b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:10.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f5087600640 1 -- 172.21.15.118:0/3623839366 shutdown_connections 2024-04-15T15:31:10.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.310+0000 7f5087600640 1 -- 172.21.15.118:0/3623839366 wait complete. 2024-04-15T15:31:10.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5087600640 1 Processor -- start 2024-04-15T15:31:10.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5087600640 1 -- start start 2024-04-15T15:31:10.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5087600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5080070170 0x7f50800b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5087600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50800cdc60 0x7f50800cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5087600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508015c940 0x7f50800cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5087600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f50800ce0c0 con 0x7f508015c940 2024-04-15T15:31:10.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5087600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f50800ce470 con 0x7f5080070170 2024-04-15T15:31:10.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5087600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f50800b5b40 con 0x7f50800cdc60 2024-04-15T15:31:10.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5084c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5080070170 0x7f50800b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f507fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50800cdc60 0x7f50800cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5084c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5080070170 0x7f50800b7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54086/0 (socket says 172.21.15.118:54086) 2024-04-15T15:31:10.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5084c00640 1 -- 172.21.15.118:0/897253879 learned_addr learned my addr 172.21.15.118:0/897253879 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:10.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.314+0000 7f5085600640 1 --2- 172.21.15.118:0/897253879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508015c940 0x7f50800cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f5084c00640 1 -- 172.21.15.118:0/897253879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50800cdc60 msgr2=0x7f50800cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f5084c00640 1 --2- 172.21.15.118:0/897253879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50800cdc60 0x7f50800cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f5084c00640 1 -- 172.21.15.118:0/897253879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508015c940 msgr2=0x7f50800cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f5084c00640 1 --2- 172.21.15.118:0/897253879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508015c940 0x7f50800cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f5084c00640 1 -- 172.21.15.118:0/897253879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50800b5e20 con 0x7f5080070170 2024-04-15T15:31:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f507fe00640 1 --2- 172.21.15.118:0/897253879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50800cdc60 0x7f50800cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f5084c00640 1 --2- 172.21.15.118:0/897253879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5080070170 0x7f50800b7c00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f507400e930 tx=0x7f507400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f507cc00640 1 -- 172.21.15.118:0/897253879 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074017070 con 0x7f5080070170 2024-04-15T15:31:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f507cc00640 1 -- 172.21.15.118:0/897253879 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507400ca00 con 0x7f5080070170 2024-04-15T15:31:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f507cc00640 1 -- 172.21.15.118:0/897253879 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507400cdb0 con 0x7f5080070170 2024-04-15T15:31:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f5087600640 1 -- 172.21.15.118:0/897253879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50800c8e00 con 0x7f5080070170 2024-04-15T15:31:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f5087600640 1 -- 172.21.15.118:0/897253879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50800b5380 con 0x7f5080070170 2024-04-15T15:31:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f507cc00640 1 -- 172.21.15.118:0/897253879 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f507401a070 con 0x7f5080070170 2024-04-15T15:31:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f507cc00640 1 -- 172.21.15.118:0/897253879 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f507401cb10 con 0x7f5080070170 2024-04-15T15:31:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.318+0000 7f5087600640 1 -- 172.21.15.118:0/897253879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50800691c0 con 0x7f5080070170 2024-04-15T15:31:10.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.322+0000 7f507cc00640 1 -- 172.21.15.118:0/897253879 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f507401c590 con 0x7f5080070170 2024-04-15T15:31:10.376 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:10.374+0000 7fa4a7248180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-15T15:31:10.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.390+0000 7f5087600640 1 -- 172.21.15.118:0/897253879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "19eab2f9-771c-408b-85d0-410f2d6fae55", "id": 5} v 0) -- 0x7f50800b4f60 con 0x7f5080070170 2024-04-15T15:31:10.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.394+0000 7f507cc00640 1 -- 172.21.15.118:0/897253879 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19eab2f9-771c-408b-85d0-410f2d6fae55", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f507401c770 con 0x7f5080070170 2024-04-15T15:31:10.396 INFO:teuthology.orchestra.run.smithi118.stdout:5 2024-04-15T15:31:10.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.394+0000 7f5087600640 1 -- 172.21.15.118:0/897253879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5080070170 msgr2=0x7f50800b7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.394+0000 7f5087600640 1 --2- 172.21.15.118:0/897253879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5080070170 0x7f50800b7c00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f507400e930 tx=0x7f507400edf0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.394+0000 7f5087600640 1 -- 172.21.15.118:0/897253879 shutdown_connections 2024-04-15T15:31:10.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.394+0000 7f5087600640 1 --2- 172.21.15.118:0/897253879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508015c940 0x7f50800cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.394+0000 7f5087600640 1 --2- 172.21.15.118:0/897253879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50800cdc60 0x7f50800cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.394+0000 7f5087600640 1 --2- 172.21.15.118:0/897253879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5080070170 0x7f50800b7c00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.394+0000 7f5087600640 1 -- 172.21.15.118:0/897253879 >> 172.21.15.118:0/897253879 conn(0x7f50800b40c0 msgr2=0x7f50800af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:10.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.394+0000 7f5087600640 1 -- 172.21.15.118:0/897253879 shutdown_connections 2024-04-15T15:31:10.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.394+0000 7f5087600640 1 -- 172.21.15.118:0/897253879 wait complete. 2024-04-15T15:31:10.407 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:10.406+0000 7f02cf918180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-15T15:31:10.415 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 91f47132-e5ff-4534-b430-71da6b5d571b 6 2024-04-15T15:31:10.478 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:10.470+0000 7f02cf918180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-15T15:31:10.542 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:10.542+0000 7fa4a7248180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-15T15:31:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbd06800640 1 Processor -- start 2024-04-15T15:31:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbd06800640 1 -- start start 2024-04-15T15:31:10.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbd06800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbd000b17a0 0x7fbd000d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbd06800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbd06800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd000d1000 con 0x7fbd0006dad0 2024-04-15T15:31:10.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbd06800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbd000d12e0 con 0x7fbd000b17a0 2024-04-15T15:31:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbd06800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbd000d15c0 con 0x7fbd0009b170 2024-04-15T15:31:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbcffe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbcffe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0015e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:36630/0 (socket says 172.21.15.118:36630) 2024-04-15T15:31:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbcffe00640 1 -- 172.21.15.118:0/3864155344 learned_addr learned my addr 172.21.15.118:0/3864155344 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.546+0000 7fbcff400640 1 --2- 172.21.15.118:0/3864155344 >> v2:172.21.15.73:3300/0 conn(0x7fbd000b17a0 0x7fbd000d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbcffe00640 1 -- 172.21.15.118:0/3864155344 >> v2:172.21.15.73:3300/0 conn(0x7fbd000b17a0 msgr2=0x7fbd000d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbcffe00640 1 --2- 172.21.15.118:0/3864155344 >> v2:172.21.15.73:3300/0 conn(0x7fbd000b17a0 0x7fbd000d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbcffe00640 1 -- 172.21.15.118:0/3864155344 >> v1:172.21.15.73:6789/0 conn(0x7fbd0006dad0 legacy=0x7fbd0009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbcffe00640 1 -- 172.21.15.118:0/3864155344 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd000d18a0 con 0x7fbd0009b170 2024-04-15T15:31:10.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbcffe00640 1 --2- 172.21.15.118:0/3864155344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0015e160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009e50 tx=0x7fbcf801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5732acb623086ea6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:10.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbcfe000640 1 -- 172.21.15.118:0/3864155344 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf80a5810 con 0x7fbd0009b170 2024-04-15T15:31:10.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbcfe000640 1 -- 172.21.15.118:0/3864155344 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf80a59b0 con 0x7fbd0009b170 2024-04-15T15:31:10.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbcfe000640 1 -- 172.21.15.118:0/3864155344 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf80a5d80 con 0x7fbd0009b170 2024-04-15T15:31:10.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbd06800640 1 -- 172.21.15.118:0/3864155344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 msgr2=0x7fbd0015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbd06800640 1 --2- 172.21.15.118:0/3864155344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0015e160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009e50 tx=0x7fbcf801ca30 comp rx=0 tx=0).stop 2024-04-15T15:31:10.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbd06800640 1 -- 172.21.15.118:0/3864155344 shutdown_connections 2024-04-15T15:31:10.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbd06800640 1 --2- 172.21.15.118:0/3864155344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0015e160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbd06800640 1 --2- 172.21.15.118:0/3864155344 >> v2:172.21.15.73:3300/0 conn(0x7fbd000b17a0 0x7fbd000d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.550+0000 7fbd06800640 1 -- 172.21.15.118:0/3864155344 >> 172.21.15.118:0/3864155344 conn(0x7fbd000b3fe0 msgr2=0x7fbd000b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:10.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbd06800640 1 -- 172.21.15.118:0/3864155344 shutdown_connections 2024-04-15T15:31:10.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbd06800640 1 -- 172.21.15.118:0/3864155344 wait complete. 2024-04-15T15:31:10.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbd06800640 1 Processor -- start 2024-04-15T15:31:10.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbd06800640 1 -- start start 2024-04-15T15:31:10.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbd06800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd0006dad0 0x7fbd000c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbd06800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0014a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbd06800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd000b17a0 0x7fbd000c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbd06800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0006fed0 con 0x7fbd000b17a0 2024-04-15T15:31:10.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbd06800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0006e130 con 0x7fbd0006dad0 2024-04-15T15:31:10.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbd06800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbd00070050 con 0x7fbd0009b170 2024-04-15T15:31:10.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcff400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd0006dad0 0x7fbd000c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcfea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0014a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcff400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd0006dad0 0x7fbd000c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54096/0 (socket says 172.21.15.118:54096) 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcff400640 1 -- 172.21.15.118:0/2965029872 learned_addr learned my addr 172.21.15.118:0/2965029872 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcffe00640 1 --2- 172.21.15.118:0/2965029872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd000b17a0 0x7fbd000c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcff400640 1 -- 172.21.15.118:0/2965029872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 msgr2=0x7fbd0014a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcff400640 1 --2- 172.21.15.118:0/2965029872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0014a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcff400640 1 -- 172.21.15.118:0/2965029872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd000b17a0 msgr2=0x7fbd000c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcff400640 1 --2- 172.21.15.118:0/2965029872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd000b17a0 0x7fbd000c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcff400640 1 -- 172.21.15.118:0/2965029872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0014ad00 con 0x7fbd0006dad0 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcfea00640 1 --2- 172.21.15.118:0/2965029872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0014a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.554+0000 7fbcff400640 1 --2- 172.21.15.118:0/2965029872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd0006dad0 0x7fbd000c5fe0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000d830 tx=0x7fbcf000dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.558+0000 7fbcf7400640 1 -- 172.21.15.118:0/2965029872 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000b6c0 con 0x7fbd0006dad0 2024-04-15T15:31:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.558+0000 7fbcf7400640 1 -- 172.21.15.118:0/2965029872 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf0019070 con 0x7fbd0006dad0 2024-04-15T15:31:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.558+0000 7fbcf7400640 1 -- 172.21.15.118:0/2965029872 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000baa0 con 0x7fbd0006dad0 2024-04-15T15:31:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.558+0000 7fbd06800640 1 -- 172.21.15.118:0/2965029872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0014afe0 con 0x7fbd0006dad0 2024-04-15T15:31:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.558+0000 7fbd06800640 1 -- 172.21.15.118:0/2965029872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd000c6520 con 0x7fbd0006dad0 2024-04-15T15:31:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.558+0000 7fbcf7400640 1 -- 172.21.15.118:0/2965029872 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbcf001e460 con 0x7fbd0006dad0 2024-04-15T15:31:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.558+0000 7fbcf7400640 1 -- 172.21.15.118:0/2965029872 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fbcf0014ca0 con 0x7fbd0006dad0 2024-04-15T15:31:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.558+0000 7fbd06800640 1 -- 172.21.15.118:0/2965029872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd00068ab0 con 0x7fbd0006dad0 2024-04-15T15:31:10.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.558+0000 7fbcf7400640 1 -- 172.21.15.118:0/2965029872 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbcf00146b0 con 0x7fbd0006dad0 2024-04-15T15:31:10.613 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:10.614+0000 7fa4a7248180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-15T15:31:10.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.626+0000 7fbd06800640 1 -- 172.21.15.118:0/2965029872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "91f47132-e5ff-4534-b430-71da6b5d571b", "id": 6} v 0) -- 0x7fbd000d22b0 con 0x7fbd0006dad0 2024-04-15T15:31:10.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.630+0000 7fbcf7400640 1 -- 172.21.15.118:0/2965029872 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "91f47132-e5ff-4534-b430-71da6b5d571b", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fbcf0014890 con 0x7fbd0006dad0 2024-04-15T15:31:10.632 INFO:teuthology.orchestra.run.smithi118.stdout:6 2024-04-15T15:31:10.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.630+0000 7fbd06800640 1 -- 172.21.15.118:0/2965029872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd0006dad0 msgr2=0x7fbd000c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.630+0000 7fbd06800640 1 --2- 172.21.15.118:0/2965029872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd0006dad0 0x7fbd000c5fe0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000d830 tx=0x7fbcf000dcf0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.630+0000 7fbd06800640 1 -- 172.21.15.118:0/2965029872 shutdown_connections 2024-04-15T15:31:10.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.630+0000 7fbd06800640 1 --2- 172.21.15.118:0/2965029872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd000b17a0 0x7fbd000c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.630+0000 7fbd06800640 1 --2- 172.21.15.118:0/2965029872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd0009b170 0x7fbd0014a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.630+0000 7fbd06800640 1 --2- 172.21.15.118:0/2965029872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd0006dad0 0x7fbd000c5fe0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.630+0000 7fbd06800640 1 -- 172.21.15.118:0/2965029872 >> 172.21.15.118:0/2965029872 conn(0x7fbd000b3fe0 msgr2=0x7fbd00074ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:10.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.630+0000 7fbd06800640 1 -- 172.21.15.118:0/2965029872 shutdown_connections 2024-04-15T15:31:10.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.630+0000 7fbd06800640 1 -- 172.21.15.118:0/2965029872 wait complete. 2024-04-15T15:31:10.647 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:10.642+0000 7f02cf918180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-15T15:31:10.651 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 7914a713-2763-40cd-8ea6-f1a55fc3128b 7 2024-04-15T15:31:10.721 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:10.718+0000 7f02cf918180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-15T15:31:10.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.782+0000 7fd998e00640 1 Processor -- start 2024-04-15T15:31:10.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.782+0000 7fd998e00640 1 -- start start 2024-04-15T15:31:10.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd998e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9940cf5b0 0x7fd9940cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd998e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940c5080 0x7fd9940c5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd998e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9940cef10 con 0x7fd99415b7c0 2024-04-15T15:31:10.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd998e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd9940c5a50 con 0x7fd9940cf5b0 2024-04-15T15:31:10.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd998e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd9940cec30 con 0x7fd9940c5080 2024-04-15T15:31:10.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd991e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd99415b7c0 0x7fd9940cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55834/0 (socket says 172.21.15.118:55834) 2024-04-15T15:31:10.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd991e00640 1 -- 172.21.15.118:0/609527800 learned_addr learned my addr 172.21.15.118:0/609527800 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-04-15T15:31:10.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd992800640 1 --2- 172.21.15.118:0/609527800 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940c5080 0x7fd9940c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd991400640 1 --2- 172.21.15.118:0/609527800 >> v2:172.21.15.73:3300/0 conn(0x7fd9940cf5b0 0x7fd9940cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd990a00640 1 -- 172.21.15.118:0/609527800 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028180256 0 0) 0x7fd9940cef10 con 0x7fd99415b7c0 2024-04-15T15:31:10.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd992800640 1 -- 172.21.15.118:0/609527800 >> v2:172.21.15.73:3300/0 conn(0x7fd9940cf5b0 msgr2=0x7fd9940cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:10.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd992800640 1 --2- 172.21.15.118:0/609527800 >> v2:172.21.15.73:3300/0 conn(0x7fd9940cf5b0 0x7fd9940cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd992800640 1 -- 172.21.15.118:0/609527800 >> v1:172.21.15.118:6789/0 conn(0x7fd99415b7c0 legacy=0x7fd9940cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.786+0000 7fd992800640 1 -- 172.21.15.118:0/609527800 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9940cd3d0 con 0x7fd9940c5080 2024-04-15T15:31:10.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd992800640 1 --2- 172.21.15.118:0/609527800 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940c5080 0x7fd9940c5510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009d90 tx=0x7fd98c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c696adb40274ae39 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:10.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd990a00640 1 -- 172.21.15.118:0/609527800 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0b2070 con 0x7fd9940c5080 2024-04-15T15:31:10.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd990a00640 1 -- 172.21.15.118:0/609527800 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98c0a5940 con 0x7fd9940c5080 2024-04-15T15:31:10.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd990a00640 1 -- 172.21.15.118:0/609527800 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0a5d10 con 0x7fd9940c5080 2024-04-15T15:31:10.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 -- 172.21.15.118:0/609527800 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940c5080 msgr2=0x7fd9940c5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 --2- 172.21.15.118:0/609527800 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940c5080 0x7fd9940c5510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009d90 tx=0x7fd98c01c970 comp rx=0 tx=0).stop 2024-04-15T15:31:10.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 -- 172.21.15.118:0/609527800 shutdown_connections 2024-04-15T15:31:10.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 --2- 172.21.15.118:0/609527800 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940c5080 0x7fd9940c5510 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 --2- 172.21.15.118:0/609527800 >> v2:172.21.15.73:3300/0 conn(0x7fd9940cf5b0 0x7fd9940cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 -- 172.21.15.118:0/609527800 >> 172.21.15.118:0/609527800 conn(0x7fd99409aa60 msgr2=0x7fd9940d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:10.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 -- 172.21.15.118:0/609527800 shutdown_connections 2024-04-15T15:31:10.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 -- 172.21.15.118:0/609527800 wait complete. 2024-04-15T15:31:10.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 Processor -- start 2024-04-15T15:31:10.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 -- start start 2024-04-15T15:31:10.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9940c5080 0x7fd9940b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940cf5b0 0x7fd994156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99415b7c0 0x7fd99414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:10.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd9940ce750 con 0x7fd9940c5080 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd99415bba0 con 0x7fd99415b7c0 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd998e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd9940ce8d0 con 0x7fd9940cf5b0 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd992800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99415b7c0 0x7fd99414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.790+0000 7fd991400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940cf5b0 0x7fd994156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd992800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99415b7c0 0x7fd99414dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54108/0 (socket says 172.21.15.118:54108) 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd992800640 1 -- 172.21.15.118:0/2993959928 learned_addr learned my addr 172.21.15.118:0/2993959928 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd991e00640 1 --2- 172.21.15.118:0/2993959928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9940c5080 0x7fd9940b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd991400640 1 -- 172.21.15.118:0/2993959928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99415b7c0 msgr2=0x7fd99414dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd991400640 1 --2- 172.21.15.118:0/2993959928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99415b7c0 0x7fd99414dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd991400640 1 -- 172.21.15.118:0/2993959928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9940c5080 msgr2=0x7fd9940b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd991400640 1 --2- 172.21.15.118:0/2993959928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9940c5080 0x7fd9940b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd991400640 1 -- 172.21.15.118:0/2993959928 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd994158ca0 con 0x7fd9940cf5b0 2024-04-15T15:31:10.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd992800640 1 --2- 172.21.15.118:0/2993959928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99415b7c0 0x7fd99414dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:10.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd991400640 1 --2- 172.21.15.118:0/2993959928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940cf5b0 0x7fd994156620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd98000d5f0 tx=0x7fd98000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:10.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd98a000640 1 -- 172.21.15.118:0/2993959928 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9800125f0 con 0x7fd9940cf5b0 2024-04-15T15:31:10.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd98a000640 1 -- 172.21.15.118:0/2993959928 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd980019070 con 0x7fd9940cf5b0 2024-04-15T15:31:10.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd98a000640 1 -- 172.21.15.118:0/2993959928 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9800129b0 con 0x7fd9940cf5b0 2024-04-15T15:31:10.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd998e00640 1 -- 172.21.15.118:0/2993959928 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd994158f80 con 0x7fd9940cf5b0 2024-04-15T15:31:10.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd998e00640 1 -- 172.21.15.118:0/2993959928 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd994159540 con 0x7fd9940cf5b0 2024-04-15T15:31:10.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd98a000640 1 -- 172.21.15.118:0/2993959928 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd980012b50 con 0x7fd9940cf5b0 2024-04-15T15:31:10.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd98a000640 1 -- 172.21.15.118:0/2993959928 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fd98001eac0 con 0x7fd9940cf5b0 2024-04-15T15:31:10.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.794+0000 7fd998e00640 1 -- 172.21.15.118:0/2993959928 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd994068ab0 con 0x7fd9940cf5b0 2024-04-15T15:31:10.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.798+0000 7fd98a000640 1 -- 172.21.15.118:0/2993959928 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd98001e460 con 0x7fd9940cf5b0 2024-04-15T15:31:10.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.862+0000 7fd998e00640 1 -- 172.21.15.118:0/2993959928 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7914a713-2763-40cd-8ea6-f1a55fc3128b", "id": 7} v 0) -- 0x7fd9940b7490 con 0x7fd9940cf5b0 2024-04-15T15:31:10.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.866+0000 7fd98a000640 1 -- 172.21.15.118:0/2993959928 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7914a713-2763-40cd-8ea6-f1a55fc3128b", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fd98001e640 con 0x7fd9940cf5b0 2024-04-15T15:31:10.870 INFO:teuthology.orchestra.run.smithi118.stdout:7 2024-04-15T15:31:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.866+0000 7fd998e00640 1 -- 172.21.15.118:0/2993959928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940cf5b0 msgr2=0x7fd994156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.866+0000 7fd998e00640 1 --2- 172.21.15.118:0/2993959928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940cf5b0 0x7fd994156620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd98000d5f0 tx=0x7fd98000dab0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.866+0000 7fd998e00640 1 -- 172.21.15.118:0/2993959928 shutdown_connections 2024-04-15T15:31:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.866+0000 7fd998e00640 1 --2- 172.21.15.118:0/2993959928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99415b7c0 0x7fd99414dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.866+0000 7fd998e00640 1 --2- 172.21.15.118:0/2993959928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9940cf5b0 0x7fd994156620 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.866+0000 7fd998e00640 1 --2- 172.21.15.118:0/2993959928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9940c5080 0x7fd9940b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.866+0000 7fd998e00640 1 -- 172.21.15.118:0/2993959928 >> 172.21.15.118:0/2993959928 conn(0x7fd99409aa60 msgr2=0x7fd9940cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.866+0000 7fd998e00640 1 -- 172.21.15.118:0/2993959928 shutdown_connections 2024-04-15T15:31:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:31:10.866+0000 7fd998e00640 1 -- 172.21.15.118:0/2993959928 wait complete. 2024-04-15T15:31:10.888 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-15T15:31:10.888 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-15T15:31:10.892 INFO:tasks.ceph.osd.0:Started 2024-04-15T15:31:10.892 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-15T15:31:10.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-15T15:31:10.895 INFO:tasks.ceph.osd.1:Started 2024-04-15T15:31:10.895 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-15T15:31:10.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-15T15:31:10.898 INFO:tasks.ceph.osd.2:Started 2024-04-15T15:31:10.898 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-15T15:31:10.898 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-15T15:31:10.901 INFO:tasks.ceph.osd.3:Started 2024-04-15T15:31:10.901 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-15T15:31:10.901 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-15T15:31:10.904 INFO:tasks.ceph.osd.4:Started 2024-04-15T15:31:10.904 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-15T15:31:10.904 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-15T15:31:10.907 INFO:tasks.ceph.osd.5:Started 2024-04-15T15:31:10.908 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-15T15:31:10.908 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-15T15:31:10.910 INFO:tasks.ceph.osd.6:Started 2024-04-15T15:31:10.911 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-15T15:31:10.911 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-15T15:31:10.913 INFO:tasks.ceph.osd.7:Started 2024-04-15T15:31:10.914 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:11.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3adce00640 1 Processor -- start 2024-04-15T15:31:11.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3adce00640 1 -- start start 2024-04-15T15:31:11.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3adce00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ad815c6d0 0x7f3ad80d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:11.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3adce00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3ad809b170 0x7f3ad80d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:11.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3adce00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad80cd690 con 0x7f3ad80cd1b0 2024-04-15T15:31:11.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3adce00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad80cd970 con 0x7f3ad815c6d0 2024-04-15T15:31:11.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3adce00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad80cdc50 con 0x7f3ad809b170 2024-04-15T15:31:11.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3ad5e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ad815c6d0 0x7f3ad80d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:11.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3ad5e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ad815c6d0 0x7f3ad80d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38210/0 (socket says 172.21.15.73:38210) 2024-04-15T15:31:11.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3ad5400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3ad80cd1b0 0x7f3ad809aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41666/0 (socket says 172.21.15.73:41666) 2024-04-15T15:31:11.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3ad5e00640 1 -- 172.21.15.73:0/2870254386 learned_addr learned my addr 172.21.15.73:0/2870254386 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:11.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3ad6800640 1 --2- 172.21.15.73:0/2870254386 >> v2:172.21.15.118:3300/0 conn(0x7f3ad809b170 0x7f3ad80d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:11.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3ad5e00640 1 -- 172.21.15.73:0/2870254386 >> v2:172.21.15.118:3300/0 conn(0x7f3ad809b170 msgr2=0x7f3ad80d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:11.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3ad5e00640 1 --2- 172.21.15.73:0/2870254386 >> v2:172.21.15.118:3300/0 conn(0x7f3ad809b170 0x7f3ad80d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:11.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3ad5e00640 1 -- 172.21.15.73:0/2870254386 >> v1:172.21.15.73:6789/0 conn(0x7f3ad80cd1b0 legacy=0x7f3ad809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:11.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3ad5e00640 1 -- 172.21.15.73:0/2870254386 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad80cdf30 con 0x7f3ad815c6d0 2024-04-15T15:31:11.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.122+0000 7f3ad4a00640 1 -- 172.21.15.73:0/2870254386 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889214939 0 0) 0x7f3ad80cd690 con 0x7f3ad80cd1b0 2024-04-15T15:31:11.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3ad5e00640 1 --2- 172.21.15.73:0/2870254386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad815c6d0 0x7f3ad80d0d70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80ce730 tx=0x7f3ac801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7007f8ec770763 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:11.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3ad4a00640 1 -- 172.21.15.73:0/2870254386 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80aa670 con 0x7f3ad815c6d0 2024-04-15T15:31:11.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3ad4a00640 1 -- 172.21.15.73:0/2870254386 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac80af070 con 0x7f3ad815c6d0 2024-04-15T15:31:11.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3ad4a00640 1 -- 172.21.15.73:0/2870254386 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80aaa30 con 0x7f3ad815c6d0 2024-04-15T15:31:11.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3adce00640 1 -- 172.21.15.73:0/2870254386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad815c6d0 msgr2=0x7f3ad80d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:11.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3adce00640 1 --2- 172.21.15.73:0/2870254386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad815c6d0 0x7f3ad80d0d70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80ce730 tx=0x7f3ac801c4f0 comp rx=0 tx=0).stop 2024-04-15T15:31:11.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3adce00640 1 -- 172.21.15.73:0/2870254386 shutdown_connections 2024-04-15T15:31:11.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3adce00640 1 --2- 172.21.15.73:0/2870254386 >> v2:172.21.15.118:3300/0 conn(0x7f3ad809b170 0x7f3ad80d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:11.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3adce00640 1 --2- 172.21.15.73:0/2870254386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad815c6d0 0x7f3ad80d0d70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:11.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3adce00640 1 -- 172.21.15.73:0/2870254386 >> 172.21.15.73:0/2870254386 conn(0x7f3ad80b3fe0 msgr2=0x7f3ad80b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:11.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3adce00640 1 -- 172.21.15.73:0/2870254386 shutdown_connections 2024-04-15T15:31:11.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.126+0000 7f3adce00640 1 -- 172.21.15.73:0/2870254386 wait complete. 2024-04-15T15:31:11.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3adce00640 1 Processor -- start 2024-04-15T15:31:11.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3adce00640 1 -- start start 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3adce00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad809b170 0x7f3ad80ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3adce00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad80cd1b0 0x7f3ad8166250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3adce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad815c6d0 0x7f3ad80b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3adce00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad80b1c20 con 0x7f3ad809b170 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3adce00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad80b1aa0 con 0x7f3ad815c6d0 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3adce00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad80b1da0 con 0x7f3ad80cd1b0 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ad5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad809b170 0x7f3ad80ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ad5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad809b170 0x7f3ad80ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38216/0 (socket says 172.21.15.73:38216) 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ad5e00640 1 -- 172.21.15.73:0/3825006475 learned_addr learned my addr 172.21.15.73:0/3825006475 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ad5400640 1 --2- 172.21.15.73:0/3825006475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad80cd1b0 0x7f3ad8166250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ad5e00640 1 -- 172.21.15.73:0/3825006475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad80cd1b0 msgr2=0x7f3ad8166250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ad5e00640 1 --2- 172.21.15.73:0/3825006475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad80cd1b0 0x7f3ad8166250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ad5e00640 1 -- 172.21.15.73:0/3825006475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad815c6d0 msgr2=0x7f3ad80b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:11.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ad5e00640 1 --2- 172.21.15.73:0/3825006475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad815c6d0 0x7f3ad80b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:11.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ad5e00640 1 -- 172.21.15.73:0/3825006475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad8166aa0 con 0x7f3ad809b170 2024-04-15T15:31:11.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ad5e00640 1 --2- 172.21.15.73:0/3825006475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad809b170 0x7f3ad80ca130 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ac801a120 tx=0x7f3ac8019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:11.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ace000640 1 -- 172.21.15.73:0/3825006475 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8003de0 con 0x7f3ad809b170 2024-04-15T15:31:11.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ace000640 1 -- 172.21.15.73:0/3825006475 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac80059a0 con 0x7f3ad809b170 2024-04-15T15:31:11.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3adce00640 1 -- 172.21.15.73:0/3825006475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad8166d80 con 0x7f3ad809b170 2024-04-15T15:31:11.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3ace000640 1 -- 172.21.15.73:0/3825006475 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8005d90 con 0x7f3ad809b170 2024-04-15T15:31:11.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.130+0000 7f3adce00640 1 -- 172.21.15.73:0/3825006475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad8167340 con 0x7f3ad809b170 2024-04-15T15:31:11.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.134+0000 7f3ace000640 1 -- 172.21.15.73:0/3825006475 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3ac80062c0 con 0x7f3ad809b170 2024-04-15T15:31:11.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.134+0000 7f3ace000640 1 -- 172.21.15.73:0/3825006475 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f3ac80bcb10 con 0x7f3ad809b170 2024-04-15T15:31:11.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.134+0000 7f3adce00640 1 -- 172.21.15.73:0/3825006475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad8068ab0 con 0x7f3ad809b170 2024-04-15T15:31:11.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.134+0000 7f3ace000640 1 -- 172.21.15.73:0/3825006475 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3ac80b8070 con 0x7f3ad809b170 2024-04-15T15:31:11.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.190+0000 7f3adce00640 1 -- 172.21.15.73:0/3825006475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ad80b4d80 con 0x7f3ad809b170 2024-04-15T15:31:11.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.194+0000 7f3ace000640 1 -- 172.21.15.73:0/3825006475 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f3ac8016110 con 0x7f3ad809b170 2024-04-15T15:31:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:11.194 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:10.867993+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:11.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.194+0000 7f3adce00640 1 -- 172.21.15.73:0/3825006475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad809b170 msgr2=0x7f3ad80ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:11.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.194+0000 7f3adce00640 1 --2- 172.21.15.73:0/3825006475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad809b170 0x7f3ad80ca130 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ac801a120 tx=0x7f3ac8019290 comp rx=0 tx=0).stop 2024-04-15T15:31:11.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.194+0000 7f3adce00640 1 -- 172.21.15.73:0/3825006475 shutdown_connections 2024-04-15T15:31:11.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.194+0000 7f3adce00640 1 --2- 172.21.15.73:0/3825006475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad815c6d0 0x7f3ad80b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:11.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.194+0000 7f3adce00640 1 --2- 172.21.15.73:0/3825006475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad80cd1b0 0x7f3ad8166250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:11.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.194+0000 7f3adce00640 1 --2- 172.21.15.73:0/3825006475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ad809b170 0x7f3ad80ca130 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.194+0000 7f3adce00640 1 -- 172.21.15.73:0/3825006475 >> 172.21.15.73:0/3825006475 conn(0x7f3ad80b3fe0 msgr2=0x7f3ad80b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.194+0000 7f3adce00640 1 -- 172.21.15.73:0/3825006475 shutdown_connections 2024-04-15T15:31:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:11.194+0000 7f3adce00640 1 -- 172.21.15.73:0/3825006475 wait complete. 2024-04-15T15:31:11.216 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-15T15:31:11.216 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-15T15:31:11.267 INFO:tasks.ceph.mgr.y.smithi073.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-15T15:31:11.267 INFO:tasks.ceph.mgr.y.smithi073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-15T15:31:11.267 INFO:tasks.ceph.mgr.y.smithi073.stderr: from numpy import show_config as show_numpy_config 2024-04-15T15:31:11.311 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:11.310+0000 7fa4a7248180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-15T15:31:11.418 INFO:tasks.ceph.mgr.x.smithi118.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-15T15:31:11.418 INFO:tasks.ceph.mgr.x.smithi118.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-15T15:31:11.419 INFO:tasks.ceph.mgr.x.smithi118.stderr: from numpy import show_config as show_numpy_config 2024-04-15T15:31:11.460 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:11.458+0000 7fa4a7248180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-15T15:31:11.469 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:11.466+0000 7f02cf918180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-15T15:31:11.572 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-04-15T15:31:11.570+0000 7f7810b437c0 -1 Falling back to public interface 2024-04-15T15:31:11.584 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-04-15T15:31:11.582+0000 7f56fafef7c0 -1 Falling back to public interface 2024-04-15T15:31:11.584 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-04-15T15:31:11.582+0000 7f856a3d37c0 -1 Falling back to public interface 2024-04-15T15:31:11.590 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-04-15T15:31:11.590+0000 7fc87e2127c0 -1 Falling back to public interface 2024-04-15T15:31:11.592 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-04-15T15:31:11.590+0000 7f698630b7c0 -1 Falling back to public interface 2024-04-15T15:31:11.602 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-04-15T15:31:11.602+0000 7f1ebc0dc7c0 -1 Falling back to public interface 2024-04-15T15:31:11.606 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-04-15T15:31:11.606+0000 7fd17ef207c0 -1 Falling back to public interface 2024-04-15T15:31:11.625 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:11.622+0000 7f02cf918180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-15T15:31:11.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-04-15T15:31:11.638+0000 7f4f3daaf7c0 -1 Falling back to public interface 2024-04-15T15:31:11.647 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:11.646+0000 7fa4a7248180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-15T15:31:11.722 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:11.722+0000 7fa4a7248180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-15T15:31:11.804 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:11.802+0000 7f02cf918180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-15T15:31:11.872 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:11.870+0000 7fa4a7248180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-15T15:31:11.878 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:11.874+0000 7f02cf918180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-15T15:31:12.021 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:12.029 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:12.026+0000 7f02cf918180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-15T15:31:12.147 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e19000640 1 Processor -- start 2024-04-15T15:31:12.147 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e19000640 1 -- start start 2024-04-15T15:31:12.148 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e19000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6e14070550 0x7f6e1406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:12.149 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e19000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6e140711a0 0x7f6e14070930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:12.149 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e19000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e1406d5a0 con 0x7f6e1415eb50 2024-04-15T15:31:12.149 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e19000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6e140b1e30 con 0x7f6e14070550 2024-04-15T15:31:12.149 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e19000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f6e14160500 con 0x7f6e140711a0 2024-04-15T15:31:12.149 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e11e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6e14070550 0x7f6e1406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:12.149 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e11e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6e14070550 0x7f6e1406d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38220/0 (socket says 172.21.15.73:38220) 2024-04-15T15:31:12.149 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e11e00640 1 -- 172.21.15.73:0/3812261945 learned_addr learned my addr 172.21.15.73:0/3812261945 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:12.149 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e11400640 1 --2- 172.21.15.73:0/3812261945 >> v2:172.21.15.118:3300/0 conn(0x7f6e140711a0 0x7f6e14070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:12.150 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e11e00640 1 -- 172.21.15.73:0/3812261945 >> v2:172.21.15.118:3300/0 conn(0x7f6e140711a0 msgr2=0x7f6e14070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:12.150 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e11e00640 1 --2- 172.21.15.73:0/3812261945 >> v2:172.21.15.118:3300/0 conn(0x7f6e140711a0 0x7f6e14070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:12.150 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e11e00640 1 -- 172.21.15.73:0/3812261945 >> v1:172.21.15.73:6789/0 conn(0x7f6e1415eb50 legacy=0x7f6e1415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:12.150 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.146+0000 7f6e11e00640 1 -- 172.21.15.73:0/3812261945 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e14070e70 con 0x7f6e14070550 2024-04-15T15:31:12.155 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e11e00640 1 --2- 172.21.15.73:0/3812261945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e14070550 0x7f6e1406d060 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6e1406f510 tx=0x7f6e0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f544db5324ab9f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:12.155 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e10a00640 1 -- 172.21.15.73:0/3812261945 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e040ab610 con 0x7f6e14070550 2024-04-15T15:31:12.156 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e10a00640 1 -- 172.21.15.73:0/3812261945 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040b0070 con 0x7f6e14070550 2024-04-15T15:31:12.156 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e10a00640 1 -- 172.21.15.73:0/3812261945 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e040ab9d0 con 0x7f6e14070550 2024-04-15T15:31:12.156 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e19000640 1 -- 172.21.15.73:0/3812261945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e14070550 msgr2=0x7f6e1406d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:12.156 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e19000640 1 --2- 172.21.15.73:0/3812261945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e14070550 0x7f6e1406d060 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6e1406f510 tx=0x7f6e0401c520 comp rx=0 tx=0).stop 2024-04-15T15:31:12.156 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e19000640 1 -- 172.21.15.73:0/3812261945 shutdown_connections 2024-04-15T15:31:12.156 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e19000640 1 --2- 172.21.15.73:0/3812261945 >> v2:172.21.15.118:3300/0 conn(0x7f6e140711a0 0x7f6e14070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:12.156 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e19000640 1 --2- 172.21.15.73:0/3812261945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e14070550 0x7f6e1406d060 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:12.157 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e19000640 1 -- 172.21.15.73:0/3812261945 >> 172.21.15.73:0/3812261945 conn(0x7f6e14071800 msgr2=0x7f6e14071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:12.157 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e19000640 1 -- 172.21.15.73:0/3812261945 shutdown_connections 2024-04-15T15:31:12.157 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e19000640 1 -- 172.21.15.73:0/3812261945 wait complete. 2024-04-15T15:31:12.160 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e19000640 1 Processor -- start 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.154+0000 7f6e19000640 1 -- start start 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e19000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e14070550 0x7f6e140ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e19000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e140711a0 0x7f6e140cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e19000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e1415eb50 0x7f6e140b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e19000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1416b630 con 0x7f6e140711a0 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e19000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1416b4b0 con 0x7f6e14070550 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e19000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1416b7b0 con 0x7f6e1415eb50 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e11400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e140711a0 0x7f6e140cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e11400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e140711a0 0x7f6e140cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38226/0 (socket says 172.21.15.73:38226) 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e11400640 1 -- 172.21.15.73:0/4245087864 learned_addr learned my addr 172.21.15.73:0/4245087864 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:12.161 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e12800640 1 --2- 172.21.15.73:0/4245087864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e1415eb50 0x7f6e140b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e11e00640 1 --2- 172.21.15.73:0/4245087864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e14070550 0x7f6e140ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e11400640 1 -- 172.21.15.73:0/4245087864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e1415eb50 msgr2=0x7f6e140b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e11400640 1 --2- 172.21.15.73:0/4245087864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e1415eb50 0x7f6e140b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e11400640 1 -- 172.21.15.73:0/4245087864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e14070550 msgr2=0x7f6e140ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e11400640 1 --2- 172.21.15.73:0/4245087864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e14070550 0x7f6e140ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e11400640 1 -- 172.21.15.73:0/4245087864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e140cf3e0 con 0x7f6e140711a0 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e11400640 1 --2- 172.21.15.73:0/4245087864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e140711a0 0x7f6e140cc060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000e960 tx=0x7f6e0000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e0a000640 1 -- 172.21.15.73:0/4245087864 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00017070 con 0x7f6e140711a0 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e0a000640 1 -- 172.21.15.73:0/4245087864 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0000ca00 con 0x7f6e140711a0 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e19000640 1 -- 172.21.15.73:0/4245087864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e140cf6c0 con 0x7f6e140711a0 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e0a000640 1 -- 172.21.15.73:0/4245087864 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000cdb0 con 0x7f6e140711a0 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e19000640 1 -- 172.21.15.73:0/4245087864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e140cfc80 con 0x7f6e140711a0 2024-04-15T15:31:12.162 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e0a000640 1 -- 172.21.15.73:0/4245087864 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6e0001a070 con 0x7f6e140711a0 2024-04-15T15:31:12.163 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e0a000640 1 -- 172.21.15.73:0/4245087864 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6e0001cb70 con 0x7f6e140711a0 2024-04-15T15:31:12.163 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.158+0000 7f6e19000640 1 -- 172.21.15.73:0/4245087864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e14075d00 con 0x7f6e140711a0 2024-04-15T15:31:12.163 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.162+0000 7f6e0a000640 1 -- 172.21.15.73:0/4245087864 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6e0001c4a0 con 0x7f6e140711a0 2024-04-15T15:31:12.220 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.218+0000 7f6e19000640 1 -- 172.21.15.73:0/4245087864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e140b1c10 con 0x7f6e140711a0 2024-04-15T15:31:12.220 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.218+0000 7f6e0a000640 1 -- 172.21.15.73:0/4245087864 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6e0001c680 con 0x7f6e140711a0 2024-04-15T15:31:12.221 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-15T15:31:12.221 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:10.867993+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:12.222 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.222+0000 7f6e19000640 1 -- 172.21.15.73:0/4245087864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e140711a0 msgr2=0x7f6e140cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:12.222 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.222+0000 7f6e19000640 1 --2- 172.21.15.73:0/4245087864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e140711a0 0x7f6e140cc060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000e960 tx=0x7f6e0000ee20 comp rx=0 tx=0).stop 2024-04-15T15:31:12.222 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.222+0000 7f6e19000640 1 -- 172.21.15.73:0/4245087864 shutdown_connections 2024-04-15T15:31:12.222 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.222+0000 7f6e19000640 1 --2- 172.21.15.73:0/4245087864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e1415eb50 0x7f6e140b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:12.222 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.222+0000 7f6e19000640 1 --2- 172.21.15.73:0/4245087864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e140711a0 0x7f6e140cc060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:12.222 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.222+0000 7f6e19000640 1 --2- 172.21.15.73:0/4245087864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e14070550 0x7f6e140ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:12.222 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.222+0000 7f6e19000640 1 -- 172.21.15.73:0/4245087864 >> 172.21.15.73:0/4245087864 conn(0x7f6e14071800 msgr2=0x7f6e1415d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:12.222 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.222+0000 7f6e19000640 1 -- 172.21.15.73:0/4245087864 shutdown_connections 2024-04-15T15:31:12.222 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:12.222+0000 7f6e19000640 1 -- 172.21.15.73:0/4245087864 wait complete. 2024-04-15T15:31:12.238 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-15T15:31:12.568 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:12.566+0000 7fa4a7248180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-15T15:31:12.654 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:12.654+0000 7fa4a7248180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-15T15:31:12.734 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:12.726+0000 7f02cf918180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-15T15:31:12.819 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:12.814+0000 7f02cf918180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-15T15:31:12.857 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:12.854+0000 7fa4a7248180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-15T15:31:12.942 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:12.942+0000 7fa4a7248180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-15T15:31:13.022 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:13.018+0000 7f02cf918180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-15T15:31:13.108 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:13.106+0000 7f02cf918180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-15T15:31:13.270 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:13.270+0000 7fa4a7248180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-15T15:31:13.340 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:13.338+0000 7fa4a7248180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-15T15:31:13.445 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:13.442+0000 7f02cf918180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-15T15:31:13.517 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-04-15T15:31:13.514+0000 7f02cf918180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-15T15:31:14.374 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:14.374+0000 7fa44c800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-15T15:31:14.374 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:31:14.374+0000 7fa44c800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-15T15:31:15.385 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-04-15T15:31:15.382+0000 7f7810b437c0 -1 osd.5 0 log_to_monitors true 2024-04-15T15:31:15.477 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-04-15T15:31:15.478+0000 7f1ebc0dc7c0 -1 osd.3 0 log_to_monitors true 2024-04-15T15:31:15.516 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-04-15T15:31:15.514+0000 7fc87e2127c0 -1 osd.0 0 log_to_monitors true 2024-04-15T15:31:15.529 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-04-15T15:31:15.526+0000 7f56fafef7c0 -1 osd.6 0 log_to_monitors true 2024-04-15T15:31:15.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-04-15T15:31:15.538+0000 7f4f3daaf7c0 -1 osd.1 0 log_to_monitors true 2024-04-15T15:31:15.564 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-04-15T15:31:15.562+0000 7f856a3d37c0 -1 osd.4 0 log_to_monitors true 2024-04-15T15:31:15.621 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-04-15T15:31:15.618+0000 7fd17ef207c0 -1 osd.2 0 log_to_monitors true 2024-04-15T15:31:15.638 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-04-15T15:31:15.634+0000 7f698630b7c0 -1 osd.7 0 log_to_monitors true 2024-04-15T15:31:19.039 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-04-15T15:31:19.034+0000 7f8565200640 -1 osd.4 0 waiting for initial osdmap 2024-04-15T15:31:19.043 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:19.071 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-04-15T15:31:19.066+0000 7f56f5e00640 -1 osd.6 0 waiting for initial osdmap 2024-04-15T15:31:19.078 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-04-15T15:31:19.074+0000 7f780ba00640 -1 osd.5 0 waiting for initial osdmap 2024-04-15T15:31:19.084 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-04-15T15:31:19.082+0000 7f6981c00640 -1 osd.7 0 waiting for initial osdmap 2024-04-15T15:31:19.084 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-04-15T15:31:19.082+0000 7f855b200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T15:31:19.101 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-04-15T15:31:19.098+0000 7f56ebe00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T15:31:19.108 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-04-15T15:31:19.106+0000 7f7801a00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T15:31:19.109 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-04-15T15:31:19.106+0000 7f6977200640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T15:31:19.247 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.246+0000 7fb20be00640 1 Processor -- start 2024-04-15T15:31:19.247 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.246+0000 7fb20be00640 1 -- start start 2024-04-15T15:31:19.249 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.246+0000 7fb20be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb204033e40 0x7fb2040eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:19.249 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.246+0000 7fb20be00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb204034220 con 0x7fb204047c20 2024-04-15T15:31:19.249 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.246+0000 7fb20be00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb20404fa30 con 0x7fb204005ea0 2024-04-15T15:31:19.249 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.246+0000 7fb20be00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb204050210 con 0x7fb204033e40 2024-04-15T15:31:19.250 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.246+0000 7fb20a000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb204047c20 0x7fb2040eb6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36304/0 (socket says 172.21.15.73:36304) 2024-04-15T15:31:19.250 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb20a000640 1 -- 172.21.15.73:0/1740128365 learned_addr learned my addr 172.21.15.73:0/1740128365 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:19.250 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb20aa00640 1 --2- 172.21.15.73:0/1740128365 >> v2:172.21.15.73:3300/0 conn(0x7fb204033e40 0x7fb2040eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:19.251 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989612298 0 0) 0x7fb20404fa30 con 0x7fb204005ea0 2024-04-15T15:31:19.251 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f0003530 con 0x7fb204005ea0 2024-04-15T15:31:19.251 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577021255 0 0) 0x7fb204034220 con 0x7fb204047c20 2024-04-15T15:31:19.252 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb20404fa30 con 0x7fb204047c20 2024-04-15T15:31:19.252 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1921338349 0 0) 0x7fb1f0003530 con 0x7fb204005ea0 2024-04-15T15:31:19.252 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 >> v2:172.21.15.73:3300/0 conn(0x7fb204033e40 msgr2=0x7fb2040eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:19.252 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 --2- 172.21.15.73:0/1740128365 >> v2:172.21.15.73:3300/0 conn(0x7fb204033e40 0x7fb2040eb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:19.253 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 >> v1:172.21.15.73:6789/0 conn(0x7fb204047c20 legacy=0x7fb2040eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:19.253 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20404f2e0 con 0x7fb204005ea0 2024-04-15T15:31:19.253 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7fb20c0505b0 con 0x7fb204005ea0 2024-04-15T15:31:19.253 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 >> v1:172.21.15.118:6789/0 conn(0x7fb204005ea0 legacy=0x7fb2040062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:19.253 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 0x7fb1f0004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:19.253 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f00037b0 0x7fb1f0003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:19.253 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f0004170 0x7fb1f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:19.254 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb204050210 con 0x7fb1f0004bb0 2024-04-15T15:31:19.254 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f000bf10 con 0x7fb1f00037b0 2024-04-15T15:31:19.254 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f000c0c0 con 0x7fb1f0004170 2024-04-15T15:31:19.254 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb20aa00640 1 --2- 172.21.15.73:0/1740128365 >> v2:172.21.15.73:3300/0 conn(0x7fb204033e40 0x7fb2040eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:19.254 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb20aa00640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 0x7fb1f0004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:19.255 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb20a000640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f00037b0 0x7fb1f0003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:19.255 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.250+0000 7fb20b400640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f0004170 0x7fb1f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:19.255 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.254+0000 7fb20aa00640 1 -- 172.21.15.73:0/1740128365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f0004170 msgr2=0x7fb1f000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:19.255 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.254+0000 7fb20aa00640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f0004170 0x7fb1f000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:19.255 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.254+0000 7fb20aa00640 1 -- 172.21.15.73:0/1740128365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f00037b0 msgr2=0x7fb1f0003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:19.255 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.254+0000 7fb20aa00640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f00037b0 0x7fb1f0003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:19.255 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.254+0000 7fb20aa00640 1 -- 172.21.15.73:0/1740128365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f0003530 con 0x7fb1f0004bb0 2024-04-15T15:31:19.255 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.254+0000 7fb20b400640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1f0004170 0x7fb1f000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:19.256 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.254+0000 7fb20b400640 1 -- 172.21.15.73:0/1740128365 reap_dead start 2024-04-15T15:31:19.256 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.254+0000 7fb20a000640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1f00037b0 0x7fb1f0003c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:19.257 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.258+0000 7fb20aa00640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 0x7fb1f0004fb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009c90 tx=0x7fb1fc01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ec268319fb94bc server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:19.258 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.258+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc009860 con 0x7fb1f0004bb0 2024-04-15T15:31:19.258 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.258+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1fc004020 con 0x7fb1f0004bb0 2024-04-15T15:31:19.258 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.258+0000 7fb209600640 1 -- 172.21.15.73:0/1740128365 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc004490 con 0x7fb1f0004bb0 2024-04-15T15:31:19.259 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.258+0000 7fb20be00640 1 -- 172.21.15.73:0/1740128365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 msgr2=0x7fb1f0004fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:19.259 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.258+0000 7fb20be00640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 0x7fb1f0004fb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009c90 tx=0x7fb1fc01cb90 comp rx=0 tx=0).stop 2024-04-15T15:31:19.262 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.262+0000 7fb20be00640 1 -- 172.21.15.73:0/1740128365 shutdown_connections 2024-04-15T15:31:19.262 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.262+0000 7fb20be00640 1 --2- 172.21.15.73:0/1740128365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 0x7fb1f0004fb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:19.262 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.262+0000 7fb20be00640 1 -- 172.21.15.73:0/1740128365 >> 172.21.15.73:0/1740128365 conn(0x7fb204009fc0 msgr2=0x7fb20400a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:19.262 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.262+0000 7fb20be00640 1 -- 172.21.15.73:0/1740128365 shutdown_connections 2024-04-15T15:31:19.262 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.262+0000 7fb20be00640 1 -- 172.21.15.73:0/1740128365 wait complete. 2024-04-15T15:31:19.265 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.262+0000 7fb20be00640 1 Processor -- start 2024-04-15T15:31:19.265 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20be00640 1 -- start start 2024-04-15T15:31:19.267 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 0x7fb2040d8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:19.267 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb20404c5b0 0x7fb20404e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:19.267 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2040e9360 0x7fb2040e9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:19.268 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20be00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb20404f090 con 0x7fb1f0004bb0 2024-04-15T15:31:19.268 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb20404fd80 con 0x7fb20404c5b0 2024-04-15T15:31:19.268 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20be00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb2040482c0 con 0x7fb2040e9360 2024-04-15T15:31:19.268 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20b400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2040e9360 0x7fb2040e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:19.268 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20b400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2040e9360 0x7fb2040e9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:60460/0 (socket says 172.21.15.73:60460) 2024-04-15T15:31:19.268 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20b400640 1 -- 172.21.15.73:0/2353842840 learned_addr learned my addr 172.21.15.73:0/2353842840 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:19.268 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20a000640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb20404c5b0 0x7fb20404e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:19.269 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20aa00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 0x7fb2040d8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:19.270 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20b400640 1 -- 172.21.15.73:0/2353842840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb20404c5b0 msgr2=0x7fb20404e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:19.270 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20b400640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb20404c5b0 0x7fb20404e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:19.270 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20b400640 1 -- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 msgr2=0x7fb2040d8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:19.270 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20b400640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 0x7fb2040d8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:19.270 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20b400640 1 -- 172.21.15.73:0/2353842840 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2040d94e0 con 0x7fb2040e9360 2024-04-15T15:31:19.270 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20aa00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 0x7fb2040d8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:19.271 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.266+0000 7fb20b400640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2040e9360 0x7fb2040e9810 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb20c050bb0 tx=0x7fb20c068e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:19.271 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.270+0000 7fb202a00640 1 -- 172.21.15.73:0/2353842840 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c098070 con 0x7fb2040e9360 2024-04-15T15:31:19.271 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.270+0000 7fb202a00640 1 -- 172.21.15.73:0/2353842840 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20c074530 con 0x7fb2040e9360 2024-04-15T15:31:19.271 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.270+0000 7fb20be00640 1 -- 172.21.15.73:0/2353842840 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20404cb20 con 0x7fb2040e9360 2024-04-15T15:31:19.271 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.270+0000 7fb202a00640 1 -- 172.21.15.73:0/2353842840 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0746e0 con 0x7fb2040e9360 2024-04-15T15:31:19.271 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.270+0000 7fb20be00640 1 -- 172.21.15.73:0/2353842840 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20404d0e0 con 0x7fb2040e9360 2024-04-15T15:31:19.272 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.270+0000 7fb20be00640 1 -- 172.21.15.73:0/2353842840 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2040053a0 con 0x7fb2040e9360 2024-04-15T15:31:19.274 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.274+0000 7fb202a00640 1 -- 172.21.15.73:0/2353842840 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fb20c09b070 con 0x7fb2040e9360 2024-04-15T15:31:19.275 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.274+0000 7fb202a00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1e80683f0 0x7fb1e806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:19.275 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.274+0000 7fb202a00640 1 -- 172.21.15.73:0/2353842840 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fb20c101580 con 0x7fb2040e9360 2024-04-15T15:31:19.276 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.274+0000 7fb20aa00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1e80683f0 0x7fb1e806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:19.278 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.278+0000 7fb20aa00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1e80683f0 0x7fb1e806a8b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0ae000 tx=0x7fb1fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:19.278 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.278+0000 7fb202a00640 1 -- 172.21.15.73:0/2353842840 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb20c0d23d0 con 0x7fb2040e9360 2024-04-15T15:31:19.608 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.606+0000 7fb20be00640 1 -- 172.21.15.73:0/2353842840 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb204052830 con 0x7fb2040e9360 2024-04-15T15:31:19.609 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.610+0000 7fb202a00640 1 -- 172.21.15.73:0/2353842840 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fb20c0d66d0 con 0x7fb2040e9360 2024-04-15T15:31:19.609 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-15T15:31:19.613 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":12,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:17.377068+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:19.622 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 -- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1e80683f0 msgr2=0x7fb1e806a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:19.622 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1e80683f0 0x7fb1e806a8b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0ae000 tx=0x7fb1fc008040 comp rx=0 tx=0).stop 2024-04-15T15:31:19.622 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 -- 172.21.15.73:0/2353842840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2040e9360 msgr2=0x7fb2040e9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:19.622 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2040e9360 0x7fb2040e9810 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb20c050bb0 tx=0x7fb20c068e70 comp rx=0 tx=0).stop 2024-04-15T15:31:19.623 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 -- 172.21.15.73:0/2353842840 shutdown_connections 2024-04-15T15:31:19.623 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1e80683f0 0x7fb1e806a8b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:19.623 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2040e9360 0x7fb2040e9810 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:19.623 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb20404c5b0 0x7fb20404e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:19.623 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 --2- 172.21.15.73:0/2353842840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f0004bb0 0x7fb2040d8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:19.623 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 -- 172.21.15.73:0/2353842840 >> 172.21.15.73:0/2353842840 conn(0x7fb204009fc0 msgr2=0x7fb204054210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:19.624 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 -- 172.21.15.73:0/2353842840 shutdown_connections 2024-04-15T15:31:19.624 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:19.622+0000 7fb20be00640 1 -- 172.21.15.73:0/2353842840 wait complete. 2024-04-15T15:31:19.656 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-15T15:31:19.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-04-15T15:31:19.734+0000 7f4f38a00640 -1 osd.1 0 waiting for initial osdmap 2024-04-15T15:31:19.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-04-15T15:31:19.774+0000 7f4f2ea00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T15:31:19.829 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-04-15T15:31:19.826+0000 7fd179e00640 -1 osd.2 0 waiting for initial osdmap 2024-04-15T15:31:19.851 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-04-15T15:31:19.850+0000 7fd16fe00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T15:31:19.871 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-04-15T15:31:19.870+0000 7fc879000640 -1 osd.0 0 waiting for initial osdmap 2024-04-15T15:31:19.881 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-04-15T15:31:19.878+0000 7f1eb7000640 -1 osd.3 0 waiting for initial osdmap 2024-04-15T15:31:19.898 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-04-15T15:31:19.898+0000 7fc86f000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T15:31:19.914 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-04-15T15:31:19.914+0000 7f1ead000640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T15:31:26.462 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:26.593 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.590+0000 7fa3cbe00640 1 Processor -- start 2024-04-15T15:31:26.593 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3cbe00640 1 -- start start 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3cbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa3c40cb0f0 0x7fa3c40ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3cbe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa3c40cb4d0 0x7fa3c40cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3cbe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c415f1c0 con 0x7fa3c415bd20 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3cbe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c40cd6a0 con 0x7fa3c40cb0f0 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3cbe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c415ca50 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3c9400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa3c40cb0f0 0x7fa3c40ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3c9400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa3c40cb0f0 0x7fa3c40ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43494/0 (socket says 172.21.15.73:43494) 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3c9400640 1 -- 172.21.15.73:0/2204598492 learned_addr learned my addr 172.21.15.73:0/2204598492 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3c8a00640 1 --2- 172.21.15.73:0/2204598492 >> v2:172.21.15.118:3300/0 conn(0x7fa3c40cb4d0 0x7fa3c40cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3c9400640 1 -- 172.21.15.73:0/2204598492 >> v2:172.21.15.118:3300/0 conn(0x7fa3c40cb4d0 msgr2=0x7fa3c40cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3c9400640 1 --2- 172.21.15.73:0/2204598492 >> v2:172.21.15.118:3300/0 conn(0x7fa3c40cb4d0 0x7fa3c40cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.595 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3c9400640 1 -- 172.21.15.73:0/2204598492 >> v1:172.21.15.118:6789/0 conn(0x7fa3c415bd20 legacy=0x7fa3c415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:26.596 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.594+0000 7fa3c9400640 1 -- 172.21.15.73:0/2204598492 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c415f460 con 0x7fa3c40cb0f0 2024-04-15T15:31:26.598 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3c9400640 1 --2- 172.21.15.73:0/2204598492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c40cb0f0 0x7fa3c40ccc20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40cdea0 tx=0x7fa3b801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244d3ad1836cdd98 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:26.598 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3c3e00640 1 -- 172.21.15.73:0/2204598492 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80ab600 con 0x7fa3c40cb0f0 2024-04-15T15:31:26.598 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3c3e00640 1 -- 172.21.15.73:0/2204598492 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b80b0070 con 0x7fa3c40cb0f0 2024-04-15T15:31:26.598 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3c3e00640 1 -- 172.21.15.73:0/2204598492 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80ab9c0 con 0x7fa3c40cb0f0 2024-04-15T15:31:26.599 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3cbe00640 1 -- 172.21.15.73:0/2204598492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c40cb0f0 msgr2=0x7fa3c40ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:26.599 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3cbe00640 1 --2- 172.21.15.73:0/2204598492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c40cb0f0 0x7fa3c40ccc20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40cdea0 tx=0x7fa3b801c400 comp rx=0 tx=0).stop 2024-04-15T15:31:26.599 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3cbe00640 1 -- 172.21.15.73:0/2204598492 shutdown_connections 2024-04-15T15:31:26.599 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3cbe00640 1 --2- 172.21.15.73:0/2204598492 >> v2:172.21.15.118:3300/0 conn(0x7fa3c40cb4d0 0x7fa3c40cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.599 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3cbe00640 1 --2- 172.21.15.73:0/2204598492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c40cb0f0 0x7fa3c40ccc20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.599 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3cbe00640 1 -- 172.21.15.73:0/2204598492 >> 172.21.15.73:0/2204598492 conn(0x7fa3c40b1ed0 msgr2=0x7fa3c40b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:26.599 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3cbe00640 1 -- 172.21.15.73:0/2204598492 shutdown_connections 2024-04-15T15:31:26.599 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3cbe00640 1 -- 172.21.15.73:0/2204598492 wait complete. 2024-04-15T15:31:26.600 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3cbe00640 1 Processor -- start 2024-04-15T15:31:26.600 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.598+0000 7fa3cbe00640 1 -- start start 2024-04-15T15:31:26.601 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3cbe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3c40cb0f0 0x7fa3c4157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.601 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3cbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c40cb4d0 0x7fa3c415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.601 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3cbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3c415bd20 0x7fa3c406e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.601 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3cbe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4159150 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.601 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3cbe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4160150 con 0x7fa3c415bd20 2024-04-15T15:31:26.601 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3cbe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c41592d0 con 0x7fa3c40cb0f0 2024-04-15T15:31:26.603 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3c415bd20 0x7fa3c406e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.603 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c9400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3c40cb0f0 0x7fa3c4157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.603 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3c415bd20 0x7fa3c406e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:56564/0 (socket says 172.21.15.73:56564) 2024-04-15T15:31:26.603 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c9e00640 1 -- 172.21.15.73:0/3369631912 learned_addr learned my addr 172.21.15.73:0/3369631912 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:26.603 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c8a00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c40cb4d0 0x7fa3c415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c8a00640 1 -- 172.21.15.73:0/3369631912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3c40cb0f0 msgr2=0x7fa3c4157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c8a00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3c40cb0f0 0x7fa3c4157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c8a00640 1 -- 172.21.15.73:0/3369631912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3c415bd20 msgr2=0x7fa3c406e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c8a00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3c415bd20 0x7fa3c406e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c8a00640 1 -- 172.21.15.73:0/3369631912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c4156f40 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c9400640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3c40cb0f0 0x7fa3c4157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c9e00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3c415bd20 0x7fa3c406e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c8a00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c40cb4d0 0x7fa3c415e6e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400d5f0 tx=0x7fa3b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c1600640 1 -- 172.21.15.73:0/3369631912 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40125f0 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c1600640 1 -- 172.21.15.73:0/3369631912 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b4019070 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c1600640 1 -- 172.21.15.73:0/3369631912 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40129b0 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3cbe00640 1 -- 172.21.15.73:0/3369631912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c406ec30 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.604 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3cbe00640 1 -- 172.21.15.73:0/3369631912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c41574c0 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.605 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3cbe00640 1 -- 172.21.15.73:0/3369631912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c4075d00 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.605 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.602+0000 7fa3c1600640 1 -- 172.21.15.73:0/3369631912 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa3b4012b50 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.606 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.606+0000 7fa3c1600640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa3a80683b0 0x7fa3a806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.606 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.606+0000 7fa3c1600640 1 -- 172.21.15.73:0/3369631912 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa3b4086900 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.606 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.606+0000 7fa3c9400640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa3a80683b0 0x7fa3a806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.606 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.606+0000 7fa3c9400640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa3a80683b0 0x7fa3a806a870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80af000 tx=0x7fa3b80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:26.611 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.610+0000 7fa3c1600640 1 -- 172.21.15.73:0/3369631912 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa3b4056bc0 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.768 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.766+0000 7fa3cbe00640 1 -- 172.21.15.73:0/3369631912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3c4167340 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.769 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.766+0000 7fa3c1600640 1 -- 172.21.15.73:0/3369631912 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7fa3b405aec0 con 0x7fa3c40cb4d0 2024-04-15T15:31:26.769 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-15T15:31:26.769 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":17,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:24.104849+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 -- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa3a80683b0 msgr2=0x7fa3a806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa3a80683b0 0x7fa3a806a870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80af000 tx=0x7fa3b80a7000 comp rx=0 tx=0).stop 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 -- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c40cb4d0 msgr2=0x7fa3c415e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c40cb4d0 0x7fa3c415e6e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400d5f0 tx=0x7fa3b400dab0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 -- 172.21.15.73:0/3369631912 shutdown_connections 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3c415bd20 0x7fa3c406e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c40cb4d0 0x7fa3c415e6e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa3a80683b0 0x7fa3a806a870 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 --2- 172.21.15.73:0/3369631912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3c40cb0f0 0x7fa3c4157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 -- 172.21.15.73:0/3369631912 >> 172.21.15.73:0/3369631912 conn(0x7fa3c40b1ed0 msgr2=0x7fa3c415a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:26.771 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 -- 172.21.15.73:0/3369631912 shutdown_connections 2024-04-15T15:31:26.772 INFO:teuthology.misc.health.smithi073.stderr:2024-04-15T15:31:26.770+0000 7fa3cbe00640 1 -- 172.21.15.73:0/3369631912 wait complete. 2024-04-15T15:31:26.788 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-15T15:31:26.788 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-15T15:31:26.788 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-15T15:31:26.788 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-15T15:31:26.791 INFO:tasks.ceph.mds.a:Started 2024-04-15T15:31:26.792 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-15T15:31:26.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-15T15:31:26.794 INFO:tasks.ceph.mds.c:Started 2024-04-15T15:31:26.794 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-15T15:31:26.795 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-15T15:31:26.798 INFO:tasks.ceph.mds.b:Started 2024-04-15T15:31:26.798 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-15T15:31:26.798 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-15T15:31:26.801 INFO:tasks.ceph.mds.d:Started 2024-04-15T15:31:26.801 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-15T15:31:26.802 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:26.896 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2024-04-15T15:31:26.897 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2024-04-15T15:31:26.897 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-04-15T15:31:26.898 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-04-15T15:31:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca4ae00640 1 Processor -- start 2024-04-15T15:31:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca4ae00640 1 -- start start 2024-04-15T15:31:26.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca4ae00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b2530 0x7fca4415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca4ae00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca440cd3a0 con 0x7fca44146110 2024-04-15T15:31:26.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca4ae00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca440b29c0 con 0x7fca440b20b0 2024-04-15T15:31:26.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca4ae00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fca440b5160 con 0x7fca440b2530 2024-04-15T15:31:26.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca43e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fca44146110 0x7fca440cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36316/0 (socket says 172.21.15.73:36316) 2024-04-15T15:31:26.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca43e00640 1 -- 172.21.15.73:0/2615047451 learned_addr learned my addr 172.21.15.73:0/2615047451 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca48e00640 1 --2- 172.21.15.73:0/2615047451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b2530 0x7fca4415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca42a00640 1 -- 172.21.15.73:0/2615047451 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523708327 0 0) 0x7fca440cd3a0 con 0x7fca44146110 2024-04-15T15:31:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca42a00640 1 -- 172.21.15.73:0/2615047451 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca28003530 con 0x7fca44146110 2024-04-15T15:31:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca42a00640 1 -- 172.21.15.73:0/2615047451 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125195644 0 0) 0x7fca440b29c0 con 0x7fca440b20b0 2024-04-15T15:31:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca42a00640 1 -- 172.21.15.73:0/2615047451 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca440cd3a0 con 0x7fca440b20b0 2024-04-15T15:31:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca48e00640 1 -- 172.21.15.73:0/2615047451 >> v1:172.21.15.118:6789/0 conn(0x7fca440b20b0 legacy=0x7fca4415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:26.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca48e00640 1 -- 172.21.15.73:0/2615047451 >> v1:172.21.15.73:6789/0 conn(0x7fca44146110 legacy=0x7fca440cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:26.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.946+0000 7fca48e00640 1 -- 172.21.15.73:0/2615047451 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca440b40c0 con 0x7fca440b2530 2024-04-15T15:31:26.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca48e00640 1 --2- 172.21.15.73:0/2615047451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b2530 0x7fca4415d2e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009dc0 tx=0x7fca3c01c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c70d86dd7602ece server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:26.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca42a00640 1 -- 172.21.15.73:0/2615047451 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0b2070 con 0x7fca440b2530 2024-04-15T15:31:26.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca42a00640 1 -- 172.21.15.73:0/2615047451 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3c0a5a20 con 0x7fca440b2530 2024-04-15T15:31:26.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca42a00640 1 -- 172.21.15.73:0/2615047451 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0a5df0 con 0x7fca440b2530 2024-04-15T15:31:26.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca4ae00640 1 -- 172.21.15.73:0/2615047451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b2530 msgr2=0x7fca4415d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:26.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca4ae00640 1 --2- 172.21.15.73:0/2615047451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b2530 0x7fca4415d2e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009dc0 tx=0x7fca3c01c960 comp rx=0 tx=0).stop 2024-04-15T15:31:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca4ae00640 1 -- 172.21.15.73:0/2615047451 shutdown_connections 2024-04-15T15:31:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca4ae00640 1 --2- 172.21.15.73:0/2615047451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b2530 0x7fca4415d2e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca4ae00640 1 -- 172.21.15.73:0/2615047451 >> 172.21.15.73:0/2615047451 conn(0x7fca44067dd0 msgr2=0x7fca440d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca4ae00640 1 -- 172.21.15.73:0/2615047451 shutdown_connections 2024-04-15T15:31:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.950+0000 7fca4ae00640 1 -- 172.21.15.73:0/2615047451 wait complete. 2024-04-15T15:31:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 Processor -- start 2024-04-15T15:31:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 -- start start 2024-04-15T15:31:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b20b0 0x7fca441535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca440b2530 0x7fca44139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca44146110 0x7fca4413cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fca440b3d70 con 0x7fca440b2530 2024-04-15T15:31:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fca440b4c40 con 0x7fca44146110 2024-04-15T15:31:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fca4415dc30 con 0x7fca440b20b0 2024-04-15T15:31:26.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca43400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca440b2530 0x7fca44139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca43400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca440b2530 0x7fca44139290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43546/0 (socket says 172.21.15.73:43546) 2024-04-15T15:31:26.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca43400640 1 -- 172.21.15.73:0/3224101824 learned_addr learned my addr 172.21.15.73:0/3224101824 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:26.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca43e00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b20b0 0x7fca441535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca48e00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca44146110 0x7fca4413cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca43400640 1 -- 172.21.15.73:0/3224101824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b20b0 msgr2=0x7fca441535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:26.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca43400640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b20b0 0x7fca441535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca43400640 1 -- 172.21.15.73:0/3224101824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca44146110 msgr2=0x7fca4413cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca43400640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca44146110 0x7fca4413cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca43400640 1 -- 172.21.15.73:0/3224101824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4413bd90 con 0x7fca440b2530 2024-04-15T15:31:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca43400640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca440b2530 0x7fca44139290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fca3000c430 tx=0x7fca3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca3be00640 1 -- 172.21.15.73:0/3224101824 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30017070 con 0x7fca440b2530 2024-04-15T15:31:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca3be00640 1 -- 172.21.15.73:0/3224101824 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca300052f0 con 0x7fca440b2530 2024-04-15T15:31:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca3be00640 1 -- 172.21.15.73:0/3224101824 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30003840 con 0x7fca440b2530 2024-04-15T15:31:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 -- 172.21.15.73:0/3224101824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca440ccc30 con 0x7fca440b2530 2024-04-15T15:31:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 -- 172.21.15.73:0/3224101824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4413c310 con 0x7fca440b2530 2024-04-15T15:31:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.954+0000 7fca4ae00640 1 -- 172.21.15.73:0/3224101824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca44068ab0 con 0x7fca440b2530 2024-04-15T15:31:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.958+0000 7fca3be00640 1 -- 172.21.15.73:0/3224101824 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fca3001a070 con 0x7fca440b2530 2024-04-15T15:31:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.958+0000 7fca3be00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fca24068380 0x7fca2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.958+0000 7fca3be00640 1 -- 172.21.15.73:0/3224101824 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fca30085950 con 0x7fca440b2530 2024-04-15T15:31:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.958+0000 7fca43e00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fca24068380 0x7fca2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.958+0000 7fca43e00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fca24068380 0x7fca2406a840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca340011f0 tx=0x7fca34007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:26.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:26.962+0000 7fca3be00640 1 -- 172.21.15.73:0/3224101824 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca30055c00 con 0x7fca440b2530 2024-04-15T15:31:27.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.122+0000 7fca4ae00640 1 -- 172.21.15.73:0/3224101824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca441551e0 con 0x7fca440b2530 2024-04-15T15:31:27.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.122+0000 7fca3be00640 1 -- 172.21.15.73:0/3224101824 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7fca30059f00 con 0x7fca440b2530 2024-04-15T15:31:27.123 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:27.124 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:24.104849+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 -- 172.21.15.73:0/3224101824 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fca24068380 msgr2=0x7fca2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fca24068380 0x7fca2406a840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca340011f0 tx=0x7fca34007d40 comp rx=0 tx=0).stop 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 -- 172.21.15.73:0/3224101824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca440b2530 msgr2=0x7fca44139290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca440b2530 0x7fca44139290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fca3000c430 tx=0x7fca3000c8f0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 -- 172.21.15.73:0/3224101824 shutdown_connections 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca44146110 0x7fca4413cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca440b2530 0x7fca44139290 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fca24068380 0x7fca2406a840 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 --2- 172.21.15.73:0/3224101824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca440b20b0 0x7fca441535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 -- 172.21.15.73:0/3224101824 >> 172.21.15.73:0/3224101824 conn(0x7fca44067dd0 msgr2=0x7fca44071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 -- 172.21.15.73:0/3224101824 shutdown_connections 2024-04-15T15:31:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.126+0000 7fca4ae00640 1 -- 172.21.15.73:0/3224101824 wait complete. 2024-04-15T15:31:27.145 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T15:31:27.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:31:27.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.282+0000 7fc269a00640 1 Processor -- start 2024-04-15T15:31:27.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.282+0000 7fc269a00640 1 -- start start 2024-04-15T15:31:27.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.282+0000 7fc269a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26406d170 0x7fc264073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.282+0000 7fc269a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc264070130 0x7fc26406e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.282+0000 7fc269a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2640b4810 con 0x7fc26415e760 2024-04-15T15:31:27.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.282+0000 7fc269a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc2640cd2f0 con 0x7fc264070130 2024-04-15T15:31:27.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.282+0000 7fc269a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc2640b45c0 con 0x7fc26406d170 2024-04-15T15:31:27.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc262a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc26415e760 0x7fc26406ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44714/0 (socket says 172.21.15.73:44714) 2024-04-15T15:31:27.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc262a00640 1 -- 172.21.15.73:0/2867795743 learned_addr learned my addr 172.21.15.73:0/2867795743 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:27.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc25a000640 1 --2- 172.21.15.73:0/2867795743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26406d170 0x7fc264073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc263400640 1 --2- 172.21.15.73:0/2867795743 >> v2:172.21.15.118:3300/0 conn(0x7fc264070130 0x7fc26406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc262000640 1 -- 172.21.15.73:0/2867795743 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 645304282 0 0) 0x7fc2640b4810 con 0x7fc26415e760 2024-04-15T15:31:27.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc262000640 1 -- 172.21.15.73:0/2867795743 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc248003530 con 0x7fc26415e760 2024-04-15T15:31:27.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc25a000640 1 -- 172.21.15.73:0/2867795743 >> v2:172.21.15.118:3300/0 conn(0x7fc264070130 msgr2=0x7fc26406e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:27.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc25a000640 1 --2- 172.21.15.73:0/2867795743 >> v2:172.21.15.118:3300/0 conn(0x7fc264070130 0x7fc26406e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc262000640 1 -- 172.21.15.73:0/2867795743 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3618938283 0 0) 0x7fc248003530 con 0x7fc26415e760 2024-04-15T15:31:27.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc25a000640 1 -- 172.21.15.73:0/2867795743 >> v1:172.21.15.73:6789/0 conn(0x7fc26415e760 legacy=0x7fc26406ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc25a000640 1 -- 172.21.15.73:0/2867795743 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2640b4af0 con 0x7fc26406d170 2024-04-15T15:31:27.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.286+0000 7fc263400640 1 --2- 172.21.15.73:0/2867795743 >> v2:172.21.15.118:3300/0 conn(0x7fc264070130 0x7fc26406e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:27.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc25a000640 1 --2- 172.21.15.73:0/2867795743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26406d170 0x7fc264073480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0097c0 tx=0x7fc24c01c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=867f085761ff43a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:27.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc262000640 1 -- 172.21.15.73:0/2867795743 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0b0070 con 0x7fc26406d170 2024-04-15T15:31:27.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc262000640 1 -- 172.21.15.73:0/2867795743 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24c0ab400 con 0x7fc26406d170 2024-04-15T15:31:27.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc262000640 1 -- 172.21.15.73:0/2867795743 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254001680 con 0x7fc26406d170 2024-04-15T15:31:27.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 -- 172.21.15.73:0/2867795743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26406d170 msgr2=0x7fc264073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 --2- 172.21.15.73:0/2867795743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26406d170 0x7fc264073480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0097c0 tx=0x7fc24c01c300 comp rx=0 tx=0).stop 2024-04-15T15:31:27.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 -- 172.21.15.73:0/2867795743 shutdown_connections 2024-04-15T15:31:27.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 --2- 172.21.15.73:0/2867795743 >> v2:172.21.15.118:3300/0 conn(0x7fc264070130 0x7fc26406e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 --2- 172.21.15.73:0/2867795743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26406d170 0x7fc264073480 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 -- 172.21.15.73:0/2867795743 >> 172.21.15.73:0/2867795743 conn(0x7fc264072590 msgr2=0x7fc264072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:27.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 -- 172.21.15.73:0/2867795743 shutdown_connections 2024-04-15T15:31:27.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 -- 172.21.15.73:0/2867795743 wait complete. 2024-04-15T15:31:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 Processor -- start 2024-04-15T15:31:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 -- start start 2024-04-15T15:31:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26406d170 0x7fc264159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc264070130 0x7fc264158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26415e760 0x7fc2640b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc26406f610 con 0x7fc264070130 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc26406f490 con 0x7fc26406d170 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc269a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc26406f790 con 0x7fc26415e760 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc25a000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc264070130 0x7fc264158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc25a000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc264070130 0x7fc264158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58758/0 (socket says 172.21.15.73:58758) 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc25a000640 1 -- 172.21.15.73:0/2244077197 learned_addr learned my addr 172.21.15.73:0/2244077197 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.290+0000 7fc262a00640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26406d170 0x7fc264159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc263400640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26415e760 0x7fc2640b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25a000640 1 -- 172.21.15.73:0/2244077197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26415e760 msgr2=0x7fc2640b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25a000640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26415e760 0x7fc2640b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25a000640 1 -- 172.21.15.73:0/2244077197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26406d170 msgr2=0x7fc264159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25a000640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26406d170 0x7fc264159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25a000640 1 -- 172.21.15.73:0/2244077197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2640afbc0 con 0x7fc264070130 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25a000640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc264070130 0x7fc264158d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc24c01a9b0 tx=0x7fc24c01ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25b400640 1 -- 172.21.15.73:0/2244077197 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0b0050 con 0x7fc264070130 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25b400640 1 -- 172.21.15.73:0/2244077197 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24c0bc070 con 0x7fc264070130 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25b400640 1 -- 172.21.15.73:0/2244077197 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c006e20 con 0x7fc264070130 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc269a00640 1 -- 172.21.15.73:0/2244077197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2641582a0 con 0x7fc264070130 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc269a00640 1 -- 172.21.15.73:0/2244077197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2640b1dc0 con 0x7fc264070130 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc269a00640 1 -- 172.21.15.73:0/2244077197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc264068ab0 con 0x7fc264070130 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25b400640 1 -- 172.21.15.73:0/2244077197 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc24c0b78b0 con 0x7fc264070130 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25b400640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc240068380 0x7fc24006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.294+0000 7fc25b400640 1 -- 172.21.15.73:0/2244077197 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc24c120bf0 con 0x7fc264070130 2024-04-15T15:31:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.298+0000 7fc262a00640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc240068380 0x7fc24006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.298+0000 7fc262a00640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc240068380 0x7fc24006a840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc2540013d0 tx=0x7fc254001360 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.302+0000 7fc25b400640 1 -- 172.21.15.73:0/2244077197 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc24c015fb0 con 0x7fc264070130 2024-04-15T15:31:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.458+0000 7fc269a00640 1 -- 172.21.15.73:0/2244077197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc26406fbf0 con 0x7fc264070130 2024-04-15T15:31:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.458+0000 7fc25b400640 1 -- 172.21.15.73:0/2244077197 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fc24c0f1580 con 0x7fc264070130 2024-04-15T15:31:27.461 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:31:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 -- 172.21.15.73:0/2244077197 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc240068380 msgr2=0x7fc24006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc240068380 0x7fc24006a840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc2540013d0 tx=0x7fc254001360 comp rx=0 tx=0).stop 2024-04-15T15:31:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 -- 172.21.15.73:0/2244077197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc264070130 msgr2=0x7fc264158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc264070130 0x7fc264158d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc24c01a9b0 tx=0x7fc24c01ab40 comp rx=0 tx=0).stop 2024-04-15T15:31:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 -- 172.21.15.73:0/2244077197 shutdown_connections 2024-04-15T15:31:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc240068380 0x7fc24006a840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc26415e760 0x7fc2640b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc264070130 0x7fc264158d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 --2- 172.21.15.73:0/2244077197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26406d170 0x7fc264159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 -- 172.21.15.73:0/2244077197 >> 172.21.15.73:0/2244077197 conn(0x7fc264072590 msgr2=0x7fc26415a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:27.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 -- 172.21.15.73:0/2244077197 shutdown_connections 2024-04-15T15:31:27.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.462+0000 7fc269a00640 1 -- 172.21.15.73:0/2244077197 wait complete. 2024-04-15T15:31:27.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:31:27.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.614+0000 7f8514400640 1 Processor -- start 2024-04-15T15:31:27.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.614+0000 7f8514400640 1 -- start start 2024-04-15T15:31:27.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.614+0000 7f8514400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f850c0affc0 0x7f850c15c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.614+0000 7f8514400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c06e1f0 0x7f850c0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.614+0000 7f8514400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f850c0b5190 0x7f850c0b5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.614+0000 7f8514400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f850c15cab0 con 0x7f850c0affc0 2024-04-15T15:31:27.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.614+0000 7f8514400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f850c0cec00 con 0x7f850c0b5190 2024-04-15T15:31:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.614+0000 7f8514400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f850c06e680 con 0x7f850c06e1f0 2024-04-15T15:31:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8511a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f850c0affc0 0x7f850c15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8511a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f850c0affc0 0x7f850c15c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58760/0 (socket says 172.21.15.73:58760) 2024-04-15T15:31:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8511a00640 1 -- 172.21.15.73:0/3489048199 learned_addr learned my addr 172.21.15.73:0/3489048199 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8512400640 1 --2- 172.21.15.73:0/3489048199 >> v2:172.21.15.118:3300/0 conn(0x7f850c0b5190 0x7f850c0b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8511000640 1 --2- 172.21.15.73:0/3489048199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c06e1f0 0x7f850c0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8511a00640 1 -- 172.21.15.73:0/3489048199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c06e1f0 msgr2=0x7f850c0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8511a00640 1 --2- 172.21.15.73:0/3489048199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c06e1f0 0x7f850c0ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8511a00640 1 -- 172.21.15.73:0/3489048199 >> v2:172.21.15.118:3300/0 conn(0x7f850c0b5190 msgr2=0x7f850c0b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8511a00640 1 --2- 172.21.15.73:0/3489048199 >> v2:172.21.15.118:3300/0 conn(0x7f850c0b5190 0x7f850c0b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8511a00640 1 -- 172.21.15.73:0/3489048199 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c06e960 con 0x7f850c0affc0 2024-04-15T15:31:27.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f8511a00640 1 --2- 172.21.15.73:0/3489048199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 0x7f850c15c570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f850c0cdc40 tx=0x7f850001ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f631874282acc27 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:27.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f850be00640 1 -- 172.21.15.73:0/3489048199 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85000b4070 con 0x7f850c0affc0 2024-04-15T15:31:27.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f850be00640 1 -- 172.21.15.73:0/3489048199 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85000a7a80 con 0x7f850c0affc0 2024-04-15T15:31:27.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.618+0000 7f850be00640 1 -- 172.21.15.73:0/3489048199 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85000a7e50 con 0x7f850c0affc0 2024-04-15T15:31:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 -- 172.21.15.73:0/3489048199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 msgr2=0x7f850c15c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 --2- 172.21.15.73:0/3489048199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 0x7f850c15c570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f850c0cdc40 tx=0x7f850001ebf0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 -- 172.21.15.73:0/3489048199 shutdown_connections 2024-04-15T15:31:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 --2- 172.21.15.73:0/3489048199 >> v2:172.21.15.118:3300/0 conn(0x7f850c0b5190 0x7f850c0b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 --2- 172.21.15.73:0/3489048199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c06e1f0 0x7f850c0ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 --2- 172.21.15.73:0/3489048199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 0x7f850c15c570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 -- 172.21.15.73:0/3489048199 >> 172.21.15.73:0/3489048199 conn(0x7f850c06ba50 msgr2=0x7f850c06be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:27.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 -- 172.21.15.73:0/3489048199 shutdown_connections 2024-04-15T15:31:27.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 -- 172.21.15.73:0/3489048199 wait complete. 2024-04-15T15:31:27.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 Processor -- start 2024-04-15T15:31:27.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 -- start start 2024-04-15T15:31:27.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 0x7f850c141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f850c0b5190 0x7f850c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c15b0c0 0x7f850c15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f850c0d10b0 con 0x7f850c0affc0 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f850c0d0f30 con 0x7f850c0b5190 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8514400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f850c0d1230 con 0x7f850c15b0c0 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8511a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 0x7f850c141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8511a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 0x7f850c141300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58764/0 (socket says 172.21.15.73:58764) 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8511a00640 1 -- 172.21.15.73:0/483861514 learned_addr learned my addr 172.21.15.73:0/483861514 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8511000640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f850c0b5190 0x7f850c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8512400640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c15b0c0 0x7f850c15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8511a00640 1 -- 172.21.15.73:0/483861514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c15b0c0 msgr2=0x7f850c15dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8511a00640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c15b0c0 0x7f850c15dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8511a00640 1 -- 172.21.15.73:0/483861514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f850c0b5190 msgr2=0x7f850c15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8511a00640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f850c0b5190 0x7f850c15ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8511a00640 1 -- 172.21.15.73:0/483861514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c158a10 con 0x7f850c0affc0 2024-04-15T15:31:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8512400640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c15b0c0 0x7f850c15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.622+0000 7f8511a00640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 0x7f850c141300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f850000b2c0 tx=0x7f850001b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8509600640 1 -- 172.21.15.73:0/483861514 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85000b4030 con 0x7f850c0affc0 2024-04-15T15:31:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8509600640 1 -- 172.21.15.73:0/483861514 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85000b6070 con 0x7f850c0affc0 2024-04-15T15:31:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8509600640 1 -- 172.21.15.73:0/483861514 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85000ad550 con 0x7f850c0affc0 2024-04-15T15:31:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8514400640 1 -- 172.21.15.73:0/483861514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850c15e860 con 0x7f850c0affc0 2024-04-15T15:31:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8514400640 1 -- 172.21.15.73:0/483861514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f850c158fb0 con 0x7f850c0affc0 2024-04-15T15:31:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8514400640 1 -- 172.21.15.73:0/483861514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850c15b4d0 con 0x7f850c0affc0 2024-04-15T15:31:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8509600640 1 -- 172.21.15.73:0/483861514 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f85000c1060 con 0x7f850c0affc0 2024-04-15T15:31:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8509600640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f84ec068380 0x7f84ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8509600640 1 -- 172.21.15.73:0/483861514 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8500120bd0 con 0x7f850c0affc0 2024-04-15T15:31:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8511000640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f84ec068380 0x7f84ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.626+0000 7f8511000640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f84ec068380 0x7f84ec06a840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f850c0ae680 tx=0x7f84f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.630+0000 7f8509600640 1 -- 172.21.15.73:0/483861514 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f850c15b4d0 con 0x7f850c0affc0 2024-04-15T15:31:27.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 -- 172.21.15.73:0/483861514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f850c068ab0 con 0x7f850c0affc0 2024-04-15T15:31:27.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8509600640 1 -- 172.21.15.73:0/483861514 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f85000187e0 con 0x7f850c0affc0 2024-04-15T15:31:27.822 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:27.822 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-15T15:31:27.822 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 -- 172.21.15.73:0/483861514 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f84ec068380 msgr2=0x7f84ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f84ec068380 0x7f84ec06a840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f850c0ae680 tx=0x7f84f8008040 comp rx=0 tx=0).stop 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 -- 172.21.15.73:0/483861514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 msgr2=0x7f850c141300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 0x7f850c141300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f850000b2c0 tx=0x7f850001b990 comp rx=0 tx=0).stop 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 -- 172.21.15.73:0/483861514 shutdown_connections 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f84ec068380 0x7f84ec06a840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f850c15b0c0 0x7f850c15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f850c0b5190 0x7f850c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 --2- 172.21.15.73:0/483861514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f850c0affc0 0x7f850c141300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 -- 172.21.15.73:0/483861514 >> 172.21.15.73:0/483861514 conn(0x7f850c06ba50 msgr2=0x7f850c0ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:27.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 -- 172.21.15.73:0/483861514 shutdown_connections 2024-04-15T15:31:27.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:27.822+0000 7f8514400640 1 -- 172.21.15.73:0/483861514 wait complete. 2024-04-15T15:31:29.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:31:29.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.985+0000 7feed9c00640 1 Processor -- start 2024-04-15T15:31:29.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feed9c00640 1 -- start start 2024-04-15T15:31:29.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feed9c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feed415e840 0x7feed40b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:29.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feed9c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feed415ec20 con 0x7feed40b17c0 2024-04-15T15:31:29.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feed9c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feed40cf2e0 con 0x7feed40ae270 2024-04-15T15:31:29.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feed9c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7feed40cfef0 con 0x7feed415e840 2024-04-15T15:31:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feed3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feed415e840 0x7feed40b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feecb400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feed40b17c0 0x7feed40d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44716/0 (socket says 172.21.15.73:44716) 2024-04-15T15:31:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feecb400640 1 -- 172.21.15.73:0/4230808013 learned_addr learned my addr 172.21.15.73:0/4230808013 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feed3e00640 1 -- 172.21.15.73:0/4230808013 >> v1:172.21.15.118:6789/0 conn(0x7feed40ae270 legacy=0x7feed406ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feed3e00640 1 -- 172.21.15.73:0/4230808013 >> v1:172.21.15.73:6789/0 conn(0x7feed40b17c0 legacy=0x7feed40d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feed3e00640 1 -- 172.21.15.73:0/4230808013 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed40cf5c0 con 0x7feed415e840 2024-04-15T15:31:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.989+0000 7feed3400640 1 -- 172.21.15.73:0/4230808013 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652691667 0 0) 0x7feed415ec20 con 0x7feed40b17c0 2024-04-15T15:31:29.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed3e00640 1 --2- 172.21.15.73:0/4230808013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed415e840 0x7feed40b3ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feec40097c0 tx=0x7feec401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573989ee28384a83 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:29.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed3400640 1 -- 172.21.15.73:0/4230808013 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec40b1070 con 0x7feed415e840 2024-04-15T15:31:29.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed3400640 1 -- 172.21.15.73:0/4230808013 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec40ac600 con 0x7feed415e840 2024-04-15T15:31:29.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed3400640 1 -- 172.21.15.73:0/4230808013 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec40ac9d0 con 0x7feed415e840 2024-04-15T15:31:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed9c00640 1 -- 172.21.15.73:0/4230808013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed415e840 msgr2=0x7feed40b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed9c00640 1 --2- 172.21.15.73:0/4230808013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed415e840 0x7feed40b3ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feec40097c0 tx=0x7feec401c3a0 comp rx=0 tx=0).stop 2024-04-15T15:31:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed9c00640 1 -- 172.21.15.73:0/4230808013 shutdown_connections 2024-04-15T15:31:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed9c00640 1 --2- 172.21.15.73:0/4230808013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed415e840 0x7feed40b3ab0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed9c00640 1 -- 172.21.15.73:0/4230808013 >> 172.21.15.73:0/4230808013 conn(0x7feed40b2f90 msgr2=0x7feed40b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed9c00640 1 -- 172.21.15.73:0/4230808013 shutdown_connections 2024-04-15T15:31:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed9c00640 1 -- 172.21.15.73:0/4230808013 wait complete. 2024-04-15T15:31:29.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed9c00640 1 Processor -- start 2024-04-15T15:31:29.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.993+0000 7feed9c00640 1 -- start start 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed40ae270 0x7feed414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed40b17c0 0x7feed40cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feed415e840 0x7feed40ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feed40b1d40 con 0x7feed40ae270 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7feed40b1bc0 con 0x7feed40b17c0 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7feed406c160 con 0x7feed415e840 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed40ae270 0x7feed414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed40ae270 0x7feed414f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58778/0 (socket says 172.21.15.73:58778) 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed3e00640 1 -- 172.21.15.73:0/1639283259 learned_addr learned my addr 172.21.15.73:0/1639283259 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feecb400640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed40b17c0 0x7feed40cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed3e00640 1 -- 172.21.15.73:0/1639283259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feed415e840 msgr2=0x7feed40ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9200640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feed415e840 0x7feed40ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed3e00640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feed415e840 0x7feed40ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed3e00640 1 -- 172.21.15.73:0/1639283259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed40b17c0 msgr2=0x7feed40cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed3e00640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed40b17c0 0x7feed40cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed3e00640 1 -- 172.21.15.73:0/1639283259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed40b6630 con 0x7feed40ae270 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feecb400640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed40b17c0 0x7feed40cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9200640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feed415e840 0x7feed40ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed3e00640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed40ae270 0x7feed414f5d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feec4019fd0 tx=0x7feec401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed0c00640 1 -- 172.21.15.73:0/1639283259 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec40bb020 con 0x7feed40ae270 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed0c00640 1 -- 172.21.15.73:0/1639283259 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec40b7640 con 0x7feed40ae270 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9c00640 1 -- 172.21.15.73:0/1639283259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed40b6910 con 0x7feed40ae270 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed0c00640 1 -- 172.21.15.73:0/1639283259 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec40b1040 con 0x7feed40ae270 2024-04-15T15:31:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9c00640 1 -- 172.21.15.73:0/1639283259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed40b6ed0 con 0x7feed40ae270 2024-04-15T15:31:30.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed9c00640 1 -- 172.21.15.73:0/1639283259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed404fd60 con 0x7feed40ae270 2024-04-15T15:31:30.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:29.997+0000 7feed0c00640 1 -- 172.21.15.73:0/1639283259 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feec40be020 con 0x7feed40ae270 2024-04-15T15:31:30.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.001+0000 7feed0c00640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feeb0068380 0x7feeb006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.001+0000 7feed0c00640 1 -- 172.21.15.73:0/1639283259 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7feec4120af0 con 0x7feed40ae270 2024-04-15T15:31:30.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.001+0000 7feecb400640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feeb0068380 0x7feeb006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.001+0000 7feecb400640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feeb0068380 0x7feeb006a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feed40cbe00 tx=0x7feebc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:30.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.005+0000 7feed0c00640 1 -- 172.21.15.73:0/1639283259 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feec40c5030 con 0x7feed40ae270 2024-04-15T15:31:30.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.193+0000 7feed9c00640 1 -- 172.21.15.73:0/1639283259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feed406bbf0 con 0x7feed40ae270 2024-04-15T15:31:30.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.193+0000 7feed0c00640 1 -- 172.21.15.73:0/1639283259 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7feec4016050 con 0x7feed40ae270 2024-04-15T15:31:30.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:30.197 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-15T15:31:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 3 2024-04-15T15:31:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 -- 172.21.15.73:0/1639283259 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feeb0068380 msgr2=0x7feeb006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feeb0068380 0x7feeb006a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feed40cbe00 tx=0x7feebc009040 comp rx=0 tx=0).stop 2024-04-15T15:31:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 -- 172.21.15.73:0/1639283259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed40ae270 msgr2=0x7feed414f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed40ae270 0x7feed414f5d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feec4019fd0 tx=0x7feec401abe0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 -- 172.21.15.73:0/1639283259 shutdown_connections 2024-04-15T15:31:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feeb0068380 0x7feeb006a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feed415e840 0x7feed40ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed40b17c0 0x7feed40cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 --2- 172.21.15.73:0/1639283259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feed40ae270 0x7feed414f5d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 -- 172.21.15.73:0/1639283259 >> 172.21.15.73:0/1639283259 conn(0x7feed40b2f90 msgr2=0x7feed406ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 -- 172.21.15.73:0/1639283259 shutdown_connections 2024-04-15T15:31:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.197+0000 7feed9c00640 1 -- 172.21.15.73:0/1639283259 wait complete. 2024-04-15T15:31:30.217 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:30.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.349+0000 7f3831200640 1 Processor -- start 2024-04-15T15:31:30.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.349+0000 7f3831200640 1 -- start start 2024-04-15T15:31:30.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.349+0000 7f3831200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f382c15b560 0x7f382c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.349+0000 7f3831200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c0af610 0x7f382c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.349+0000 7f3831200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f382c0ce620 con 0x7f382c0d0450 2024-04-15T15:31:30.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.349+0000 7f3831200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f382c06dc10 con 0x7f382c15b560 2024-04-15T15:31:30.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.349+0000 7f3831200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f382c06def0 con 0x7f382c0af610 2024-04-15T15:31:30.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f382b400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f382c15b560 0x7f382c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f3822a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c0af610 0x7f382c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f382b400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f382c15b560 0x7f382c06e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:53320/0 (socket says 172.21.15.73:53320) 2024-04-15T15:31:30.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f382be00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f382c0d0450 0x7f382c0d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:43026/0 (socket says 172.21.15.73:43026) 2024-04-15T15:31:30.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f382b400640 1 -- 172.21.15.73:0/263879868 learned_addr learned my addr 172.21.15.73:0/263879868 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:30.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f382b400640 1 -- 172.21.15.73:0/263879868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c0af610 msgr2=0x7f382c0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:30.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f382b400640 1 --2- 172.21.15.73:0/263879868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c0af610 0x7f382c0cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f382b400640 1 -- 172.21.15.73:0/263879868 >> v1:172.21.15.118:6789/0 conn(0x7f382c0d0450 legacy=0x7f382c0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f382b400640 1 -- 172.21.15.73:0/263879868 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c0ce330 con 0x7f382c15b560 2024-04-15T15:31:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f3822a00640 1 --2- 172.21.15.73:0/263879868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c0af610 0x7f382c0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:30.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.353+0000 7f382b400640 1 --2- 172.21.15.73:0/263879868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f382c15b560 0x7f382c06e6f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f381c009e50 tx=0x7f381c01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=944f888411db65d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:30.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f382aa00640 1 -- 172.21.15.73:0/263879868 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c0a5660 con 0x7f382c15b560 2024-04-15T15:31:30.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f382aa00640 1 -- 172.21.15.73:0/263879868 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381c0a5800 con 0x7f382c15b560 2024-04-15T15:31:30.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f382aa00640 1 -- 172.21.15.73:0/263879868 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c0a5bd0 con 0x7f382c15b560 2024-04-15T15:31:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 -- 172.21.15.73:0/263879868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f382c15b560 msgr2=0x7f382c06e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 --2- 172.21.15.73:0/263879868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f382c15b560 0x7f382c06e6f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f381c009e50 tx=0x7f381c01c9a0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 -- 172.21.15.73:0/263879868 shutdown_connections 2024-04-15T15:31:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 --2- 172.21.15.73:0/263879868 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c0af610 0x7f382c0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 --2- 172.21.15.73:0/263879868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f382c15b560 0x7f382c06e6f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 -- 172.21.15.73:0/263879868 >> 172.21.15.73:0/263879868 conn(0x7f382c06bc20 msgr2=0x7f382c06c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 -- 172.21.15.73:0/263879868 shutdown_connections 2024-04-15T15:31:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 -- 172.21.15.73:0/263879868 wait complete. 2024-04-15T15:31:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 Processor -- start 2024-04-15T15:31:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 -- start start 2024-04-15T15:31:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f382c0af610 0x7f382c099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382c0d0450 0x7f382c164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c15b560 0x7f382c156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f382c0b40d0 con 0x7f382c0d0450 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f382c0b3f50 con 0x7f382c0af610 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3831200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f382c0b4250 con 0x7f382c15b560 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3822a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382c0d0450 0x7f382c164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3822a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382c0d0450 0x7f382c164540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58780/0 (socket says 172.21.15.73:58780) 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.357+0000 7f3822a00640 1 -- 172.21.15.73:0/4086438534 learned_addr learned my addr 172.21.15.73:0/4086438534 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f382be00640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c15b560 0x7f382c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f382b400640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f382c0af610 0x7f382c099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3822a00640 1 -- 172.21.15.73:0/4086438534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c15b560 msgr2=0x7f382c156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3822a00640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c15b560 0x7f382c156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3822a00640 1 -- 172.21.15.73:0/4086438534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f382c0af610 msgr2=0x7f382c099870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3822a00640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f382c0af610 0x7f382c099870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3822a00640 1 -- 172.21.15.73:0/4086438534 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c164f90 con 0x7f382c0d0450 2024-04-15T15:31:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f382b400640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f382c0af610 0x7f382c099870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3822a00640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382c0d0450 0x7f382c164540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f381400e9b0 tx=0x7f381400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3823e00640 1 -- 172.21.15.73:0/4086438534 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814017070 con 0x7f382c0d0450 2024-04-15T15:31:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3823e00640 1 -- 172.21.15.73:0/4086438534 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381400c9a0 con 0x7f382c0d0450 2024-04-15T15:31:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3823e00640 1 -- 172.21.15.73:0/4086438534 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381400cd90 con 0x7f382c0d0450 2024-04-15T15:31:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3831200640 1 -- 172.21.15.73:0/4086438534 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382c165270 con 0x7f382c0d0450 2024-04-15T15:31:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3831200640 1 -- 172.21.15.73:0/4086438534 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382c165830 con 0x7f382c0d0450 2024-04-15T15:31:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3831200640 1 -- 172.21.15.73:0/4086438534 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f382c04fd60 con 0x7f382c0d0450 2024-04-15T15:31:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.361+0000 7f3823e00640 1 -- 172.21.15.73:0/4086438534 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f381401a070 con 0x7f382c0d0450 2024-04-15T15:31:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.365+0000 7f3823e00640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3808068380 0x7f380806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.365+0000 7f3823e00640 1 -- 172.21.15.73:0/4086438534 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f3814086610 con 0x7f382c0d0450 2024-04-15T15:31:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.365+0000 7f382b400640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3808068380 0x7f380806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.365+0000 7f382b400640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3808068380 0x7f380806a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f381c0ae000 tx=0x7f381c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.369+0000 7f3823e00640 1 -- 172.21.15.73:0/4086438534 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3814056e90 con 0x7f382c0d0450 2024-04-15T15:31:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.529+0000 7f3831200640 1 -- 172.21.15.73:0/4086438534 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f382c06ea40 con 0x7f382c0d0450 2024-04-15T15:31:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.529+0000 7f3823e00640 1 -- 172.21.15.73:0/4086438534 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7f3814056790 con 0x7f382c0d0450 2024-04-15T15:31:30.532 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:30.532 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:24.104849+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 -- 172.21.15.73:0/4086438534 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3808068380 msgr2=0x7f380806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3808068380 0x7f380806a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f381c0ae000 tx=0x7f381c0a7070 comp rx=0 tx=0).stop 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 -- 172.21.15.73:0/4086438534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382c0d0450 msgr2=0x7f382c164540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382c0d0450 0x7f382c164540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f381400e9b0 tx=0x7f381400ee70 comp rx=0 tx=0).stop 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 -- 172.21.15.73:0/4086438534 shutdown_connections 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3808068380 0x7f380806a840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f382c15b560 0x7f382c156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f382c0d0450 0x7f382c164540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 --2- 172.21.15.73:0/4086438534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f382c0af610 0x7f382c099870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 -- 172.21.15.73:0/4086438534 >> 172.21.15.73:0/4086438534 conn(0x7f382c06bc20 msgr2=0x7f382c0ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 -- 172.21.15.73:0/4086438534 shutdown_connections 2024-04-15T15:31:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.533+0000 7f3831200640 1 -- 172.21.15.73:0/4086438534 wait complete. 2024-04-15T15:31:30.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T15:31:30.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:31:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc157e00640 1 Processor -- start 2024-04-15T15:31:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc157e00640 1 -- start start 2024-04-15T15:31:30.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc157e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc1581480e0 0x7fc1580cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc157e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc158072750 0x7fc15815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc157e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1581484c0 con 0x7fc15806ea40 2024-04-15T15:31:30.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc157e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc15806fd80 con 0x7fc1581480e0 2024-04-15T15:31:30.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc157e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc15806eed0 con 0x7fc158072750 2024-04-15T15:31:30.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc156000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc15806ea40 0x7fc158072040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44728/0 (socket says 172.21.15.73:44728) 2024-04-15T15:31:30.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc156000640 1 -- 172.21.15.73:0/54672870 learned_addr learned my addr 172.21.15.73:0/54672870 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:30.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc156a00640 1 --2- 172.21.15.73:0/54672870 >> v2:172.21.15.73:3300/0 conn(0x7fc1581480e0 0x7fc1580cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc157400640 1 --2- 172.21.15.73:0/54672870 >> v2:172.21.15.118:3300/0 conn(0x7fc158072750 0x7fc15815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc155600640 1 -- 172.21.15.73:0/54672870 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674391888 0 0) 0x7fc1581484c0 con 0x7fc15806ea40 2024-04-15T15:31:30.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc155600640 1 -- 172.21.15.73:0/54672870 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc13c003530 con 0x7fc15806ea40 2024-04-15T15:31:30.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc156a00640 1 -- 172.21.15.73:0/54672870 >> v2:172.21.15.118:3300/0 conn(0x7fc158072750 msgr2=0x7fc15815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:30.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc156a00640 1 --2- 172.21.15.73:0/54672870 >> v2:172.21.15.118:3300/0 conn(0x7fc158072750 0x7fc15815edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc156a00640 1 -- 172.21.15.73:0/54672870 >> v1:172.21.15.73:6789/0 conn(0x7fc15806ea40 legacy=0x7fc158072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.689+0000 7fc156a00640 1 -- 172.21.15.73:0/54672870 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15806f170 con 0x7fc1581480e0 2024-04-15T15:31:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc156a00640 1 --2- 172.21.15.73:0/54672870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1581480e0 0x7fc1580cea80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1580d0210 tx=0x7fc14801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d923b96b0c38c926 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc155600640 1 -- 172.21.15.73:0/54672870 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1480b2070 con 0x7fc1581480e0 2024-04-15T15:31:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc155600640 1 -- 172.21.15.73:0/54672870 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1480a58e0 con 0x7fc1581480e0 2024-04-15T15:31:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc155600640 1 -- 172.21.15.73:0/54672870 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1480a5cb0 con 0x7fc1581480e0 2024-04-15T15:31:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc157e00640 1 -- 172.21.15.73:0/54672870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1581480e0 msgr2=0x7fc1580cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc157e00640 1 --2- 172.21.15.73:0/54672870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1581480e0 0x7fc1580cea80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1580d0210 tx=0x7fc14801c930 comp rx=0 tx=0).stop 2024-04-15T15:31:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc157e00640 1 -- 172.21.15.73:0/54672870 shutdown_connections 2024-04-15T15:31:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc157e00640 1 --2- 172.21.15.73:0/54672870 >> v2:172.21.15.118:3300/0 conn(0x7fc158072750 0x7fc15815edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc157e00640 1 --2- 172.21.15.73:0/54672870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1581480e0 0x7fc1580cea80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc157e00640 1 -- 172.21.15.73:0/54672870 >> 172.21.15.73:0/54672870 conn(0x7fc158067bd0 msgr2=0x7fc15806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc157e00640 1 -- 172.21.15.73:0/54672870 shutdown_connections 2024-04-15T15:31:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.693+0000 7fc157e00640 1 -- 172.21.15.73:0/54672870 wait complete. 2024-04-15T15:31:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 Processor -- start 2024-04-15T15:31:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 -- start start 2024-04-15T15:31:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15806ea40 0x7fc1580cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc158072750 0x7fc158160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1581480e0 0x7fc15813dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc15815fca0 con 0x7fc158072750 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc15815fb20 con 0x7fc15806ea40 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc15815fe20 con 0x7fc1581480e0 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc158072750 0x7fc158160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc158072750 0x7fc158160950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58792/0 (socket says 172.21.15.73:58792) 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156000640 1 -- 172.21.15.73:0/2960365121 learned_addr learned my addr 172.21.15.73:0/2960365121 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156a00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15806ea40 0x7fc1580cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157400640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1581480e0 0x7fc15813dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156000640 1 -- 172.21.15.73:0/2960365121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1581480e0 msgr2=0x7fc15813dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156000640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1581480e0 0x7fc15813dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156000640 1 -- 172.21.15.73:0/2960365121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15806ea40 msgr2=0x7fc1580cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156000640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15806ea40 0x7fc1580cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156000640 1 -- 172.21.15.73:0/2960365121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15813eb30 con 0x7fc158072750 2024-04-15T15:31:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156a00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15806ea40 0x7fc1580cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc156000640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc158072750 0x7fc158160950 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc1440010f0 tx=0x7fc14400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc14ea00640 1 -- 172.21.15.73:0/2960365121 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144017070 con 0x7fc158072750 2024-04-15T15:31:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc14ea00640 1 -- 172.21.15.73:0/2960365121 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc144005d10 con 0x7fc158072750 2024-04-15T15:31:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 -- 172.21.15.73:0/2960365121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15813ee10 con 0x7fc158072750 2024-04-15T15:31:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc14ea00640 1 -- 172.21.15.73:0/2960365121 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144007310 con 0x7fc158072750 2024-04-15T15:31:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 -- 172.21.15.73:0/2960365121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15813f3d0 con 0x7fc158072750 2024-04-15T15:31:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.697+0000 7fc157e00640 1 -- 172.21.15.73:0/2960365121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15804fd60 con 0x7fc158072750 2024-04-15T15:31:30.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.701+0000 7fc14ea00640 1 -- 172.21.15.73:0/2960365121 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc14401a070 con 0x7fc158072750 2024-04-15T15:31:30.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.701+0000 7fc14ea00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc138068380 0x7fc13806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:30.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.701+0000 7fc14ea00640 1 -- 172.21.15.73:0/2960365121 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc144085b00 con 0x7fc158072750 2024-04-15T15:31:30.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.701+0000 7fc156a00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc138068380 0x7fc13806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:30.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.701+0000 7fc156a00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc138068380 0x7fc13806a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc1480af000 tx=0x7fc1480a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:30.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.705+0000 7fc14ea00640 1 -- 172.21.15.73:0/2960365121 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc144056400 con 0x7fc158072750 2024-04-15T15:31:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.861+0000 7fc157e00640 1 -- 172.21.15.73:0/2960365121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1581412d0 con 0x7fc158072750 2024-04-15T15:31:30.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.861+0000 7fc14ea00640 1 -- 172.21.15.73:0/2960365121 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fc144085e20 con 0x7fc158072750 2024-04-15T15:31:30.864 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:31:30.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 -- 172.21.15.73:0/2960365121 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc138068380 msgr2=0x7fc13806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc138068380 0x7fc13806a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc1480af000 tx=0x7fc1480a7070 comp rx=0 tx=0).stop 2024-04-15T15:31:30.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 -- 172.21.15.73:0/2960365121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc158072750 msgr2=0x7fc158160950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:30.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc158072750 0x7fc158160950 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc1440010f0 tx=0x7fc14400c8f0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 -- 172.21.15.73:0/2960365121 shutdown_connections 2024-04-15T15:31:30.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc138068380 0x7fc13806a840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1581480e0 0x7fc15813dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc158072750 0x7fc158160950 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 --2- 172.21.15.73:0/2960365121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15806ea40 0x7fc1580cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:30.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 -- 172.21.15.73:0/2960365121 >> 172.21.15.73:0/2960365121 conn(0x7fc158067bd0 msgr2=0x7fc1580b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:30.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 -- 172.21.15.73:0/2960365121 shutdown_connections 2024-04-15T15:31:30.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:30.865+0000 7fc157e00640 1 -- 172.21.15.73:0/2960365121 wait complete. 2024-04-15T15:31:30.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-15T15:31:31.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.017+0000 7f8f3da00640 1 Processor -- start 2024-04-15T15:31:31.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.017+0000 7f8f3da00640 1 -- start start 2024-04-15T15:31:31.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f3da00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f3815b5d0 0x7f8f3815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f3da00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8f380b3e30 0x7f8f380b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f3da00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f38070160 con 0x7f8f380b25f0 2024-04-15T15:31:31.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f3da00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f8f3815b9b0 con 0x7f8f380b3e30 2024-04-15T15:31:31.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f3da00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3815f1f0 con 0x7f8f3815b5d0 2024-04-15T15:31:31.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f36a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f3815b5d0 0x7f8f3815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f2e000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8f380b3e30 0x7f8f380b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f2e000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8f380b3e30 0x7f8f380b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:53346/0 (socket says 172.21.15.73:53346) 2024-04-15T15:31:31.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f36a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f3815b5d0 0x7f8f3815fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:54522/0 (socket says 172.21.15.73:54522) 2024-04-15T15:31:31.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f2e000640 1 -- 172.21.15.73:0/3521229694 learned_addr learned my addr 172.21.15.73:0/3521229694 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:31.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f2e000640 1 -- 172.21.15.73:0/3521229694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f3815b5d0 msgr2=0x7f8f3815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:31.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f2e000640 1 --2- 172.21.15.73:0/3521229694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f3815b5d0 0x7f8f3815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f2e000640 1 -- 172.21.15.73:0/3521229694 >> v1:172.21.15.118:6789/0 conn(0x7f8f380b25f0 legacy=0x7f8f380b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:31.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.021+0000 7f8f2e000640 1 -- 172.21.15.73:0/3521229694 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3806fe80 con 0x7f8f380b3e30 2024-04-15T15:31:31.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f2e000640 1 --2- 172.21.15.73:0/3521229694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f380b3e30 0x7f8f380b20b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009870 tx=0x7f8f2001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b578ec69d5f15bfa server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f36000640 1 -- 172.21.15.73:0/3521229694 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f200b0070 con 0x7f8f380b3e30 2024-04-15T15:31:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f36000640 1 -- 172.21.15.73:0/3521229694 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f200ab600 con 0x7f8f380b3e30 2024-04-15T15:31:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f36000640 1 -- 172.21.15.73:0/3521229694 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f200ab9d0 con 0x7f8f380b3e30 2024-04-15T15:31:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f3da00640 1 -- 172.21.15.73:0/3521229694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f380b3e30 msgr2=0x7f8f380b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f3da00640 1 --2- 172.21.15.73:0/3521229694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f380b3e30 0x7f8f380b20b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009870 tx=0x7f8f2001c410 comp rx=0 tx=0).stop 2024-04-15T15:31:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f3da00640 1 -- 172.21.15.73:0/3521229694 shutdown_connections 2024-04-15T15:31:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f3da00640 1 --2- 172.21.15.73:0/3521229694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f380b3e30 0x7f8f380b20b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f3da00640 1 --2- 172.21.15.73:0/3521229694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f3815b5d0 0x7f8f3815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f3da00640 1 -- 172.21.15.73:0/3521229694 >> 172.21.15.73:0/3521229694 conn(0x7f8f38067dd0 msgr2=0x7f8f380d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f3da00640 1 -- 172.21.15.73:0/3521229694 shutdown_connections 2024-04-15T15:31:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f3da00640 1 -- 172.21.15.73:0/3521229694 wait complete. 2024-04-15T15:31:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f3da00640 1 Processor -- start 2024-04-15T15:31:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.025+0000 7f8f3da00640 1 -- start start 2024-04-15T15:31:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f3da00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f380b25f0 0x7f8f3815e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f3da00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f380b3e30 0x7f8f38154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f3da00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f3815b5d0 0x7f8f38158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f3da00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3806faa0 con 0x7f8f3815b5d0 2024-04-15T15:31:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f3da00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8f380cfd00 con 0x7f8f380b3e30 2024-04-15T15:31:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f3da00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3806fc20 con 0x7f8f380b25f0 2024-04-15T15:31:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f37400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f3815b5d0 0x7f8f38158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f37400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f3815b5d0 0x7f8f38158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58806/0 (socket says 172.21.15.73:58806) 2024-04-15T15:31:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f37400640 1 -- 172.21.15.73:0/2412715983 learned_addr learned my addr 172.21.15.73:0/2412715983 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f36a00640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f380b25f0 0x7f8f3815e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f2e000640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f380b3e30 0x7f8f38154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f37400640 1 -- 172.21.15.73:0/2412715983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f380b25f0 msgr2=0x7f8f3815e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f37400640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f380b25f0 0x7f8f3815e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f37400640 1 -- 172.21.15.73:0/2412715983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f380b3e30 msgr2=0x7f8f38154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f37400640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f380b3e30 0x7f8f38154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f37400640 1 -- 172.21.15.73:0/2412715983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f38154ab0 con 0x7f8f3815b5d0 2024-04-15T15:31:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f37400640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f3815b5d0 0x7f8f38158b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c730 tx=0x7f8f3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f2f400640 1 -- 172.21.15.73:0/2412715983 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30003b80 con 0x7f8f3815b5d0 2024-04-15T15:31:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f2f400640 1 -- 172.21.15.73:0/2412715983 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f30003d20 con 0x7f8f3815b5d0 2024-04-15T15:31:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f3da00640 1 -- 172.21.15.73:0/2412715983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f38154d90 con 0x7f8f3815b5d0 2024-04-15T15:31:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f2f400640 1 -- 172.21.15.73:0/2412715983 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3000aa30 con 0x7f8f3815b5d0 2024-04-15T15:31:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f3da00640 1 -- 172.21.15.73:0/2412715983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f38155350 con 0x7f8f3815b5d0 2024-04-15T15:31:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f3da00640 1 -- 172.21.15.73:0/2412715983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f38068ab0 con 0x7f8f3815b5d0 2024-04-15T15:31:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.029+0000 7f8f2f400640 1 -- 172.21.15.73:0/2412715983 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8f3000abd0 con 0x7f8f3815b5d0 2024-04-15T15:31:31.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.033+0000 7f8f2f400640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8f140683b0 0x7f8f1406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.033+0000 7f8f2f400640 1 -- 172.21.15.73:0/2412715983 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8f300863a0 con 0x7f8f3815b5d0 2024-04-15T15:31:31.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.033+0000 7f8f36a00640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8f140683b0 0x7f8f1406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.033+0000 7f8f36a00640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8f140683b0 0x7f8f1406a870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f381572c0 tx=0x7f8f28009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:31.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.037+0000 7f8f2f400640 1 -- 172.21.15.73:0/2412715983 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f30056650 con 0x7f8f3815b5d0 2024-04-15T15:31:31.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 -- 172.21.15.73:0/2412715983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8f380afd00 con 0x7f8f3815b5d0 2024-04-15T15:31:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f2f400640 1 -- 172.21.15.73:0/2412715983 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f8f3005a950 con 0x7f8f3815b5d0 2024-04-15T15:31:31.198 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:31.198 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-04-15T15:31:31.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:31:31.198 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-04-15T15:31:31.199 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-04-15T15:31:31.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:31:31.199 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-04-15T15:31:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 -- 172.21.15.73:0/2412715983 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8f140683b0 msgr2=0x7f8f1406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8f140683b0 0x7f8f1406a870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f381572c0 tx=0x7f8f28009190 comp rx=0 tx=0).stop 2024-04-15T15:31:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 -- 172.21.15.73:0/2412715983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f3815b5d0 msgr2=0x7f8f38158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f3815b5d0 0x7f8f38158b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c730 tx=0x7f8f3000cbf0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 -- 172.21.15.73:0/2412715983 shutdown_connections 2024-04-15T15:31:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f3815b5d0 0x7f8f38158b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f380b3e30 0x7f8f38154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8f140683b0 0x7f8f1406a870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 --2- 172.21.15.73:0/2412715983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f380b25f0 0x7f8f3815e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 -- 172.21.15.73:0/2412715983 >> 172.21.15.73:0/2412715983 conn(0x7f8f38067dd0 msgr2=0x7f8f380b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 -- 172.21.15.73:0/2412715983 shutdown_connections 2024-04-15T15:31:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.197+0000 7f8f3da00640 1 -- 172.21.15.73:0/2412715983 wait complete. 2024-04-15T15:31:31.219 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-15T15:31:31.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-15T15:31:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef9400640 1 Processor -- start 2024-04-15T15:31:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef9400640 1 -- start start 2024-04-15T15:31:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef9400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 0x7efef41625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef9400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efef40b5ec0 0x7efef4162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef9400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efef40b4410 con 0x7efef4162b20 2024-04-15T15:31:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef9400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7efef4163460 con 0x7efef40b5ec0 2024-04-15T15:31:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef9400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efef40ced20 con 0x7efef415e9a0 2024-04-15T15:31:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef3200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efef40b5ec0 0x7efef4162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef3200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efef40b5ec0 0x7efef4162f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58810/0 (socket says 172.21.15.73:58810) 2024-04-15T15:31:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef3200640 1 -- 172.21.15.73:0/2367247732 learned_addr learned my addr 172.21.15.73:0/2367247732 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef2800640 1 --2- 172.21.15.73:0/2367247732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 0x7efef41625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef3200640 1 -- 172.21.15.73:0/2367247732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 msgr2=0x7efef41625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef3200640 1 --2- 172.21.15.73:0/2367247732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 0x7efef41625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef3200640 1 -- 172.21.15.73:0/2367247732 >> v1:172.21.15.118:6789/0 conn(0x7efef4162b20 legacy=0x7efef406ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef3200640 1 -- 172.21.15.73:0/2367247732 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef40b46b0 con 0x7efef40b5ec0 2024-04-15T15:31:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.357+0000 7efef2800640 1 --2- 172.21.15.73:0/2367247732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 0x7efef41625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef3200640 1 --2- 172.21.15.73:0/2367247732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 0x7efef4162f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efeec009e50 tx=0x7efeec01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37c4d4d1d801844 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef1e00640 1 -- 172.21.15.73:0/2367247732 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec0a5860 con 0x7efef40b5ec0 2024-04-15T15:31:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef1e00640 1 -- 172.21.15.73:0/2367247732 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeec0a5a00 con 0x7efef40b5ec0 2024-04-15T15:31:31.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef1e00640 1 -- 172.21.15.73:0/2367247732 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec0a5dd0 con 0x7efef40b5ec0 2024-04-15T15:31:31.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef9400640 1 -- 172.21.15.73:0/2367247732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 msgr2=0x7efef4162f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:31.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef9400640 1 --2- 172.21.15.73:0/2367247732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 0x7efef4162f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efeec009e50 tx=0x7efeec01c9c0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef9400640 1 -- 172.21.15.73:0/2367247732 shutdown_connections 2024-04-15T15:31:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef9400640 1 --2- 172.21.15.73:0/2367247732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 0x7efef4162f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef9400640 1 --2- 172.21.15.73:0/2367247732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 0x7efef41625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef9400640 1 -- 172.21.15.73:0/2367247732 >> 172.21.15.73:0/2367247732 conn(0x7efef40b6890 msgr2=0x7efef40b6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef9400640 1 -- 172.21.15.73:0/2367247732 shutdown_connections 2024-04-15T15:31:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.361+0000 7efef9400640 1 -- 172.21.15.73:0/2367247732 wait complete. 2024-04-15T15:31:31.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef9400640 1 Processor -- start 2024-04-15T15:31:31.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef9400640 1 -- start start 2024-04-15T15:31:31.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef9400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 0x7efef4151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef9400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 0x7efef4158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efef4162b20 0x7efef40ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef9400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efef415ef00 con 0x7efef40b5ec0 2024-04-15T15:31:31.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef9400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efef415ed80 con 0x7efef4162b20 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef9400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efef40ce8f0 con 0x7efef415e9a0 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef2800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 0x7efef4151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef2800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 0x7efef4151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58824/0 (socket says 172.21.15.73:58824) 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef2800640 1 -- 172.21.15.73:0/4121540459 learned_addr learned my addr 172.21.15.73:0/4121540459 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef3200640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efef4162b20 0x7efef40ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efee9e00640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 0x7efef4158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef2800640 1 -- 172.21.15.73:0/4121540459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 msgr2=0x7efef4158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef2800640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 0x7efef4158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef2800640 1 -- 172.21.15.73:0/4121540459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efef4162b20 msgr2=0x7efef40ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef2800640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efef4162b20 0x7efef40ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef2800640 1 -- 172.21.15.73:0/4121540459 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef40d0da0 con 0x7efef40b5ec0 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efee9e00640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 0x7efef4158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:31.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef2800640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 0x7efef4151490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efee400c7f0 tx=0x7efee400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:31.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efeeb400640 1 -- 172.21.15.73:0/4121540459 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee4015070 con 0x7efef40b5ec0 2024-04-15T15:31:31.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efeeb400640 1 -- 172.21.15.73:0/4121540459 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee40077c0 con 0x7efef40b5ec0 2024-04-15T15:31:31.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef9400640 1 -- 172.21.15.73:0/4121540459 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef40d1080 con 0x7efef40b5ec0 2024-04-15T15:31:31.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efeeb400640 1 -- 172.21.15.73:0/4121540459 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee4007bb0 con 0x7efef40b5ec0 2024-04-15T15:31:31.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.365+0000 7efef9400640 1 -- 172.21.15.73:0/4121540459 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef40d1640 con 0x7efef40b5ec0 2024-04-15T15:31:31.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.369+0000 7efef9400640 1 -- 172.21.15.73:0/4121540459 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef4068b20 con 0x7efef40b5ec0 2024-04-15T15:31:31.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.369+0000 7efeeb400640 1 -- 172.21.15.73:0/4121540459 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efee4018070 con 0x7efef40b5ec0 2024-04-15T15:31:31.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.369+0000 7efeeb400640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efed0068380 0x7efed006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:31.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.369+0000 7efeeb400640 1 -- 172.21.15.73:0/4121540459 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7efee4086680 con 0x7efef40b5ec0 2024-04-15T15:31:31.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.369+0000 7efee9e00640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efed0068380 0x7efed006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:31.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.369+0000 7efee9e00640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efed0068380 0x7efed006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efef41591e0 tx=0x7efedc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:31.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.373+0000 7efeeb400640 1 -- 172.21.15.73:0/4121540459 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efee40569d0 con 0x7efef40b5ec0 2024-04-15T15:31:31.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:31.533+0000 7efef9400640 1 -- 172.21.15.73:0/4121540459 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efef40b2100 con 0x7efef40b5ec0 2024-04-15T15:31:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.425+0000 7efeeb400640 1 -- 172.21.15.73:0/4121540459 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7efee405acd0 con 0x7efef40b5ec0 2024-04-15T15:31:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-04-15T15:31:32.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 -- 172.21.15.73:0/4121540459 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efed0068380 msgr2=0x7efed006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efed0068380 0x7efed006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efef41591e0 tx=0x7efedc009040 comp rx=0 tx=0).stop 2024-04-15T15:31:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 -- 172.21.15.73:0/4121540459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 msgr2=0x7efef4151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 0x7efef4151490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efee400c7f0 tx=0x7efee400ccb0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 -- 172.21.15.73:0/4121540459 shutdown_connections 2024-04-15T15:31:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efef4162b20 0x7efef40ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efed0068380 0x7efed006a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efef415e9a0 0x7efef4158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 --2- 172.21.15.73:0/4121540459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efef40b5ec0 0x7efef4151490 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 -- 172.21.15.73:0/4121540459 >> 172.21.15.73:0/4121540459 conn(0x7efef40b6890 msgr2=0x7efef4070740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 -- 172.21.15.73:0/4121540459 shutdown_connections 2024-04-15T15:31:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.429+0000 7efef9400640 1 -- 172.21.15.73:0/4121540459 wait complete. 2024-04-15T15:31:32.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-15T15:31:32.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cf200640 1 Processor -- start 2024-04-15T15:31:32.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cf200640 1 -- start start 2024-04-15T15:31:32.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cf200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f34c815b5d0 0x7f34c815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:32.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cf200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 0x7f34c80b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:32.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cf200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c8070160 con 0x7f34c80b3e30 2024-04-15T15:31:32.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cf200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f34c815b9b0 con 0x7f34c815b5d0 2024-04-15T15:31:32.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cf200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f34c815f1f0 con 0x7f34c80b27c0 2024-04-15T15:31:32.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cd200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 0x7f34c80b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:32.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cd200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 0x7f34c80b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:54554/0 (socket says 172.21.15.73:54554) 2024-04-15T15:31:32.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cd200640 1 -- 172.21.15.73:0/982541492 learned_addr learned my addr 172.21.15.73:0/982541492 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:32.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34c7e00640 1 --2- 172.21.15.73:0/982541492 >> v2:172.21.15.118:3300/0 conn(0x7f34c815b5d0 0x7f34c815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:32.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cd200640 1 -- 172.21.15.73:0/982541492 >> v2:172.21.15.118:3300/0 conn(0x7f34c815b5d0 msgr2=0x7f34c815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:32.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cd200640 1 --2- 172.21.15.73:0/982541492 >> v2:172.21.15.118:3300/0 conn(0x7f34c815b5d0 0x7f34c815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cd200640 1 -- 172.21.15.73:0/982541492 >> v1:172.21.15.118:6789/0 conn(0x7f34c80b3e30 legacy=0x7f34c80b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:32.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.605+0000 7f34cd200640 1 -- 172.21.15.73:0/982541492 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c806fe80 con 0x7f34c80b27c0 2024-04-15T15:31:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34cd200640 1 --2- 172.21.15.73:0/982541492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 0x7f34c80b4740 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009e80 tx=0x7f34c001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee7f50881707ee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34c7400640 1 -- 172.21.15.73:0/982541492 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c00090d0 con 0x7f34c80b27c0 2024-04-15T15:31:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34c7400640 1 -- 172.21.15.73:0/982541492 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c00a5780 con 0x7f34c80b27c0 2024-04-15T15:31:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34c7400640 1 -- 172.21.15.73:0/982541492 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c0009270 con 0x7f34c80b27c0 2024-04-15T15:31:32.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34cf200640 1 -- 172.21.15.73:0/982541492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 msgr2=0x7f34c80b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:32.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34cf200640 1 --2- 172.21.15.73:0/982541492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 0x7f34c80b4740 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009e80 tx=0x7f34c001c8c0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34cf200640 1 -- 172.21.15.73:0/982541492 shutdown_connections 2024-04-15T15:31:32.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34cf200640 1 --2- 172.21.15.73:0/982541492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 0x7f34c80b4740 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34cf200640 1 --2- 172.21.15.73:0/982541492 >> v2:172.21.15.118:3300/0 conn(0x7f34c815b5d0 0x7f34c815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34cf200640 1 -- 172.21.15.73:0/982541492 >> 172.21.15.73:0/982541492 conn(0x7f34c8067dd0 msgr2=0x7f34c80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:32.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34cf200640 1 -- 172.21.15.73:0/982541492 shutdown_connections 2024-04-15T15:31:32.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.609+0000 7f34cf200640 1 -- 172.21.15.73:0/982541492 wait complete. 2024-04-15T15:31:32.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cf200640 1 Processor -- start 2024-04-15T15:31:32.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cf200640 1 -- start start 2024-04-15T15:31:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cf200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 0x7f34c8150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cf200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c80b3e30 0x7f34c8141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cf200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34c815b5d0 0x7f34c815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cf200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f34c806faa0 con 0x7f34c815b5d0 2024-04-15T15:31:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cf200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f34c80b4240 con 0x7f34c80b3e30 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cf200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f34c806fc20 con 0x7f34c80b27c0 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cd200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34c815b5d0 0x7f34c815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cd200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34c815b5d0 0x7f34c815cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58836/0 (socket says 172.21.15.73:58836) 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cd200640 1 -- 172.21.15.73:0/2263821765 learned_addr learned my addr 172.21.15.73:0/2263821765 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34c7e00640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 0x7f34c8150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34bf400640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c80b3e30 0x7f34c8141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cd200640 1 -- 172.21.15.73:0/2263821765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 msgr2=0x7f34c8150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cd200640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 0x7f34c8150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cd200640 1 -- 172.21.15.73:0/2263821765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c80b3e30 msgr2=0x7f34c8141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cd200640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c80b3e30 0x7f34c8141dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cd200640 1 -- 172.21.15.73:0/2263821765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c815d4a0 con 0x7f34c815b5d0 2024-04-15T15:31:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cd200640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34c815b5d0 0x7f34c815cf60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009e80 tx=0x7f34c0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34c4c00640 1 -- 172.21.15.73:0/2263821765 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c00bc020 con 0x7f34c815b5d0 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34c4c00640 1 -- 172.21.15.73:0/2263821765 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c00b8670 con 0x7f34c815b5d0 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cf200640 1 -- 172.21.15.73:0/2263821765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c815e630 con 0x7f34c815b5d0 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34c4c00640 1 -- 172.21.15.73:0/2263821765 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c00b8a60 con 0x7f34c815b5d0 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.613+0000 7f34cf200640 1 -- 172.21.15.73:0/2263821765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c815c760 con 0x7f34c815b5d0 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.617+0000 7f34cf200640 1 -- 172.21.15.73:0/2263821765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c815c550 con 0x7f34c815b5d0 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.617+0000 7f34c4c00640 1 -- 172.21.15.73:0/2263821765 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f34c00bf020 con 0x7f34c815b5d0 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.617+0000 7f34c4c00640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34a40683b0 0x7f34a406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.617+0000 7f34c4c00640 1 -- 172.21.15.73:0/2263821765 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f34c0121a20 con 0x7f34c815b5d0 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.617+0000 7f34c7e00640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34a40683b0 0x7f34a406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.617+0000 7f34c7e00640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34a40683b0 0x7f34a406a870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34c815e3b0 tx=0x7f34b8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.621+0000 7f34c4c00640 1 -- 172.21.15.73:0/2263821765 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f34c00c6070 con 0x7f34c815b5d0 2024-04-15T15:31:32.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:32.777+0000 7f34cf200640 1 -- 172.21.15.73:0/2263821765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f34c8068ab0 con 0x7f34c815b5d0 2024-04-15T15:31:33.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:31:33.017 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:31:33.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.429+0000 7f34c4c00640 1 -- 172.21.15.73:0/2263821765 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f34c815d4a0 con 0x7f34c815b5d0 2024-04-15T15:31:33.433 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-04-15T15:31:33.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 -- 172.21.15.73:0/2263821765 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34a40683b0 msgr2=0x7f34a406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:33.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34a40683b0 0x7f34a406a870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34c815e3b0 tx=0x7f34b8009190 comp rx=0 tx=0).stop 2024-04-15T15:31:33.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 -- 172.21.15.73:0/2263821765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34c815b5d0 msgr2=0x7f34c815cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:33.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34c815b5d0 0x7f34c815cf60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009e80 tx=0x7f34c0019660 comp rx=0 tx=0).stop 2024-04-15T15:31:33.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 -- 172.21.15.73:0/2263821765 shutdown_connections 2024-04-15T15:31:33.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34c815b5d0 0x7f34c815cf60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c80b3e30 0x7f34c8141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34a40683b0 0x7f34a406a870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 --2- 172.21.15.73:0/2263821765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34c80b27c0 0x7f34c8150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 -- 172.21.15.73:0/2263821765 >> 172.21.15.73:0/2263821765 conn(0x7f34c8067dd0 msgr2=0x7f34c80b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 -- 172.21.15.73:0/2263821765 shutdown_connections 2024-04-15T15:31:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.433+0000 7f34cf200640 1 -- 172.21.15.73:0/2263821765 wait complete. 2024-04-15T15:31:33.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-15T15:31:33.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.613+0000 7f4240800640 1 Processor -- start 2024-04-15T15:31:33.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.613+0000 7f4240800640 1 -- start start 2024-04-15T15:31:33.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f4240800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42380cd1b0 0x7f423809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:33.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f4240800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f423815cab0 0x7f423809afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:33.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f4240800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42380cd690 con 0x7f423815c6d0 2024-04-15T15:31:33.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f4240800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f42380cd970 con 0x7f42380cd1b0 2024-04-15T15:31:33.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f4240800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f42380cdc50 con 0x7f423815cab0 2024-04-15T15:31:33.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f423d400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42380cd1b0 0x7f423809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:33.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f423de00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f423815c6d0 0x7f42380d0d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44730/0 (socket says 172.21.15.73:44730) 2024-04-15T15:31:33.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f423de00640 1 -- 172.21.15.73:0/3093318711 learned_addr learned my addr 172.21.15.73:0/3093318711 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:33.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f423d400640 1 -- 172.21.15.73:0/3093318711 >> v2:172.21.15.118:3300/0 conn(0x7f423815cab0 msgr2=0x7f423809afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:33.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f423e800640 1 --2- 172.21.15.73:0/3093318711 >> v2:172.21.15.118:3300/0 conn(0x7f423815cab0 0x7f423809afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:33.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f423d400640 1 --2- 172.21.15.73:0/3093318711 >> v2:172.21.15.118:3300/0 conn(0x7f423815cab0 0x7f423809afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:33.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f423d400640 1 -- 172.21.15.73:0/3093318711 >> v1:172.21.15.73:6789/0 conn(0x7f423815c6d0 legacy=0x7f42380d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:33.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f423d400640 1 -- 172.21.15.73:0/3093318711 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42380cdf30 con 0x7f42380cd1b0 2024-04-15T15:31:33.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f423ca00640 1 -- 172.21.15.73:0/3093318711 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517777695 0 0) 0x7f42380cd690 con 0x7f423815c6d0 2024-04-15T15:31:33.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.617+0000 7f423e800640 1 --2- 172.21.15.73:0/3093318711 >> v2:172.21.15.118:3300/0 conn(0x7f423815cab0 0x7f423809afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f423d400640 1 --2- 172.21.15.73:0/3093318711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 0x7f423809aa60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42380ce730 tx=0x7f422801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5dc50e78f1c177 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f423ca00640 1 -- 172.21.15.73:0/3093318711 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42280a7070 con 0x7f42380cd1b0 2024-04-15T15:31:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f423ca00640 1 -- 172.21.15.73:0/3093318711 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42280b0070 con 0x7f42380cd1b0 2024-04-15T15:31:33.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f423ca00640 1 -- 172.21.15.73:0/3093318711 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42280ab890 con 0x7f42380cd1b0 2024-04-15T15:31:33.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 -- 172.21.15.73:0/3093318711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 msgr2=0x7f423809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:33.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 --2- 172.21.15.73:0/3093318711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 0x7f423809aa60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42380ce730 tx=0x7f422801c450 comp rx=0 tx=0).stop 2024-04-15T15:31:33.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 -- 172.21.15.73:0/3093318711 shutdown_connections 2024-04-15T15:31:33.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 --2- 172.21.15.73:0/3093318711 >> v2:172.21.15.118:3300/0 conn(0x7f423815cab0 0x7f423809afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:33.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 --2- 172.21.15.73:0/3093318711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 0x7f423809aa60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:33.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 -- 172.21.15.73:0/3093318711 >> 172.21.15.73:0/3093318711 conn(0x7f42380b3fe0 msgr2=0x7f42380b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:33.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 -- 172.21.15.73:0/3093318711 shutdown_connections 2024-04-15T15:31:33.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 -- 172.21.15.73:0/3093318711 wait complete. 2024-04-15T15:31:33.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 Processor -- start 2024-04-15T15:31:33.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 -- start start 2024-04-15T15:31:33.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 0x7f4238153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:33.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f423815c6d0 0x7f4238166120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:33.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f423815cab0 0x7f4238166660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:33.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42380b1c60 con 0x7f42380cd1b0 2024-04-15T15:31:33.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f42380b1ae0 con 0x7f423815cab0 2024-04-15T15:31:33.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f4240800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f423806fdf0 con 0x7f423815c6d0 2024-04-15T15:31:33.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f423de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 0x7f4238153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:33.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f423de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 0x7f4238153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58858/0 (socket says 172.21.15.73:58858) 2024-04-15T15:31:33.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f423de00640 1 -- 172.21.15.73:0/2025077175 learned_addr learned my addr 172.21.15.73:0/2025077175 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:33.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f423e800640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f423815cab0 0x7f4238166660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.621+0000 7f423d400640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f423815c6d0 0x7f4238166120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f423de00640 1 -- 172.21.15.73:0/2025077175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f423815c6d0 msgr2=0x7f4238166120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f423de00640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f423815c6d0 0x7f4238166120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f423de00640 1 -- 172.21.15.73:0/2025077175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f423815cab0 msgr2=0x7f4238166660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f423de00640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f423815cab0 0x7f4238166660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f423de00640 1 -- 172.21.15.73:0/2025077175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423815a2a0 con 0x7f42380cd1b0 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f423d400640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f423815c6d0 0x7f4238166120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f423de00640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 0x7f4238153fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c730 tx=0x7f422c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f4232000640 1 -- 172.21.15.73:0/2025077175 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c007270 con 0x7f42380cd1b0 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f4232000640 1 -- 172.21.15.73:0/2025077175 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f422c007410 con 0x7f42380cd1b0 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f4232000640 1 -- 172.21.15.73:0/2025077175 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c0057b0 con 0x7f42380cd1b0 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f4240800640 1 -- 172.21.15.73:0/2025077175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42380b2920 con 0x7f42380cd1b0 2024-04-15T15:31:33.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f4240800640 1 -- 172.21.15.73:0/2025077175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42381548c0 con 0x7f42380cd1b0 2024-04-15T15:31:33.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f4240800640 1 -- 172.21.15.73:0/2025077175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4238068ab0 con 0x7f42380cd1b0 2024-04-15T15:31:33.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f4232000640 1 -- 172.21.15.73:0/2025077175 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f422c005950 con 0x7f42380cd1b0 2024-04-15T15:31:33.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f4232000640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f421c068380 0x7f421c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:33.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f4232000640 1 -- 172.21.15.73:0/2025077175 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f422c086600 con 0x7f42380cd1b0 2024-04-15T15:31:33.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.625+0000 7f423d400640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f421c068380 0x7f421c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:33.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.629+0000 7f423d400640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f421c068380 0x7f421c06a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42280af000 tx=0x7f42280a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:33.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.633+0000 7f4232000640 1 -- 172.21.15.73:0/2025077175 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f422c056b80 con 0x7f42380cd1b0 2024-04-15T15:31:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:33.821+0000 7f4240800640 1 -- 172.21.15.73:0/2025077175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f42380b4d80 con 0x7f42380cd1b0 2024-04-15T15:31:34.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.433+0000 7f4232000640 1 -- 172.21.15.73:0/2025077175 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f422c056480 con 0x7f42380cd1b0 2024-04-15T15:31:34.437 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2024-04-15T15:31:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 -- 172.21.15.73:0/2025077175 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f421c068380 msgr2=0x7f421c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f421c068380 0x7f421c06a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42280af000 tx=0x7f42280a7000 comp rx=0 tx=0).stop 2024-04-15T15:31:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 -- 172.21.15.73:0/2025077175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 msgr2=0x7f4238153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 0x7f4238153fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c730 tx=0x7f422c00cbf0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 -- 172.21.15.73:0/2025077175 shutdown_connections 2024-04-15T15:31:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f423815cab0 0x7f4238166660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f421c068380 0x7f421c06a840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f423815c6d0 0x7f4238166120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 --2- 172.21.15.73:0/2025077175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42380cd1b0 0x7f4238153fe0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 -- 172.21.15.73:0/2025077175 >> 172.21.15.73:0/2025077175 conn(0x7f42380b3fe0 msgr2=0x7f423809b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:34.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.437+0000 7f4240800640 1 -- 172.21.15.73:0/2025077175 shutdown_connections 2024-04-15T15:31:34.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.441+0000 7f4240800640 1 -- 172.21.15.73:0/2025077175 wait complete. 2024-04-15T15:31:34.490 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-15T15:31:34.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-15T15:31:34.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe924200640 1 Processor -- start 2024-04-15T15:31:34.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe924200640 1 -- start start 2024-04-15T15:31:34.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe924200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 0x7fe91c0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:34.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe924200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe91c143070 0x7fe91c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:34.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe924200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91c06c010 con 0x7fe91c06ba50 2024-04-15T15:31:34.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe924200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe91c0b4ae0 con 0x7fe91c143070 2024-04-15T15:31:34.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe924200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c06c5d0 con 0x7fe91c142c90 2024-04-15T15:31:34.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe920e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe91c143070 0x7fe91c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:34.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe920e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe91c143070 0x7fe91c0cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58874/0 (socket says 172.21.15.73:58874) 2024-04-15T15:31:34.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe920e00640 1 -- 172.21.15.73:0/67386346 learned_addr learned my addr 172.21.15.73:0/67386346 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:34.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.633+0000 7fe921800640 1 --2- 172.21.15.73:0/67386346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 0x7fe91c0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:34.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe920e00640 1 -- 172.21.15.73:0/67386346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 msgr2=0x7fe91c0b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:34.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe920e00640 1 --2- 172.21.15.73:0/67386346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 0x7fe91c0b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe920e00640 1 -- 172.21.15.73:0/67386346 >> v1:172.21.15.118:6789/0 conn(0x7fe91c06ba50 legacy=0x7fe91c0ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:34.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe920e00640 1 -- 172.21.15.73:0/67386346 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c06c2f0 con 0x7fe91c143070 2024-04-15T15:31:34.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe921800640 1 --2- 172.21.15.73:0/67386346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 0x7fe91c0b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:34.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe920e00640 1 --2- 172.21.15.73:0/67386346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 0x7fe91c0cf810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe908009870 tx=0x7fe90801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3e3b3de05048cf server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:34.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe91be00640 1 -- 172.21.15.73:0/67386346 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080aa430 con 0x7fe91c143070 2024-04-15T15:31:34.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe91be00640 1 -- 172.21.15.73:0/67386346 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9080af070 con 0x7fe91c143070 2024-04-15T15:31:34.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe91be00640 1 -- 172.21.15.73:0/67386346 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080aa7f0 con 0x7fe91c143070 2024-04-15T15:31:34.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe924200640 1 -- 172.21.15.73:0/67386346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 msgr2=0x7fe91c0cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:34.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe924200640 1 --2- 172.21.15.73:0/67386346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 0x7fe91c0cf810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe908009870 tx=0x7fe90801c4f0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe924200640 1 -- 172.21.15.73:0/67386346 shutdown_connections 2024-04-15T15:31:34.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe924200640 1 --2- 172.21.15.73:0/67386346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 0x7fe91c0cf810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe924200640 1 --2- 172.21.15.73:0/67386346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 0x7fe91c0b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe924200640 1 -- 172.21.15.73:0/67386346 >> 172.21.15.73:0/67386346 conn(0x7fe91c067e30 msgr2=0x7fe91c0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:34.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe924200640 1 -- 172.21.15.73:0/67386346 shutdown_connections 2024-04-15T15:31:34.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.637+0000 7fe924200640 1 -- 172.21.15.73:0/67386346 wait complete. 2024-04-15T15:31:34.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe924200640 1 Processor -- start 2024-04-15T15:31:34.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe924200640 1 -- start start 2024-04-15T15:31:34.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe924200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91c06ba50 0x7fe91c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:34.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe924200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 0x7fe91c158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:34.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe924200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 0x7fe91c13abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:34.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe924200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c169620 con 0x7fe91c143070 2024-04-15T15:31:34.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe924200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0d0160 con 0x7fe91c06ba50 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe924200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c1697a0 con 0x7fe91c142c90 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe922200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 0x7fe91c13abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe921800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91c06ba50 0x7fe91c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe920e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 0x7fe91c158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe922200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 0x7fe91c13abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58882/0 (socket says 172.21.15.73:58882) 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe922200640 1 -- 172.21.15.73:0/4086337937 learned_addr learned my addr 172.21.15.73:0/4086337937 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe922200640 1 -- 172.21.15.73:0/4086337937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 msgr2=0x7fe91c158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe922200640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 0x7fe91c158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe922200640 1 -- 172.21.15.73:0/4086337937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91c06ba50 msgr2=0x7fe91c06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe922200640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91c06ba50 0x7fe91c06faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe922200640 1 -- 172.21.15.73:0/4086337937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c0cc600 con 0x7fe91c143070 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe922200640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 0x7fe91c13abf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe91400b970 tx=0x7fe91400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe919600640 1 -- 172.21.15.73:0/4086337937 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914019070 con 0x7fe91c143070 2024-04-15T15:31:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe919600640 1 -- 172.21.15.73:0/4086337937 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91400cb40 con 0x7fe91c143070 2024-04-15T15:31:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe924200640 1 -- 172.21.15.73:0/4086337937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91c13dd60 con 0x7fe91c143070 2024-04-15T15:31:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.641+0000 7fe919600640 1 -- 172.21.15.73:0/4086337937 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914014440 con 0x7fe91c143070 2024-04-15T15:31:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.645+0000 7fe924200640 1 -- 172.21.15.73:0/4086337937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91c13e000 con 0x7fe91c143070 2024-04-15T15:31:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.645+0000 7fe924200640 1 -- 172.21.15.73:0/4086337937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91c068b20 con 0x7fe91c143070 2024-04-15T15:31:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.645+0000 7fe919600640 1 -- 172.21.15.73:0/4086337937 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe91401c070 con 0x7fe91c143070 2024-04-15T15:31:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.645+0000 7fe919600640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe8fc068380 0x7fe8fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.645+0000 7fe919600640 1 -- 172.21.15.73:0/4086337937 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe914086570 con 0x7fe91c143070 2024-04-15T15:31:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.645+0000 7fe921800640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe8fc068380 0x7fe8fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.645+0000 7fe921800640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe8fc068380 0x7fe8fc06a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe91c15c290 tx=0x7fe910008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:34.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.649+0000 7fe919600640 1 -- 172.21.15.73:0/4086337937 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe9140564d0 con 0x7fe91c143070 2024-04-15T15:31:34.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:34.813+0000 7fe924200640 1 -- 172.21.15.73:0/4086337937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fe91c0b3ae0 con 0x7fe91c143070 2024-04-15T15:31:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe919600640 1 -- 172.21.15.73:0/4086337937 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fe914084e20 con 0x7fe91c143070 2024-04-15T15:31:35.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 -- 172.21.15.73:0/4086337937 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe8fc068380 msgr2=0x7fe8fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:35.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe8fc068380 0x7fe8fc06a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe91c15c290 tx=0x7fe910008040 comp rx=0 tx=0).stop 2024-04-15T15:31:35.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 -- 172.21.15.73:0/4086337937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 msgr2=0x7fe91c13abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:35.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 0x7fe91c13abf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe91400b970 tx=0x7fe91400be30 comp rx=0 tx=0).stop 2024-04-15T15:31:35.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 -- 172.21.15.73:0/4086337937 shutdown_connections 2024-04-15T15:31:35.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe91c143070 0x7fe91c13abf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:35.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe8fc068380 0x7fe8fc06a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:35.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe91c142c90 0x7fe91c158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:35.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 --2- 172.21.15.73:0/4086337937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91c06ba50 0x7fe91c06faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:35.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 -- 172.21.15.73:0/4086337937 >> 172.21.15.73:0/4086337937 conn(0x7fe91c067e30 msgr2=0x7fe91c15c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:35.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 -- 172.21.15.73:0/4086337937 shutdown_connections 2024-04-15T15:31:35.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.437+0000 7fe924200640 1 -- 172.21.15.73:0/4086337937 wait complete. 2024-04-15T15:31:35.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-15T15:31:35.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb40b400640 1 Processor -- start 2024-04-15T15:31:35.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb40b400640 1 -- start start 2024-04-15T15:31:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb40b400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb4040cd020 0x7fb4040ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb40b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb4040cd400 0x7fb4040ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb40b400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4040ced10 con 0x7fb4040ae790 2024-04-15T15:31:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb40b400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb40406ba50 con 0x7fb4040cd400 2024-04-15T15:31:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb40b400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb40406bd10 con 0x7fb4040cd020 2024-04-15T15:31:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb3fbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb4040cd400 0x7fb4040ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb409400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb4040ae790 0x7fb4040d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44746/0 (socket says 172.21.15.73:44746) 2024-04-15T15:31:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb409400640 1 -- 172.21.15.73:0/2545004901 learned_addr learned my addr 172.21.15.73:0/2545004901 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb408a00640 1 --2- 172.21.15.73:0/2545004901 >> v2:172.21.15.118:3300/0 conn(0x7fb4040cd020 0x7fb4040ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb3fbe00640 1 -- 172.21.15.73:0/2545004901 >> v2:172.21.15.118:3300/0 conn(0x7fb4040cd020 msgr2=0x7fb4040ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb3fbe00640 1 --2- 172.21.15.73:0/2545004901 >> v2:172.21.15.118:3300/0 conn(0x7fb4040cd020 0x7fb4040ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb3fbe00640 1 -- 172.21.15.73:0/2545004901 >> v1:172.21.15.73:6789/0 conn(0x7fb4040ae790 legacy=0x7fb4040d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb403e00640 1 -- 172.21.15.73:0/2545004901 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961398421 0 0) 0x7fb4040ced10 con 0x7fb4040ae790 2024-04-15T15:31:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.605+0000 7fb3fbe00640 1 -- 172.21.15.73:0/2545004901 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40406bff0 con 0x7fb4040cd400 2024-04-15T15:31:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb3fbe00640 1 --2- 172.21.15.73:0/2545004901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040cd400 0x7fb4040ae250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb4040d2500 tx=0x7fb3ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8ea11029a763c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb403e00640 1 -- 172.21.15.73:0/2545004901 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0ab680 con 0x7fb4040cd400 2024-04-15T15:31:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb403e00640 1 -- 172.21.15.73:0/2545004901 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ec0b0070 con 0x7fb4040cd400 2024-04-15T15:31:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb403e00640 1 -- 172.21.15.73:0/2545004901 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0aba40 con 0x7fb4040cd400 2024-04-15T15:31:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb40b400640 1 -- 172.21.15.73:0/2545004901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040cd400 msgr2=0x7fb4040ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb40b400640 1 --2- 172.21.15.73:0/2545004901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040cd400 0x7fb4040ae250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb4040d2500 tx=0x7fb3ec01c480 comp rx=0 tx=0).stop 2024-04-15T15:31:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb40b400640 1 -- 172.21.15.73:0/2545004901 shutdown_connections 2024-04-15T15:31:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb40b400640 1 --2- 172.21.15.73:0/2545004901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040cd400 0x7fb4040ae250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb40b400640 1 --2- 172.21.15.73:0/2545004901 >> v2:172.21.15.118:3300/0 conn(0x7fb4040cd020 0x7fb4040ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb40b400640 1 -- 172.21.15.73:0/2545004901 >> 172.21.15.73:0/2545004901 conn(0x7fb4040b2f70 msgr2=0x7fb4040b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb40b400640 1 -- 172.21.15.73:0/2545004901 shutdown_connections 2024-04-15T15:31:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.609+0000 7fb40b400640 1 -- 172.21.15.73:0/2545004901 wait complete. 2024-04-15T15:31:35.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 Processor -- start 2024-04-15T15:31:35.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 -- start start 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040ae790 0x7fb404150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4040cd020 0x7fb404151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4040cd400 0x7fb4041518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb40415c9d0 con 0x7fb4040ae790 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb4040cd860 con 0x7fb4040cd400 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb40415cb50 con 0x7fb4040cd020 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb408a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040ae790 0x7fb404150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb408a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040ae790 0x7fb404150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58894/0 (socket says 172.21.15.73:58894) 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb408a00640 1 -- 172.21.15.73:0/3499473063 learned_addr learned my addr 172.21.15.73:0/3499473063 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb409400640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4040cd400 0x7fb4041518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb3fbe00640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4040cd020 0x7fb404151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:35.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb408a00640 1 -- 172.21.15.73:0/3499473063 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4040cd020 msgr2=0x7fb404151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:35.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb408a00640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4040cd020 0x7fb404151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:35.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb408a00640 1 -- 172.21.15.73:0/3499473063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4040cd400 msgr2=0x7fb4041518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:35.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb408a00640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4040cd400 0x7fb4041518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:35.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb408a00640 1 -- 172.21.15.73:0/3499473063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4040b1870 con 0x7fb4040ae790 2024-04-15T15:31:35.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb409400640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4040cd400 0x7fb4041518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:35.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb408a00640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040ae790 0x7fb404150a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400d830 tx=0x7fb3f400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:35.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb401600640 1 -- 172.21.15.73:0/3499473063 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400b6c0 con 0x7fb4040ae790 2024-04-15T15:31:35.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb401600640 1 -- 172.21.15.73:0/3499473063 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f4019070 con 0x7fb4040ae790 2024-04-15T15:31:35.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb401600640 1 -- 172.21.15.73:0/3499473063 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400ba60 con 0x7fb4040ae790 2024-04-15T15:31:35.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 -- 172.21.15.73:0/3499473063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4040b58a0 con 0x7fb4040ae790 2024-04-15T15:31:35.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 -- 172.21.15.73:0/3499473063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4040b5e60 con 0x7fb4040ae790 2024-04-15T15:31:35.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.613+0000 7fb40b400640 1 -- 172.21.15.73:0/3499473063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb404068ab0 con 0x7fb4040ae790 2024-04-15T15:31:35.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.617+0000 7fb401600640 1 -- 172.21.15.73:0/3499473063 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3f401e460 con 0x7fb4040ae790 2024-04-15T15:31:35.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.617+0000 7fb401600640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb3e0068380 0x7fb3e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:35.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.617+0000 7fb401600640 1 -- 172.21.15.73:0/3499473063 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fb3f4087280 con 0x7fb4040ae790 2024-04-15T15:31:35.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.617+0000 7fb3fbe00640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb3e0068380 0x7fb3e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.617+0000 7fb3fbe00640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb3e0068380 0x7fb3e006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0af000 tx=0x7fb3ec0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:35.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.621+0000 7fb401600640 1 -- 172.21.15.73:0/3499473063 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb3f4057680 con 0x7fb4040ae790 2024-04-15T15:31:35.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:35.777+0000 7fb40b400640 1 -- 172.21.15.73:0/3499473063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb4040b61a0 con 0x7fb4040ae790 2024-04-15T15:31:37.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.477+0000 7fb401600640 1 -- 172.21.15.73:0/3499473063 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fb3f4056f80 con 0x7fb4040ae790 2024-04-15T15:31:37.478 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data_ec' created 2024-04-15T15:31:37.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.477+0000 7fb40b400640 1 -- 172.21.15.73:0/3499473063 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb3e0068380 msgr2=0x7fb3e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:37.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.477+0000 7fb40b400640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb3e0068380 0x7fb3e006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0af000 tx=0x7fb3ec0a7000 comp rx=0 tx=0).stop 2024-04-15T15:31:37.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.477+0000 7fb40b400640 1 -- 172.21.15.73:0/3499473063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040ae790 msgr2=0x7fb404150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:37.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.477+0000 7fb40b400640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040ae790 0x7fb404150a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400d830 tx=0x7fb3f400dcf0 comp rx=0 tx=0).stop 2024-04-15T15:31:37.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.481+0000 7fb40b400640 1 -- 172.21.15.73:0/3499473063 shutdown_connections 2024-04-15T15:31:37.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.481+0000 7fb40b400640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4040cd400 0x7fb4041518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:37.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.481+0000 7fb40b400640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb3e0068380 0x7fb3e006a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:37.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.481+0000 7fb40b400640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4040cd020 0x7fb404151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:37.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.481+0000 7fb40b400640 1 --2- 172.21.15.73:0/3499473063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040ae790 0x7fb404150a40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:37.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.481+0000 7fb40b400640 1 -- 172.21.15.73:0/3499473063 >> 172.21.15.73:0/3499473063 conn(0x7fb4040b2f70 msgr2=0x7fb4040cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:37.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.481+0000 7fb40b400640 1 -- 172.21.15.73:0/3499473063 shutdown_connections 2024-04-15T15:31:37.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.481+0000 7fb40b400640 1 -- 172.21.15.73:0/3499473063 wait complete. 2024-04-15T15:31:37.513 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-15T15:31:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.653+0000 7fd496600640 1 Processor -- start 2024-04-15T15:31:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.653+0000 7fd496600640 1 -- start start 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd496600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd49009b620 0x7fd49009baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd496600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4900d0120 con 0x7fd49009aa60 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd496600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4900d0400 con 0x7fd4900c6a20 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd496600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd4900d06e0 con 0x7fd49009b620 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48f400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd49009aa60 0x7fd49009ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42344/0 (socket says 172.21.15.73:42344) 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48f400640 1 -- 172.21.15.73:0/2432637436 learned_addr learned my addr 172.21.15.73:0/2432637436 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48ea00640 1 --2- 172.21.15.73:0/2432637436 >> v2:172.21.15.118:3300/0 conn(0x7fd49009b620 0x7fd49009baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48e000640 1 -- 172.21.15.73:0/2432637436 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526438359 0 0) 0x7fd4900d0120 con 0x7fd49009aa60 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48e000640 1 -- 172.21.15.73:0/2432637436 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd474003530 con 0x7fd49009aa60 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48e000640 1 -- 172.21.15.73:0/2432637436 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456989810 0 0) 0x7fd4900d0400 con 0x7fd4900c6a20 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48e000640 1 -- 172.21.15.73:0/2432637436 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4900d0120 con 0x7fd4900c6a20 2024-04-15T15:31:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48e000640 1 -- 172.21.15.73:0/2432637436 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3126027773 0 0) 0x7fd474003530 con 0x7fd49009aa60 2024-04-15T15:31:37.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48ea00640 1 -- 172.21.15.73:0/2432637436 >> v1:172.21.15.118:6789/0 conn(0x7fd4900c6a20 legacy=0x7fd4900c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:37.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48ea00640 1 -- 172.21.15.73:0/2432637436 >> v1:172.21.15.73:6789/0 conn(0x7fd49009aa60 legacy=0x7fd49009ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:37.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.657+0000 7fd48ea00640 1 -- 172.21.15.73:0/2432637436 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4900c6220 con 0x7fd49009b620 2024-04-15T15:31:37.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd48ea00640 1 --2- 172.21.15.73:0/2432637436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49009b620 0x7fd49009baa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0097c0 tx=0x7fd47c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631975f72cbb2c4b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:37.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd48e000640 1 -- 172.21.15.73:0/2432637436 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0b0070 con 0x7fd49009b620 2024-04-15T15:31:37.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd48e000640 1 -- 172.21.15.73:0/2432637436 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47c0ab400 con 0x7fd49009b620 2024-04-15T15:31:37.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd48e000640 1 -- 172.21.15.73:0/2432637436 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49015cd90 con 0x7fd49009b620 2024-04-15T15:31:37.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd496600640 1 -- 172.21.15.73:0/2432637436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49009b620 msgr2=0x7fd49009baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:37.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd496600640 1 --2- 172.21.15.73:0/2432637436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49009b620 0x7fd49009baa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0097c0 tx=0x7fd47c01c390 comp rx=0 tx=0).stop 2024-04-15T15:31:37.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd496600640 1 -- 172.21.15.73:0/2432637436 shutdown_connections 2024-04-15T15:31:37.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd496600640 1 --2- 172.21.15.73:0/2432637436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49009b620 0x7fd49009baa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:37.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd496600640 1 -- 172.21.15.73:0/2432637436 >> 172.21.15.73:0/2432637436 conn(0x7fd4900b4040 msgr2=0x7fd4900b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:37.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd496600640 1 -- 172.21.15.73:0/2432637436 shutdown_connections 2024-04-15T15:31:37.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd496600640 1 -- 172.21.15.73:0/2432637436 wait complete. 2024-04-15T15:31:37.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd496600640 1 Processor -- start 2024-04-15T15:31:37.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.661+0000 7fd496600640 1 -- start start 2024-04-15T15:31:37.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd496600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49009aa60 0x7fd49014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:37.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd496600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49009b620 0x7fd49015f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:37.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd496600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4900c6a20 0x7fd49015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:37.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd496600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd49016a820 con 0x7fd49009aa60 2024-04-15T15:31:37.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd496600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd49016a6a0 con 0x7fd4900c6a20 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd496600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd49016a9a0 con 0x7fd49009b620 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49009aa60 0x7fd49014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49009aa60 0x7fd49014f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45740/0 (socket says 172.21.15.73:45740) 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48f400640 1 -- 172.21.15.73:0/169323918 learned_addr learned my addr 172.21.15.73:0/169323918 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48fe00640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4900c6a20 0x7fd49015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48ea00640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49009b620 0x7fd49015f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48f400640 1 -- 172.21.15.73:0/169323918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49009b620 msgr2=0x7fd49015f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48f400640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49009b620 0x7fd49015f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48f400640 1 -- 172.21.15.73:0/169323918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4900c6a20 msgr2=0x7fd49015cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48f400640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4900c6a20 0x7fd49015cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48f400640 1 -- 172.21.15.73:0/169323918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4900b6010 con 0x7fd49009aa60 2024-04-15T15:31:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd48f400640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49009aa60 0x7fd49014f330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd48000c730 tx=0x7fd48000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:37.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd487400640 1 -- 172.21.15.73:0/169323918 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480017070 con 0x7fd49009aa60 2024-04-15T15:31:37.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd487400640 1 -- 172.21.15.73:0/169323918 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd480005d10 con 0x7fd49009aa60 2024-04-15T15:31:37.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd487400640 1 -- 172.21.15.73:0/169323918 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4800072b0 con 0x7fd49009aa60 2024-04-15T15:31:37.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd496600640 1 -- 172.21.15.73:0/169323918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd49015de10 con 0x7fd49009aa60 2024-04-15T15:31:37.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd496600640 1 -- 172.21.15.73:0/169323918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd49015e3d0 con 0x7fd49009aa60 2024-04-15T15:31:37.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd496600640 1 -- 172.21.15.73:0/169323918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd490068b20 con 0x7fd49009aa60 2024-04-15T15:31:37.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.665+0000 7fd487400640 1 -- 172.21.15.73:0/169323918 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd48001a070 con 0x7fd49009aa60 2024-04-15T15:31:37.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.669+0000 7fd487400640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd470068380 0x7fd47006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:37.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.669+0000 7fd487400640 1 -- 172.21.15.73:0/169323918 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fd480086410 con 0x7fd49009aa60 2024-04-15T15:31:37.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.669+0000 7fd48ea00640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd470068380 0x7fd47006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:37.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.669+0000 7fd48ea00640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd470068380 0x7fd47006a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0ad000 tx=0x7fd47c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:37.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.673+0000 7fd487400640 1 -- 172.21.15.73:0/169323918 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd480056610 con 0x7fd49009aa60 2024-04-15T15:31:37.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:37.829+0000 7fd496600640 1 -- 172.21.15.73:0/169323918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fd4900b7e70 con 0x7fd49009aa60 2024-04-15T15:31:37.915 INFO:tasks.ceph.mds.c.smithi073.stderr:2024-04-15T15:31:37.913+0000 7fda65200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-15T15:31:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.477+0000 7fd487400640 1 -- 172.21.15.73:0/169323918 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7fd480055f10 con 0x7fd49009aa60 2024-04-15T15:31:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:set pool 4 allow_ec_overwrites to true 2024-04-15T15:31:38.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 -- 172.21.15.73:0/169323918 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd470068380 msgr2=0x7fd47006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd470068380 0x7fd47006a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0ad000 tx=0x7fd47c008040 comp rx=0 tx=0).stop 2024-04-15T15:31:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 -- 172.21.15.73:0/169323918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49009aa60 msgr2=0x7fd49014f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49009aa60 0x7fd49014f330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd48000c730 tx=0x7fd48000cbf0 comp rx=0 tx=0).stop 2024-04-15T15:31:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 -- 172.21.15.73:0/169323918 shutdown_connections 2024-04-15T15:31:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4900c6a20 0x7fd49015cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd470068380 0x7fd47006a840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49009b620 0x7fd49015f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 --2- 172.21.15.73:0/169323918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49009aa60 0x7fd49014f330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 -- 172.21.15.73:0/169323918 >> 172.21.15.73:0/169323918 conn(0x7fd4900b4040 msgr2=0x7fd4900d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:38.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 -- 172.21.15.73:0/169323918 shutdown_connections 2024-04-15T15:31:38.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.481+0000 7fd496600640 1 -- 172.21.15.73:0/169323918 wait complete. 2024-04-15T15:31:38.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-15T15:31:38.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.669+0000 7ff3efe00640 1 Processor -- start 2024-04-15T15:31:38.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.669+0000 7ff3efe00640 1 -- start start 2024-04-15T15:31:38.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3efe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3e80b27c0 0x7ff3e815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:38.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3efe00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e8070160 con 0x7ff3e815b5d0 2024-04-15T15:31:38.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3efe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e815f1f0 con 0x7ff3e80b3e30 2024-04-15T15:31:38.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3efe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e815b9b0 con 0x7ff3e80b27c0 2024-04-15T15:31:38.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3ed400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff3e815b5d0 0x7ff3e80b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42360/0 (socket says 172.21.15.73:42360) 2024-04-15T15:31:38.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3ed400640 1 -- 172.21.15.73:0/632523722 learned_addr learned my addr 172.21.15.73:0/632523722 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:38.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3eca00640 1 --2- 172.21.15.73:0/632523722 >> v2:172.21.15.118:3300/0 conn(0x7ff3e80b27c0 0x7ff3e815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:38.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3e7e00640 1 -- 172.21.15.73:0/632523722 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3252034560 0 0) 0x7ff3e8070160 con 0x7ff3e815b5d0 2024-04-15T15:31:38.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3e7e00640 1 -- 172.21.15.73:0/632523722 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3d0003530 con 0x7ff3e815b5d0 2024-04-15T15:31:38.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3eca00640 1 -- 172.21.15.73:0/632523722 >> v1:172.21.15.118:6789/0 conn(0x7ff3e80b3e30 legacy=0x7ff3e80b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:38.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3eca00640 1 -- 172.21.15.73:0/632523722 >> v1:172.21.15.73:6789/0 conn(0x7ff3e815b5d0 legacy=0x7ff3e80b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:38.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3eca00640 1 -- 172.21.15.73:0/632523722 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e806fe80 con 0x7ff3e80b27c0 2024-04-15T15:31:38.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.673+0000 7ff3eca00640 1 --2- 172.21.15.73:0/632523722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e80b27c0 0x7ff3e815fc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40097c0 tx=0x7ff3d401c320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35763daef5f67fd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:38.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3e7e00640 1 -- 172.21.15.73:0/632523722 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d40b0070 con 0x7ff3e80b27c0 2024-04-15T15:31:38.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3e7e00640 1 -- 172.21.15.73:0/632523722 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d40ab600 con 0x7ff3e80b27c0 2024-04-15T15:31:38.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3e7e00640 1 -- 172.21.15.73:0/632523722 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d40ab9d0 con 0x7ff3e80b27c0 2024-04-15T15:31:38.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 -- 172.21.15.73:0/632523722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e80b27c0 msgr2=0x7ff3e815fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:38.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 --2- 172.21.15.73:0/632523722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e80b27c0 0x7ff3e815fc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40097c0 tx=0x7ff3d401c320 comp rx=0 tx=0).stop 2024-04-15T15:31:38.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 -- 172.21.15.73:0/632523722 shutdown_connections 2024-04-15T15:31:38.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 --2- 172.21.15.73:0/632523722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e80b27c0 0x7ff3e815fc90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:38.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 -- 172.21.15.73:0/632523722 >> 172.21.15.73:0/632523722 conn(0x7ff3e8067dd0 msgr2=0x7ff3e80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:38.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 -- 172.21.15.73:0/632523722 shutdown_connections 2024-04-15T15:31:38.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 -- 172.21.15.73:0/632523722 wait complete. 2024-04-15T15:31:38.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 Processor -- start 2024-04-15T15:31:38.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 -- start start 2024-04-15T15:31:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3e80b27c0 0x7ff3e80aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e80b3e30 0x7ff3e80ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e815b5d0 0x7ff3e80ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e806faa0 con 0x7ff3e80b27c0 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80b4240 con 0x7ff3e815b5d0 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3efe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e806fc20 con 0x7ff3e80b3e30 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3ed400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3e80b27c0 0x7ff3e80aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3ed400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3e80b27c0 0x7ff3e80aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45746/0 (socket says 172.21.15.73:45746) 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3ed400640 1 -- 172.21.15.73:0/433272881 learned_addr learned my addr 172.21.15.73:0/433272881 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3eca00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e80b3e30 0x7ff3e80ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.677+0000 7ff3ede00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e815b5d0 0x7ff3e80ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3ed400640 1 -- 172.21.15.73:0/433272881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e80b3e30 msgr2=0x7ff3e80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3ed400640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e80b3e30 0x7ff3e80ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:38.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3ed400640 1 -- 172.21.15.73:0/433272881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e815b5d0 msgr2=0x7ff3e80ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3ed400640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e815b5d0 0x7ff3e80ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3ed400640 1 -- 172.21.15.73:0/433272881 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e80ade40 con 0x7ff3e80b27c0 2024-04-15T15:31:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3ede00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e815b5d0 0x7ff3e80ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3eca00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e80b3e30 0x7ff3e80ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3ed400640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3e80b27c0 0x7ff3e80aeee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c500 tx=0x7ff3dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3e5600640 1 -- 172.21.15.73:0/433272881 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc017070 con 0x7ff3e80b27c0 2024-04-15T15:31:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3e5600640 1 -- 172.21.15.73:0/433272881 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3dc005cf0 con 0x7ff3e80b27c0 2024-04-15T15:31:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3e5600640 1 -- 172.21.15.73:0/433272881 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0072f0 con 0x7ff3e80b27c0 2024-04-15T15:31:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3efe00640 1 -- 172.21.15.73:0/433272881 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e80ae120 con 0x7ff3e80b27c0 2024-04-15T15:31:38.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3efe00640 1 -- 172.21.15.73:0/433272881 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e80ae6e0 con 0x7ff3e80b27c0 2024-04-15T15:31:38.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3efe00640 1 -- 172.21.15.73:0/433272881 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e8068ab0 con 0x7ff3e80b27c0 2024-04-15T15:31:38.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3e5600640 1 -- 172.21.15.73:0/433272881 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff3dc01a070 con 0x7ff3e80b27c0 2024-04-15T15:31:38.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3e5600640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff3c8068380 0x7ff3c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:38.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3e5600640 1 -- 172.21.15.73:0/433272881 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7ff3dc0860a0 con 0x7ff3e80b27c0 2024-04-15T15:31:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.681+0000 7ff3eca00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff3c8068380 0x7ff3c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:38.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.685+0000 7ff3eca00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff3c8068380 0x7ff3c806a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40ad000 tx=0x7ff3d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:38.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.689+0000 7ff3e5600640 1 -- 172.21.15.73:0/433272881 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3dc055ce0 con 0x7ff3e80b27c0 2024-04-15T15:31:38.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:38.877+0000 7ff3efe00640 1 -- 172.21.15.73:0/433272881 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ff3e80b3420 con 0x7ff3e80b27c0 2024-04-15T15:31:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.493+0000 7ff3e5600640 1 -- 172.21.15.73:0/433272881 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7ff3dc059fe0 con 0x7ff3e80b27c0 2024-04-15T15:31:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:added data pool 4 to fsmap 2024-04-15T15:31:39.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 -- 172.21.15.73:0/433272881 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff3c8068380 msgr2=0x7ff3c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:39.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff3c8068380 0x7ff3c806a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40ad000 tx=0x7ff3d4008040 comp rx=0 tx=0).stop 2024-04-15T15:31:39.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 -- 172.21.15.73:0/433272881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3e80b27c0 msgr2=0x7ff3e80aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:39.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3e80b27c0 0x7ff3e80aeee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c500 tx=0x7ff3dc00c9c0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 -- 172.21.15.73:0/433272881 shutdown_connections 2024-04-15T15:31:39.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3e815b5d0 0x7ff3e80ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff3c8068380 0x7ff3c806a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3e80b3e30 0x7ff3e80ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 --2- 172.21.15.73:0/433272881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3e80b27c0 0x7ff3e80aeee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 -- 172.21.15.73:0/433272881 >> 172.21.15.73:0/433272881 conn(0x7ff3e8067dd0 msgr2=0x7ff3e8159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:39.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 -- 172.21.15.73:0/433272881 shutdown_connections 2024-04-15T15:31:39.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.497+0000 7ff3efe00640 1 -- 172.21.15.73:0/433272881 wait complete. 2024-04-15T15:31:39.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:31:39.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.653+0000 7f7c5ea00640 1 Processor -- start 2024-04-15T15:31:39.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.653+0000 7f7c5ea00640 1 -- start start 2024-04-15T15:31:39.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c5ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 0x7f7c580cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:39.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c5ea00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7c580b20b0 0x7f7c580b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:39.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c5ea00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c580cd3a0 con 0x7f7c58071e10 2024-04-15T15:31:39.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c5ea00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f7c580b5160 con 0x7f7c580b20b0 2024-04-15T15:31:39.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c5ea00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7c580b40c0 con 0x7f7c58146110 2024-04-15T15:31:39.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c5ca00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7c58071e10 0x7f7c580722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:40366/0 (socket says 172.21.15.73:40366) 2024-04-15T15:31:39.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c57400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7c580b20b0 0x7f7c580b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:39.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c5ca00640 1 -- 172.21.15.73:0/3442724744 learned_addr learned my addr 172.21.15.73:0/3442724744 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:39.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c57e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 0x7f7c580cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:39.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c56a00640 1 -- 172.21.15.73:0/3442724744 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3145391126 0 0) 0x7f7c580cd3a0 con 0x7f7c58071e10 2024-04-15T15:31:39.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c56a00640 1 -- 172.21.15.73:0/3442724744 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c3c003530 con 0x7f7c58071e10 2024-04-15T15:31:39.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c57400640 1 -- 172.21.15.73:0/3442724744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 msgr2=0x7f7c580cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:39.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c57400640 1 --2- 172.21.15.73:0/3442724744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 0x7f7c580cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c57400640 1 -- 172.21.15.73:0/3442724744 >> v1:172.21.15.118:6789/0 conn(0x7f7c58071e10 legacy=0x7f7c580722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:39.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c57400640 1 -- 172.21.15.73:0/3442724744 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c580b43a0 con 0x7f7c580b20b0 2024-04-15T15:31:39.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.657+0000 7f7c57e00640 1 --2- 172.21.15.73:0/3442724744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 0x7f7c580cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:39.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c57400640 1 --2- 172.21.15.73:0/3442724744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c580b20b0 0x7f7c580b2530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c480097c0 tx=0x7f7c4801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dc3d1d22efa7311 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:39.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c56a00640 1 -- 172.21.15.73:0/3442724744 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c480b2070 con 0x7f7c580b20b0 2024-04-15T15:31:39.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c56a00640 1 -- 172.21.15.73:0/3442724744 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c480ad640 con 0x7f7c580b20b0 2024-04-15T15:31:39.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c56a00640 1 -- 172.21.15.73:0/3442724744 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c480ada10 con 0x7f7c580b20b0 2024-04-15T15:31:39.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c5ea00640 1 -- 172.21.15.73:0/3442724744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c580b20b0 msgr2=0x7f7c580b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:39.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c5ea00640 1 --2- 172.21.15.73:0/3442724744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c580b20b0 0x7f7c580b2530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c480097c0 tx=0x7f7c4801c4a0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c5ea00640 1 -- 172.21.15.73:0/3442724744 shutdown_connections 2024-04-15T15:31:39.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c5ea00640 1 --2- 172.21.15.73:0/3442724744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c580b20b0 0x7f7c580b2530 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c5ea00640 1 --2- 172.21.15.73:0/3442724744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 0x7f7c580cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c5ea00640 1 -- 172.21.15.73:0/3442724744 >> 172.21.15.73:0/3442724744 conn(0x7f7c58067dd0 msgr2=0x7f7c580d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:39.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c5ea00640 1 -- 172.21.15.73:0/3442724744 shutdown_connections 2024-04-15T15:31:39.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c5ea00640 1 -- 172.21.15.73:0/3442724744 wait complete. 2024-04-15T15:31:39.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.661+0000 7f7c5ea00640 1 Processor -- start 2024-04-15T15:31:39.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ea00640 1 -- start start 2024-04-15T15:31:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c58071e10 0x7f7c58132110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c580b20b0 0x7f7c581449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 0x7f7c58144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ea00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7c580cdcf0 con 0x7f7c580b20b0 2024-04-15T15:31:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7c580b3d70 con 0x7f7c58071e10 2024-04-15T15:31:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ea00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5815dbe0 con 0x7f7c58146110 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c57400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c580b20b0 0x7f7c581449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c57400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c580b20b0 0x7f7c581449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45762/0 (socket says 172.21.15.73:45762) 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c57400640 1 -- 172.21.15.73:0/803353678 learned_addr learned my addr 172.21.15.73:0/803353678 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c57e00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c58071e10 0x7f7c58132110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ca00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 0x7f7c58144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c57400640 1 -- 172.21.15.73:0/803353678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 msgr2=0x7f7c58144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c57400640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 0x7f7c58144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c57400640 1 -- 172.21.15.73:0/803353678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c58071e10 msgr2=0x7f7c58132110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c57400640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c58071e10 0x7f7c58132110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c57400640 1 -- 172.21.15.73:0/803353678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5806ef10 con 0x7f7c580b20b0 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ca00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 0x7f7c58144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c57400640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c580b20b0 0x7f7c581449a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c480b0040 tx=0x7f7c48019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c4fe00640 1 -- 172.21.15.73:0/803353678 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c480ba070 con 0x7f7c580b20b0 2024-04-15T15:31:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c4fe00640 1 -- 172.21.15.73:0/803353678 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c480b6410 con 0x7f7c580b20b0 2024-04-15T15:31:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ea00640 1 -- 172.21.15.73:0/803353678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5806f1f0 con 0x7f7c580b20b0 2024-04-15T15:31:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c4fe00640 1 -- 172.21.15.73:0/803353678 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c480b2040 con 0x7f7c580b20b0 2024-04-15T15:31:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ea00640 1 -- 172.21.15.73:0/803353678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5806f7b0 con 0x7f7c580b20b0 2024-04-15T15:31:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.665+0000 7f7c5ea00640 1 -- 172.21.15.73:0/803353678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c58068ab0 con 0x7f7c580b20b0 2024-04-15T15:31:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.669+0000 7f7c4fe00640 1 -- 172.21.15.73:0/803353678 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c480bd070 con 0x7f7c580b20b0 2024-04-15T15:31:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.669+0000 7f7c4fe00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c34068380 0x7f7c3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.669+0000 7f7c4fe00640 1 -- 172.21.15.73:0/803353678 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7c48120fa0 con 0x7f7c580b20b0 2024-04-15T15:31:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.669+0000 7f7c57e00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c34068380 0x7f7c3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.669+0000 7f7c57e00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c34068380 0x7f7c3406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c58142d50 tx=0x7f7c40009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.673+0000 7f7c4fe00640 1 -- 172.21.15.73:0/803353678 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c48016090 con 0x7f7c580b20b0 2024-04-15T15:31:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 -- 172.21.15.73:0/803353678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c580d03f0 con 0x7f7c580b20b0 2024-04-15T15:31:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c4fe00640 1 -- 172.21.15.73:0/803353678 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5180 (secure 0 0 0) 0x7f7c480f0ce0 con 0x7f7c580b20b0 2024-04-15T15:31:39.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:39.867 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:31:33.826027+0000","modified":"2024-04-15T15:31:38.883491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-15T15:31:39.868 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2024-04-15T15:31:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 -- 172.21.15.73:0/803353678 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c34068380 msgr2=0x7f7c3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c34068380 0x7f7c3406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c58142d50 tx=0x7f7c40009190 comp rx=0 tx=0).stop 2024-04-15T15:31:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 -- 172.21.15.73:0/803353678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c580b20b0 msgr2=0x7f7c581449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c580b20b0 0x7f7c581449a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c480b0040 tx=0x7f7c48019240 comp rx=0 tx=0).stop 2024-04-15T15:31:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 -- 172.21.15.73:0/803353678 shutdown_connections 2024-04-15T15:31:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c34068380 0x7f7c3406a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c58146110 0x7f7c58144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c580b20b0 0x7f7c581449a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 --2- 172.21.15.73:0/803353678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c58071e10 0x7f7c58132110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 -- 172.21.15.73:0/803353678 >> 172.21.15.73:0/803353678 conn(0x7f7c58067dd0 msgr2=0x7f7c58143890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 -- 172.21.15.73:0/803353678 shutdown_connections 2024-04-15T15:31:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:39.865+0000 7f7c5ea00640 1 -- 172.21.15.73:0/803353678 wait complete. 2024-04-15T15:31:39.888 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:40.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2eb200640 1 Processor -- start 2024-04-15T15:31:40.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2eb200640 1 -- start start 2024-04-15T15:31:40.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2eb200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e415c6d0 0x7fe2e40d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2eb200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe2e40cd1b0 0x7fe2e40d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2eb200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e40cd690 con 0x7fe2e415cab0 2024-04-15T15:31:40.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2eb200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e40cd970 con 0x7fe2e40cd1b0 2024-04-15T15:31:40.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2eb200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e40cdc50 con 0x7fe2e415c6d0 2024-04-15T15:31:40.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2e3400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe2e40cd1b0 0x7fe2e40d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2e9200640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe2e415cab0 0x7fe2e409aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42374/0 (socket says 172.21.15.73:42374) 2024-04-15T15:31:40.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2e9200640 1 -- 172.21.15.73:0/967018438 learned_addr learned my addr 172.21.15.73:0/967018438 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:40.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2e3e00640 1 --2- 172.21.15.73:0/967018438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e415c6d0 0x7fe2e40d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2e3400640 1 -- 172.21.15.73:0/967018438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e415c6d0 msgr2=0x7fe2e40d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:40.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2e3400640 1 --2- 172.21.15.73:0/967018438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e415c6d0 0x7fe2e40d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2e2a00640 1 -- 172.21.15.73:0/967018438 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 160133909 0 0) 0x7fe2e40cd690 con 0x7fe2e415cab0 2024-04-15T15:31:40.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2e3400640 1 -- 172.21.15.73:0/967018438 >> v1:172.21.15.73:6789/0 conn(0x7fe2e415cab0 legacy=0x7fe2e409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2e3400640 1 -- 172.21.15.73:0/967018438 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e40cdf30 con 0x7fe2e40cd1b0 2024-04-15T15:31:40.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.025+0000 7fe2e3e00640 1 --2- 172.21.15.73:0/967018438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e415c6d0 0x7fe2e40d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:40.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2e3400640 1 --2- 172.21.15.73:0/967018438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e40cd1b0 0x7fe2e40d12b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40097c0 tx=0x7fe2d401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ce9f5101443a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:40.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2e2a00640 1 -- 172.21.15.73:0/967018438 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40aa5f0 con 0x7fe2e40cd1b0 2024-04-15T15:31:40.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2e2a00640 1 -- 172.21.15.73:0/967018438 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d40af070 con 0x7fe2e40cd1b0 2024-04-15T15:31:40.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2e2a00640 1 -- 172.21.15.73:0/967018438 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40aa9b0 con 0x7fe2e40cd1b0 2024-04-15T15:31:40.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2eb200640 1 -- 172.21.15.73:0/967018438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e40cd1b0 msgr2=0x7fe2e40d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2eb200640 1 --2- 172.21.15.73:0/967018438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e40cd1b0 0x7fe2e40d12b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40097c0 tx=0x7fe2d401c470 comp rx=0 tx=0).stop 2024-04-15T15:31:40.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2eb200640 1 -- 172.21.15.73:0/967018438 shutdown_connections 2024-04-15T15:31:40.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2eb200640 1 --2- 172.21.15.73:0/967018438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e40cd1b0 0x7fe2e40d12b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2eb200640 1 --2- 172.21.15.73:0/967018438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e415c6d0 0x7fe2e40d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2eb200640 1 -- 172.21.15.73:0/967018438 >> 172.21.15.73:0/967018438 conn(0x7fe2e40b3fe0 msgr2=0x7fe2e40b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:40.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2eb200640 1 -- 172.21.15.73:0/967018438 shutdown_connections 2024-04-15T15:31:40.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.029+0000 7fe2eb200640 1 -- 172.21.15.73:0/967018438 wait complete. 2024-04-15T15:31:40.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 Processor -- start 2024-04-15T15:31:40.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 -- start start 2024-04-15T15:31:40.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e40cd1b0 0x7fe2e41570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2e415c6d0 0x7fe2e40b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e415cab0 0x7fe2e40b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e40b1c20 con 0x7fe2e415cab0 2024-04-15T15:31:40.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e40b1aa0 con 0x7fe2e415c6d0 2024-04-15T15:31:40.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e40b1da0 con 0x7fe2e40cd1b0 2024-04-15T15:31:40.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e415cab0 0x7fe2e40b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e40cd1b0 0x7fe2e41570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e415cab0 0x7fe2e40b7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45770/0 (socket says 172.21.15.73:45770) 2024-04-15T15:31:40.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e9200640 1 -- 172.21.15.73:0/266911834 learned_addr learned my addr 172.21.15.73:0/266911834 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:40.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2e415c6d0 0x7fe2e40b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e40cd1b0 0x7fe2e41570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:41382/0 (socket says 172.21.15.73:41382) 2024-04-15T15:31:40.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e9200640 1 -- 172.21.15.73:0/266911834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e40cd1b0 msgr2=0x7fe2e41570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e9200640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e40cd1b0 0x7fe2e41570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e9200640 1 -- 172.21.15.73:0/266911834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2e415c6d0 msgr2=0x7fe2e40b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e9200640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2e415c6d0 0x7fe2e40b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e9200640 1 -- 172.21.15.73:0/266911834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e40ca2d0 con 0x7fe2e415cab0 2024-04-15T15:31:40.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2e9200640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e415cab0 0x7fe2e40b7ae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00c7b0 tx=0x7fe2dc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:40.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2dbe00640 1 -- 172.21.15.73:0/266911834 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc018070 con 0x7fe2e415cab0 2024-04-15T15:31:40.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2dbe00640 1 -- 172.21.15.73:0/266911834 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2dc00a640 con 0x7fe2e415cab0 2024-04-15T15:31:40.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 -- 172.21.15.73:0/266911834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e40ca5b0 con 0x7fe2e415cab0 2024-04-15T15:31:40.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2dbe00640 1 -- 172.21.15.73:0/266911834 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00aa30 con 0x7fe2e415cab0 2024-04-15T15:31:40.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 -- 172.21.15.73:0/266911834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e40b53d0 con 0x7fe2e415cab0 2024-04-15T15:31:40.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.033+0000 7fe2eb200640 1 -- 172.21.15.73:0/266911834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e4068ab0 con 0x7fe2e415cab0 2024-04-15T15:31:40.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.037+0000 7fe2dbe00640 1 -- 172.21.15.73:0/266911834 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe2dc01b070 con 0x7fe2e415cab0 2024-04-15T15:31:40.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.037+0000 7fe2dbe00640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe2c0068380 0x7fe2c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.037+0000 7fe2dbe00640 1 -- 172.21.15.73:0/266911834 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe2dc086290 con 0x7fe2e415cab0 2024-04-15T15:31:40.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.037+0000 7fe2e3e00640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe2c0068380 0x7fe2c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.037+0000 7fe2e3e00640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe2c0068380 0x7fe2c006a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00ab60 tx=0x7fe2cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:40.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.041+0000 7fe2dbe00640 1 -- 172.21.15.73:0/266911834 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe2dc055e20 con 0x7fe2e415cab0 2024-04-15T15:31:40.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.197+0000 7fe2eb200640 1 -- 172.21.15.73:0/266911834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2e40b4d80 con 0x7fe2e415cab0 2024-04-15T15:31:40.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2dbe00640 1 -- 172.21.15.73:0/266911834 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fe2dc05a120 con 0x7fe2e415cab0 2024-04-15T15:31:40.203 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:40.203 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 -- 172.21.15.73:0/266911834 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe2c0068380 msgr2=0x7fe2c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe2c0068380 0x7fe2c006a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00ab60 tx=0x7fe2cc008040 comp rx=0 tx=0).stop 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 -- 172.21.15.73:0/266911834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e415cab0 msgr2=0x7fe2e40b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e415cab0 0x7fe2e40b7ae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00c7b0 tx=0x7fe2dc00cc70 comp rx=0 tx=0).stop 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 -- 172.21.15.73:0/266911834 shutdown_connections 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2e415cab0 0x7fe2e40b7ae0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2e415c6d0 0x7fe2e40b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe2c0068380 0x7fe2c006a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 --2- 172.21.15.73:0/266911834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2e40cd1b0 0x7fe2e41570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 -- 172.21.15.73:0/266911834 >> 172.21.15.73:0/266911834 conn(0x7fe2e40b3fe0 msgr2=0x7fe2e40b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 -- 172.21.15.73:0/266911834 shutdown_connections 2024-04-15T15:31:40.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.201+0000 7fe2eb200640 1 -- 172.21.15.73:0/266911834 wait complete. 2024-04-15T15:31:40.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:40.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1db2600640 1 Processor -- start 2024-04-15T15:31:40.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1db2600640 1 -- start start 2024-04-15T15:31:40.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1db2600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1dac15c860 0x7f1dac0d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1db2600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1dac0d1230 0x7f1dac0704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1db2600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dac09be00 con 0x7f1dac0d0670 2024-04-15T15:31:40.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1db2600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1dac15cc40 con 0x7f1dac15c860 2024-04-15T15:31:40.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1db2600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f1dac070040 con 0x7f1dac0d1230 2024-04-15T15:31:40.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1da2a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1dac0d0670 0x7f1dac0d0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42388/0 (socket says 172.21.15.73:42388) 2024-04-15T15:31:40.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1da2a00640 1 -- 172.21.15.73:0/4144167973 learned_addr learned my addr 172.21.15.73:0/4144167973 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:40.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1dab400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1dac15c860 0x7f1dac0d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1dabe00640 1 --2- 172.21.15.73:0/4144167973 >> v2:172.21.15.118:3300/0 conn(0x7f1dac0d1230 0x7f1dac0704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1daaa00640 1 -- 172.21.15.73:0/4144167973 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322253420 0 0) 0x7f1dac09be00 con 0x7f1dac0d0670 2024-04-15T15:31:40.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1daaa00640 1 -- 172.21.15.73:0/4144167973 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d90003530 con 0x7f1dac0d0670 2024-04-15T15:31:40.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1dab400640 1 -- 172.21.15.73:0/4144167973 >> v2:172.21.15.118:3300/0 conn(0x7f1dac0d1230 msgr2=0x7f1dac0704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:40.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1dab400640 1 --2- 172.21.15.73:0/4144167973 >> v2:172.21.15.118:3300/0 conn(0x7f1dac0d1230 0x7f1dac0704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1dab400640 1 -- 172.21.15.73:0/4144167973 >> v1:172.21.15.73:6789/0 conn(0x7f1dac0d0670 legacy=0x7f1dac0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.357+0000 7f1dab400640 1 -- 172.21.15.73:0/4144167973 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac09b5a0 con 0x7f1dac15c860 2024-04-15T15:31:40.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1dab400640 1 --2- 172.21.15.73:0/4144167973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 0x7f1dac0d0130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1dac073640 tx=0x7f1d9c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c520d4b64859f94d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:40.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1daaa00640 1 -- 172.21.15.73:0/4144167973 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c0b1070 con 0x7f1dac15c860 2024-04-15T15:31:40.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1daaa00640 1 -- 172.21.15.73:0/4144167973 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c0ac620 con 0x7f1dac15c860 2024-04-15T15:31:40.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1daaa00640 1 -- 172.21.15.73:0/4144167973 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c0ac9f0 con 0x7f1dac15c860 2024-04-15T15:31:40.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1db2600640 1 -- 172.21.15.73:0/4144167973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 msgr2=0x7f1dac0d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1db2600640 1 --2- 172.21.15.73:0/4144167973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 0x7f1dac0d0130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1dac073640 tx=0x7f1d9c01c3c0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1db2600640 1 -- 172.21.15.73:0/4144167973 shutdown_connections 2024-04-15T15:31:40.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1db2600640 1 --2- 172.21.15.73:0/4144167973 >> v2:172.21.15.118:3300/0 conn(0x7f1dac0d1230 0x7f1dac0704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1db2600640 1 --2- 172.21.15.73:0/4144167973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 0x7f1dac0d0130 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1db2600640 1 -- 172.21.15.73:0/4144167973 >> 172.21.15.73:0/4144167973 conn(0x7f1dac0b4050 msgr2=0x7f1dac0b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:40.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1db2600640 1 -- 172.21.15.73:0/4144167973 shutdown_connections 2024-04-15T15:31:40.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.361+0000 7f1db2600640 1 -- 172.21.15.73:0/4144167973 wait complete. 2024-04-15T15:31:40.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 Processor -- start 2024-04-15T15:31:40.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 -- start start 2024-04-15T15:31:40.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac0d0670 0x7f1dac0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1dac0d1230 0x7f1dac14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 0x7f1dac0b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac0713a0 con 0x7f1dac15c860 2024-04-15T15:31:40.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac071220 con 0x7f1dac0d0670 2024-04-15T15:31:40.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1dac071520 con 0x7f1dac0d1230 2024-04-15T15:31:40.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dabe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 0x7f1dac0b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dabe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 0x7f1dac0b7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45788/0 (socket says 172.21.15.73:45788) 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dabe00640 1 -- 172.21.15.73:0/2962062006 learned_addr learned my addr 172.21.15.73:0/2962062006 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dab400640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac0d0670 0x7f1dac0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1da2a00640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1dac0d1230 0x7f1dac14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dabe00640 1 -- 172.21.15.73:0/2962062006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1dac0d1230 msgr2=0x7f1dac14fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dabe00640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1dac0d1230 0x7f1dac14fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dabe00640 1 -- 172.21.15.73:0/2962062006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac0d0670 msgr2=0x7f1dac0ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dabe00640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac0d0670 0x7f1dac0ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dabe00640 1 -- 172.21.15.73:0/2962062006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac0caf30 con 0x7f1dac15c860 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dab400640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac0d0670 0x7f1dac0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:40.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1dabe00640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 0x7f1dac0b7460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1da400ef90 tx=0x7f1da400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:40.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1da3e00640 1 -- 172.21.15.73:0/2962062006 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4018020 con 0x7f1dac15c860 2024-04-15T15:31:40.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1da3e00640 1 -- 172.21.15.73:0/2962062006 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da4014480 con 0x7f1dac15c860 2024-04-15T15:31:40.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 -- 172.21.15.73:0/2962062006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac0b66a0 con 0x7f1dac15c860 2024-04-15T15:31:40.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1da3e00640 1 -- 172.21.15.73:0/2962062006 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4014870 con 0x7f1dac15c860 2024-04-15T15:31:40.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 -- 172.21.15.73:0/2962062006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac0b6c60 con 0x7f1dac15c860 2024-04-15T15:31:40.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.365+0000 7f1db2600640 1 -- 172.21.15.73:0/2962062006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac068ab0 con 0x7f1dac15c860 2024-04-15T15:31:40.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.369+0000 7f1da3e00640 1 -- 172.21.15.73:0/2962062006 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1da401b020 con 0x7f1dac15c860 2024-04-15T15:31:40.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.369+0000 7f1da3e00640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1d880683b0 0x7f1d8806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.369+0000 7f1da3e00640 1 -- 172.21.15.73:0/2962062006 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1da4087b80 con 0x7f1dac15c860 2024-04-15T15:31:40.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.369+0000 7f1dab400640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1d880683b0 0x7f1d8806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.369+0000 7f1dab400640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1d880683b0 0x7f1d8806a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0ae000 tx=0x7f1d9c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:40.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.373+0000 7f1da3e00640 1 -- 172.21.15.73:0/2962062006 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1da4022030 con 0x7f1dac15c860 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.537+0000 7f1db2600640 1 -- 172.21.15.73:0/2962062006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dac0af9a0 con 0x7f1dac15c860 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1da3e00640 1 -- 172.21.15.73:0/2962062006 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f1da4010040 con 0x7f1dac15c860 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 -- 172.21.15.73:0/2962062006 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1d880683b0 msgr2=0x7f1d8806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1d880683b0 0x7f1d8806a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0ae000 tx=0x7f1d9c0a7000 comp rx=0 tx=0).stop 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 -- 172.21.15.73:0/2962062006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 msgr2=0x7f1dac0b7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 0x7f1dac0b7460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1da400ef90 tx=0x7f1da400c490 comp rx=0 tx=0).stop 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 -- 172.21.15.73:0/2962062006 shutdown_connections 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dac15c860 0x7f1dac0b7460 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1d880683b0 0x7f1d8806a870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1dac0d1230 0x7f1dac14fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 --2- 172.21.15.73:0/2962062006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac0d0670 0x7f1dac0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 -- 172.21.15.73:0/2962062006 >> 172.21.15.73:0/2962062006 conn(0x7f1dac0b4050 msgr2=0x7f1dac0b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 -- 172.21.15.73:0/2962062006 shutdown_connections 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.541+0000 7f1db2600640 1 -- 172.21.15.73:0/2962062006 wait complete. 2024-04-15T15:31:40.578 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.709+0000 7fbe41e00640 1 Processor -- start 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.709+0000 7fbe41e00640 1 -- start start 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe3c15fa60 0x7fbe3c0b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe3c0b3250 0x7fbe3c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3c0ccfe0 con 0x7fbe3c15fe40 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbe3c0d09f0 con 0x7fbe3c0b3250 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbe3c0d0cd0 con 0x7fbe3c15fa60 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe3c0b3250 0x7fbe3c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe3c0b3250 0x7fbe3c0cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45802/0 (socket says 172.21.15.73:45802) 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41400640 1 -- 172.21.15.73:0/1550584022 learned_addr learned my addr 172.21.15.73:0/1550584022 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe40a00640 1 --2- 172.21.15.73:0/1550584022 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe3c15fa60 0x7fbe3c0b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41400640 1 -- 172.21.15.73:0/1550584022 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe3c15fa60 msgr2=0x7fbe3c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41400640 1 --2- 172.21.15.73:0/1550584022 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe3c15fa60 0x7fbe3c0b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41400640 1 -- 172.21.15.73:0/1550584022 >> v1:172.21.15.118:6789/0 conn(0x7fbe3c15fe40 legacy=0x7fbe3c0cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41400640 1 -- 172.21.15.73:0/1550584022 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c0d0fb0 con 0x7fbe3c0b3250 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.713+0000 7fbe41400640 1 --2- 172.21.15.73:0/1550584022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c0b3250 0x7fbe3c0cdbd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009e50 tx=0x7fbe3401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda946c1b2272df0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe3be00640 1 -- 172.21.15.73:0/1550584022 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe340a56e0 con 0x7fbe3c0b3250 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe3be00640 1 -- 172.21.15.73:0/1550584022 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe340a5880 con 0x7fbe3c0b3250 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe3be00640 1 -- 172.21.15.73:0/1550584022 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe340a5c50 con 0x7fbe3c0b3250 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 -- 172.21.15.73:0/1550584022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c0b3250 msgr2=0x7fbe3c0cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 --2- 172.21.15.73:0/1550584022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c0b3250 0x7fbe3c0cdbd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009e50 tx=0x7fbe3401c9d0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 -- 172.21.15.73:0/1550584022 shutdown_connections 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 --2- 172.21.15.73:0/1550584022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c0b3250 0x7fbe3c0cdbd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 --2- 172.21.15.73:0/1550584022 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe3c15fa60 0x7fbe3c0b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 -- 172.21.15.73:0/1550584022 >> 172.21.15.73:0/1550584022 conn(0x7fbe3c0b3e60 msgr2=0x7fbe3c0b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 -- 172.21.15.73:0/1550584022 shutdown_connections 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 -- 172.21.15.73:0/1550584022 wait complete. 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 Processor -- start 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 -- start start 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe3c0b3250 0x7fbe3c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c15fa60 0x7fbe3c0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe3c15fe40 0x7fbe3c0c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c160d10 con 0x7fbe3c15fa60 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c160b90 con 0x7fbe3c15fe40 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbe3c160e90 con 0x7fbe3c0b3250 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe33e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c15fa60 0x7fbe3c0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe33e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c15fa60 0x7fbe3c0cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45804/0 (socket says 172.21.15.73:45804) 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe33e00640 1 -- 172.21.15.73:0/48468380 learned_addr learned my addr 172.21.15.73:0/48468380 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe41400640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe3c15fe40 0x7fbe3c0c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe40a00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe3c0b3250 0x7fbe3c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe33e00640 1 -- 172.21.15.73:0/48468380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe3c0b3250 msgr2=0x7fbe3c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.717+0000 7fbe33e00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe3c0b3250 0x7fbe3c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe33e00640 1 -- 172.21.15.73:0/48468380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe3c15fe40 msgr2=0x7fbe3c0c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe33e00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe3c15fe40 0x7fbe3c0c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe33e00640 1 -- 172.21.15.73:0/48468380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c159070 con 0x7fbe3c15fa60 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe33e00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c15fa60 0x7fbe3c0cb8e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c370 tx=0x7fbe2400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe39600640 1 -- 172.21.15.73:0/48468380 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe240052d0 con 0x7fbe3c15fa60 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe39600640 1 -- 172.21.15.73:0/48468380 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe24005470 con 0x7fbe3c15fa60 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe39600640 1 -- 172.21.15.73:0/48468380 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe24007260 con 0x7fbe3c15fa60 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe41e00640 1 -- 172.21.15.73:0/48468380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3c159350 con 0x7fbe3c15fa60 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe41e00640 1 -- 172.21.15.73:0/48468380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe3c159910 con 0x7fbe3c15fa60 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe41e00640 1 -- 172.21.15.73:0/48468380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe3c04fd60 con 0x7fbe3c15fa60 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe39600640 1 -- 172.21.15.73:0/48468380 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe24007400 con 0x7fbe3c15fa60 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe39600640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe180683b0 0x7fbe1806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe39600640 1 -- 172.21.15.73:0/48468380 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbe24086200 con 0x7fbe3c15fa60 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.721+0000 7fbe40a00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe180683b0 0x7fbe1806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.725+0000 7fbe40a00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe180683b0 0x7fbe1806a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0b81d0 tx=0x7fbe2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.725+0000 7fbe39600640 1 -- 172.21.15.73:0/48468380 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe240563e0 con 0x7fbe3c15fa60 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.913+0000 7fbe41e00640 1 -- 172.21.15.73:0/48468380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe3c0ce7d0 con 0x7fbe3c15fa60 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe39600640 1 -- 172.21.15.73:0/48468380 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5180 (secure 0 0 0) 0x7fbe24055ce0 con 0x7fbe3c15fa60 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:31:33.826027+0000","modified":"2024-04-15T15:31:38.883491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 -- 172.21.15.73:0/48468380 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe180683b0 msgr2=0x7fbe1806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe180683b0 0x7fbe1806a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0b81d0 tx=0x7fbe2c008040 comp rx=0 tx=0).stop 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 -- 172.21.15.73:0/48468380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c15fa60 msgr2=0x7fbe3c0cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c15fa60 0x7fbe3c0cb8e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c370 tx=0x7fbe2400c830 comp rx=0 tx=0).stop 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 -- 172.21.15.73:0/48468380 shutdown_connections 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe3c15fe40 0x7fbe3c0c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe3c15fa60 0x7fbe3c0cb8e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe180683b0 0x7fbe1806a870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 --2- 172.21.15.73:0/48468380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe3c0b3250 0x7fbe3c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 -- 172.21.15.73:0/48468380 >> 172.21.15.73:0/48468380 conn(0x7fbe3c0b3e60 msgr2=0x7fbe3c1583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 -- 172.21.15.73:0/48468380 shutdown_connections 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:40.917+0000 7fbe41e00640 1 -- 172.21.15.73:0/48468380 wait complete. 2024-04-15T15:31:40.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7ea000640 1 Processor -- start 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7ea000640 1 -- start start 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7ea000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff7e40b20b0 0x7ff7e40b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7ea000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7e415cbd0 0x7ff7e415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7ea000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e40cd3a0 con 0x7ff7e4146110 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7ea000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff7e40b5160 con 0x7ff7e415cbd0 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7ea000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ff7e40b40c0 con 0x7ff7e40b20b0 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7e3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7e415cbd0 0x7ff7e415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7e3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7e415cbd0 0x7ff7e415d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45820/0 (socket says 172.21.15.73:45820) 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7e3e00640 1 -- 172.21.15.73:0/2133695350 learned_addr learned my addr 172.21.15.73:0/2133695350 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7daa00640 1 --2- 172.21.15.73:0/2133695350 >> v2:172.21.15.118:3300/0 conn(0x7ff7e40b20b0 0x7ff7e40b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7e3e00640 1 -- 172.21.15.73:0/2133695350 >> v2:172.21.15.118:3300/0 conn(0x7ff7e40b20b0 msgr2=0x7ff7e40b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7e3e00640 1 --2- 172.21.15.73:0/2133695350 >> v2:172.21.15.118:3300/0 conn(0x7ff7e40b20b0 0x7ff7e40b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7e3e00640 1 -- 172.21.15.73:0/2133695350 >> v1:172.21.15.118:6789/0 conn(0x7ff7e4146110 legacy=0x7ff7e40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.073+0000 7ff7e3e00640 1 -- 172.21.15.73:0/2133695350 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e40b43a0 con 0x7ff7e415cbd0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7e3e00640 1 --2- 172.21.15.73:0/2133695350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e415cbd0 0x7ff7e415d020 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40cd570 tx=0x7ff7dc01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc050e99aff278b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7e2a00640 1 -- 172.21.15.73:0/2133695350 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0a5760 con 0x7ff7e415cbd0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7e2a00640 1 -- 172.21.15.73:0/2133695350 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc0a5900 con 0x7ff7e415cbd0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7e2a00640 1 -- 172.21.15.73:0/2133695350 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0a5cd0 con 0x7ff7e415cbd0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7ea000640 1 -- 172.21.15.73:0/2133695350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e415cbd0 msgr2=0x7ff7e415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7ea000640 1 --2- 172.21.15.73:0/2133695350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e415cbd0 0x7ff7e415d020 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40cd570 tx=0x7ff7dc01c9b0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7ea000640 1 -- 172.21.15.73:0/2133695350 shutdown_connections 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7ea000640 1 --2- 172.21.15.73:0/2133695350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e415cbd0 0x7ff7e415d020 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7ea000640 1 --2- 172.21.15.73:0/2133695350 >> v2:172.21.15.118:3300/0 conn(0x7ff7e40b20b0 0x7ff7e40b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7ea000640 1 -- 172.21.15.73:0/2133695350 >> 172.21.15.73:0/2133695350 conn(0x7ff7e4067dd0 msgr2=0x7ff7e40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7ea000640 1 -- 172.21.15.73:0/2133695350 shutdown_connections 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.077+0000 7ff7ea000640 1 -- 172.21.15.73:0/2133695350 wait complete. 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7ea000640 1 Processor -- start 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7ea000640 1 -- start start 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7ea000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7e40b20b0 0x7ff7e413dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7ea000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e4146110 0x7ff7e4139e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7ea000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7e415cbd0 0x7ff7e4157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7ea000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4169210 con 0x7ff7e4146110 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7ea000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e40b3d70 con 0x7ff7e40b20b0 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7ea000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff7e4169390 con 0x7ff7e415cbd0 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7daa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e4146110 0x7ff7e4139e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7daa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e4146110 0x7ff7e4139e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45822/0 (socket says 172.21.15.73:45822) 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7daa00640 1 -- 172.21.15.73:0/243861671 learned_addr learned my addr 172.21.15.73:0/243861671 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7e3400640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7e40b20b0 0x7ff7e413dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7e3e00640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7e415cbd0 0x7ff7e4157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7daa00640 1 -- 172.21.15.73:0/243861671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7e415cbd0 msgr2=0x7ff7e4157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7daa00640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7e415cbd0 0x7ff7e4157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7daa00640 1 -- 172.21.15.73:0/243861671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7e40b20b0 msgr2=0x7ff7e413dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7daa00640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7e40b20b0 0x7ff7e413dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7daa00640 1 -- 172.21.15.73:0/243861671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e415a8a0 con 0x7ff7e4146110 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7daa00640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e4146110 0x7ff7e4139e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00d830 tx=0x7ff7cc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7dbe00640 1 -- 172.21.15.73:0/243861671 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00b6c0 con 0x7ff7e4146110 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7dbe00640 1 -- 172.21.15.73:0/243861671 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7cc019070 con 0x7ff7e4146110 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7dbe00640 1 -- 172.21.15.73:0/243861671 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00ba60 con 0x7ff7e4146110 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7ea000640 1 -- 172.21.15.73:0/243861671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e406fa20 con 0x7ff7e4146110 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.081+0000 7ff7ea000640 1 -- 172.21.15.73:0/243861671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e406f660 con 0x7ff7e4146110 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.085+0000 7ff7ea000640 1 -- 172.21.15.73:0/243861671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e4068ab0 con 0x7ff7e4146110 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.085+0000 7ff7dbe00640 1 -- 172.21.15.73:0/243861671 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff7cc01e460 con 0x7ff7e4146110 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.085+0000 7ff7dbe00640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff7c0068380 0x7ff7c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.085+0000 7ff7dbe00640 1 -- 172.21.15.73:0/243861671 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff7cc0874f0 con 0x7ff7e4146110 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.085+0000 7ff7e3400640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff7c0068380 0x7ff7c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.085+0000 7ff7e3400640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff7c0068380 0x7ff7c006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4004e30 tx=0x7ff7d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.089+0000 7ff7dbe00640 1 -- 172.21.15.73:0/243861671 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff7cc057640 con 0x7ff7e4146110 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.245+0000 7ff7ea000640 1 -- 172.21.15.73:0/243861671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7e415bcd0 con 0x7ff7e4146110 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.245+0000 7ff7dbe00640 1 -- 172.21.15.73:0/243861671 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7ff7cc056f40 con 0x7ff7e4146110 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 -- 172.21.15.73:0/243861671 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff7c0068380 msgr2=0x7ff7c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff7c0068380 0x7ff7c006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4004e30 tx=0x7ff7d4009040 comp rx=0 tx=0).stop 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 -- 172.21.15.73:0/243861671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e4146110 msgr2=0x7ff7e4139e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e4146110 0x7ff7e4139e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00d830 tx=0x7ff7cc00dcf0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 -- 172.21.15.73:0/243861671 shutdown_connections 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff7c0068380 0x7ff7c006a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7e415cbd0 0x7ff7e4157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e4146110 0x7ff7e4139e70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 --2- 172.21.15.73:0/243861671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7e40b20b0 0x7ff7e413dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 -- 172.21.15.73:0/243861671 >> 172.21.15.73:0/243861671 conn(0x7ff7e4067dd0 msgr2=0x7ff7e406ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 -- 172.21.15.73:0/243861671 shutdown_connections 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.249+0000 7ff7ea000640 1 -- 172.21.15.73:0/243861671 wait complete. 2024-04-15T15:31:41.672 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T15:31:33.826027+0000', 'modified': '2024-04-15T15:31:38.883491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/2095978965', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 2095978965}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2095978965}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4281, 'qdb_cluster': [4281]} 2024-04-15T15:31:41.672 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-15T15:31:41.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-15T15:31:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f764dc00640 1 Processor -- start 2024-04-15T15:31:41.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f764dc00640 1 -- start start 2024-04-15T15:31:41.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f764dc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480cf390 0x7f764815f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f764dc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f76480d0620 0x7f764815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f764dc00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76480cf770 con 0x7f764806e690 2024-04-15T15:31:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f764dc00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f7648162290 con 0x7f76480d0620 2024-04-15T15:31:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f764dc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7648162550 con 0x7f76480cf390 2024-04-15T15:31:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7647400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f764806e690 0x7f76480cff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42396/0 (socket says 172.21.15.73:42396) 2024-04-15T15:31:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7647400640 1 -- 172.21.15.73:0/2802882383 learned_addr learned my addr 172.21.15.73:0/2802882383 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:41.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7647e00640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480cf390 0x7f764815f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f764d200640 1 --2- 172.21.15.73:0/2802882383 >> v2:172.21.15.118:3300/0 conn(0x7f76480d0620 0x7f764815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353416166 0 0) 0x7f76480cf770 con 0x7f764806e690 2024-04-15T15:31:41.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f762c003530 con 0x7f764806e690 2024-04-15T15:31:41.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4070948688 0 0) 0x7f762c003530 con 0x7f764806e690 2024-04-15T15:31:41.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480cf390 msgr2=0x7f764815f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480cf390 0x7f764815f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 >> v2:172.21.15.118:3300/0 conn(0x7f76480d0620 msgr2=0x7f764815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 --2- 172.21.15.73:0/2802882383 >> v2:172.21.15.118:3300/0 conn(0x7f76480d0620 0x7f764815fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7648162830 con 0x7f764806e690 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f7638001680 con 0x7f764806e690 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 >> v1:172.21.15.73:6789/0 conn(0x7f764806e690 legacy=0x7f76480cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 0x7f762c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f762c004810 0x7f762c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480cf390 0x7f762c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7648162290 con 0x7f762c003a30 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7648162550 con 0x7f762c004810 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f762c00b9d0 con 0x7f76480cf390 2024-04-15T15:31:41.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.809+0000 7f7647e00640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 0x7f762c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f7647400640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f762c004810 0x7f762c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f764d200640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480cf390 0x7f762c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f7647e00640 1 -- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480cf390 msgr2=0x7f762c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f7647e00640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480cf390 0x7f762c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f7647e00640 1 -- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f762c004810 msgr2=0x7f762c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f7647e00640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f762c004810 0x7f762c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f7647e00640 1 -- 172.21.15.73:0/2802882383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c003530 con 0x7f762c003a30 2024-04-15T15:31:41.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f7647e00640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 0x7f762c003e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7630009b10 tx=0x7f763001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf88a4c3a9fec97 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:41.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76300096b0 con 0x7f762c003a30 2024-04-15T15:31:41.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76300a6450 con 0x7f762c003a30 2024-04-15T15:31:41.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f7646a00640 1 -- 172.21.15.73:0/2802882383 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76300a6840 con 0x7f762c003a30 2024-04-15T15:31:41.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f764dc00640 1 -- 172.21.15.73:0/2802882383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 msgr2=0x7f762c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f764dc00640 1 --2- 172.21.15.73:0/2802882383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 0x7f762c003e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7630009b10 tx=0x7f763001ca40 comp rx=0 tx=0).stop 2024-04-15T15:31:41.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.813+0000 7f764d200640 1 -- 172.21.15.73:0/2802882383 reap_dead start 2024-04-15T15:31:41.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 -- 172.21.15.73:0/2802882383 shutdown_connections 2024-04-15T15:31:41.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 -- 172.21.15.73:0/2802882383 >> 172.21.15.73:0/2802882383 conn(0x7f764806ba50 msgr2=0x7f764806be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:41.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 -- 172.21.15.73:0/2802882383 shutdown_connections 2024-04-15T15:31:41.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 -- 172.21.15.73:0/2802882383 wait complete. 2024-04-15T15:31:41.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 Processor -- start 2024-04-15T15:31:41.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 -- start start 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 0x7f76480b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480b7100 0x7f7648163540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76480ca460 0x7f76480ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f764806d9a0 con 0x7f762c003a30 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f764806d820 con 0x7f76480ca460 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f764806db20 con 0x7f76480b7100 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f7647e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 0x7f76480b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f7647e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 0x7f76480b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45842/0 (socket says 172.21.15.73:45842) 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f7647e00640 1 -- 172.21.15.73:0/1653216623 learned_addr learned my addr 172.21.15.73:0/1653216623 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764d200640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76480ca460 0x7f76480ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f7647400640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480b7100 0x7f7648163540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f7647e00640 1 -- 172.21.15.73:0/1653216623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480b7100 msgr2=0x7f7648163540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f7647e00640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480b7100 0x7f7648163540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f7647e00640 1 -- 172.21.15.73:0/1653216623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76480ca460 msgr2=0x7f76480ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f7647e00640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76480ca460 0x7f76480ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f7647e00640 1 -- 172.21.15.73:0/1653216623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76480cff10 con 0x7f762c003a30 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f7647e00640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 0x7f76480b4be0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7630009a30 tx=0x7f762c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f763fe00640 1 -- 172.21.15.73:0/1653216623 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76300a6c00 con 0x7f762c003a30 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f763fe00640 1 -- 172.21.15.73:0/1653216623 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76300a6da0 con 0x7f762c003a30 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f763fe00640 1 -- 172.21.15.73:0/1653216623 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630004260 con 0x7f762c003a30 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.817+0000 7f764dc00640 1 -- 172.21.15.73:0/1653216623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764815f520 con 0x7f762c003a30 2024-04-15T15:31:41.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.821+0000 7f764dc00640 1 -- 172.21.15.73:0/1653216623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76480b52e0 con 0x7f762c003a30 2024-04-15T15:31:41.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.821+0000 7f763fe00640 1 -- 172.21.15.73:0/1653216623 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7630003620 con 0x7f762c003a30 2024-04-15T15:31:41.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.821+0000 7f763fe00640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f76240683b0 0x7f762406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.821+0000 7f763fe00640 1 -- 172.21.15.73:0/1653216623 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f76301209d0 con 0x7f762c003a30 2024-04-15T15:31:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.821+0000 7f7647400640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f76240683b0 0x7f762406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.821+0000 7f7652630000 1 Processor -- start 2024-04-15T15:31:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.821+0000 7f7647400640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f76240683b0 0x7f762406a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76480b7f10 tx=0x7f7638009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.821+0000 7f7652630000 1 -- start start 2024-04-15T15:31:41.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d28e0 0x55a5f41d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41860a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41865e0 0x55a5f41869c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a5f3fd7290 con 0x55a5f41d3200 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55a5f3f72bd0 con 0x55a5f41d28e0 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55a5f3fd3250 con 0x55a5f41865e0 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7647400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41860a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7647400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41860a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45850/0 (socket says 172.21.15.73:45850) 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7647400640 1 -- 172.21.15.73:0/2265525525 learned_addr learned my addr 172.21.15.73:0/2265525525 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7647e00640 1 --2- 172.21.15.73:0/2265525525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d28e0 0x55a5f41d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f764d200640 1 --2- 172.21.15.73:0/2265525525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41865e0 0x55a5f41869c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7647400640 1 -- 172.21.15.73:0/2265525525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41865e0 msgr2=0x55a5f41869c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7647400640 1 --2- 172.21.15.73:0/2265525525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41865e0 0x55a5f41869c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7647400640 1 -- 172.21.15.73:0/2265525525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d28e0 msgr2=0x55a5f41d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7647400640 1 --2- 172.21.15.73:0/2265525525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d28e0 0x55a5f41d2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7647400640 1 -- 172.21.15.73:0/2265525525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f401c520 con 0x55a5f41d3200 2024-04-15T15:31:41.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7647400640 1 --2- 172.21.15.73:0/2265525525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41860a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f76380073b0 tx=0x7f7638014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f204b3345d2e208 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:41.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f763cc00640 1 -- 172.21.15.73:0/2265525525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638015c00 con 0x55a5f41d3200 2024-04-15T15:31:41.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f763cc00640 1 -- 172.21.15.73:0/2265525525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7638015da0 con 0x55a5f41d3200 2024-04-15T15:31:41.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f763cc00640 1 -- 172.21.15.73:0/2265525525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638023640 con 0x55a5f41d3200 2024-04-15T15:31:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 -- 172.21.15.73:0/2265525525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 msgr2=0x55a5f41860a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 --2- 172.21.15.73:0/2265525525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41860a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f76380073b0 tx=0x7f7638014000 comp rx=0 tx=0).stop 2024-04-15T15:31:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 -- 172.21.15.73:0/2265525525 shutdown_connections 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 --2- 172.21.15.73:0/2265525525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41865e0 0x55a5f41869c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 --2- 172.21.15.73:0/2265525525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41860a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 --2- 172.21.15.73:0/2265525525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d28e0 0x55a5f41d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 -- 172.21.15.73:0/2265525525 >> 172.21.15.73:0/2265525525 conn(0x55a5f4070510 msgr2=0x55a5f41b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 -- 172.21.15.73:0/2265525525 shutdown_connections 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 -- 172.21.15.73:0/2265525525 wait complete. 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 -- start start 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.825+0000 7f7652630000 1 Processor -- start 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41865e0 0x55a5f41d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d28e0 0x55a5f41a1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d3200 0x55a5f41a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a5f3f93530 con 0x55a5f41865e0 2024-04-15T15:31:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55a5f4058140 con 0x55a5f41d28e0 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55a5f3fdb8c0 con 0x55a5f41d3200 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 10 client.0 _ll_register_callbacks cb 0x55a5f4173fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41865e0 0x55a5f41d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41865e0 0x55a5f41d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45860/0 (socket says 172.21.15.73:45860) 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647e00640 1 -- 172.21.15.73:0/3608249901 learned_addr learned my addr 172.21.15.73:0/3608249901 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647400640 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d28e0 0x55a5f41a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f764d200640 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d3200 0x55a5f41a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647e00640 1 -- 172.21.15.73:0/3608249901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d3200 msgr2=0x55a5f41a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647e00640 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d3200 0x55a5f41a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647e00640 1 -- 172.21.15.73:0/3608249901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d28e0 msgr2=0x55a5f41a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647e00640 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d28e0 0x55a5f41a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647e00640 1 -- 172.21.15.73:0/3608249901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f3f7a940 con 0x55a5f41865e0 2024-04-15T15:31:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647e00640 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41865e0 0x55a5f41d2070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7630098260 tx=0x7f7630009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60c6aebfa517abd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7635600640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7635600640 1 -- 172.21.15.73:0/3608249901 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76300ee860 con 0x55a5f41865e0 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7635600640 1 -- 172.21.15.73:0/3608249901 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7630003d60 con 0x55a5f41865e0 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- 172.21.15.73:0/3608249901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7638015da0 con 0x55a5f41865e0 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7635600640 1 -- 172.21.15.73:0/3608249901 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f76300ecbd0 con 0x55a5f41865e0 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 10 client.4413 fetch_fsmap learned FSMap version 7 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- 172.21.15.73:0/3608249901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55a5f3f5de80 con 0x55a5f41865e0 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7635600640 1 -- 172.21.15.73:0/3608249901 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7638015da0 con 0x55a5f41865e0 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7635600640 1 -- 172.21.15.73:0/3608249901 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f76300ef9b0 con 0x55a5f41865e0 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 10 client.4413 fetch_fsmap finished waiting for FSMap version 7 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 10 client.4413 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 20 client.4413 populate_metadata read hostname 'smithi073' 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x55a5f41a24b0 0x55a5f41a2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 4 client.4413 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- 172.21.15.73:0/3608249901 --> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5f3f70bc0 con 0x55a5f41a24b0 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647400640 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x55a5f41a24b0 0x55a5f41a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7647400640 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x55a5f41a24b0 0x55a5f41a2890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5890ad02a25bed50 server_cookie=1d362e2d2b4b0145 in_seq=0 out_seq=0 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7635600640 10 client.4413 ms_handle_connect on v2:172.21.15.73:6834/2095978965 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7635600640 1 -- 172.21.15.73:0/3608249901 <== mds.0 v2:172.21.15.73:6834/2095978965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a5f3f70bc0 con 0x55a5f41a24b0 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7635600640 10 client.4413 handle_command_reply: tid=0 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 client.4413 shutdown 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- 172.21.15.73:0/3608249901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41865e0 msgr2=0x55a5f41d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41865e0 0x55a5f41d2070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7630098260 tx=0x7f7630009190 comp rx=0 tx=0).stop 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- 172.21.15.73:0/3608249901 shutdown_connections 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x55a5f41a24b0 0x55a5f41a2890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d3200 0x55a5f41a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d28e0 0x55a5f41a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7635600640 0 client.4413 ms_handle_reset on v2:172.21.15.73:6834/2095978965 2024-04-15T15:31:41.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 --2- 172.21.15.73:0/3608249901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41865e0 0x55a5f41d2070 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- 172.21.15.73:0/3608249901 >> 172.21.15.73:0/3608249901 conn(0x55a5f4070510 msgr2=0x55a5f41857a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:41.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- 172.21.15.73:0/3608249901 shutdown_connections 2024-04-15T15:31:41.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 1 -- 172.21.15.73:0/3608249901 wait complete. 2024-04-15T15:31:41.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.829+0000 7f7652630000 20 client.4413 trim_cache size 0 max 16384 2024-04-15T15:31:41.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7652630000 1 Processor -- start 2024-04-15T15:31:41.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7652630000 1 -- start start 2024-04-15T15:31:41.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7652630000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41865e0 0x55a5f4184800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7652630000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d28e0 0x55a5f4184d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7652630000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d3200 0x55a5f41b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7652630000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7648204990 con 0x55a5f41d28e0 2024-04-15T15:31:41.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7652630000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7648203d50 con 0x55a5f41d3200 2024-04-15T15:31:41.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7652630000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7648204340 con 0x55a5f41865e0 2024-04-15T15:31:41.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7647400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d28e0 0x55a5f4184d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7647400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d28e0 0x55a5f4184d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45864/0 (socket says 172.21.15.73:45864) 2024-04-15T15:31:41.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7647400640 1 -- 172.21.15.73:0/1061052561 learned_addr learned my addr 172.21.15.73:0/1061052561 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:41.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7647400640 1 -- 172.21.15.73:0/1061052561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41865e0 msgr2=0x55a5f4184800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7647400640 1 --2- 172.21.15.73:0/1061052561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41865e0 0x55a5f4184800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7647400640 1 -- 172.21.15.73:0/1061052561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d3200 msgr2=0x55a5f41b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7647400640 1 --2- 172.21.15.73:0/1061052561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d3200 0x55a5f41b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7647400640 1 -- 172.21.15.73:0/1061052561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f40585d0 con 0x55a5f41d28e0 2024-04-15T15:31:41.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7647400640 1 --2- 172.21.15.73:0/1061052561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d28e0 0x55a5f4184d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7638015fd0 tx=0x7f7638016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11dfd1e9b31d7dfb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7637e00640 1 -- 172.21.15.73:0/1061052561 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763803d070 con 0x55a5f41d28e0 2024-04-15T15:31:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7637e00640 1 -- 172.21.15.73:0/1061052561 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7638007030 con 0x55a5f41d28e0 2024-04-15T15:31:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.849+0000 7f7637e00640 1 -- 172.21.15.73:0/1061052561 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638037d90 con 0x55a5f41d28e0 2024-04-15T15:31:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- 172.21.15.73:0/1061052561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d28e0 msgr2=0x55a5f4184d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 --2- 172.21.15.73:0/1061052561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d28e0 0x55a5f4184d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7638015fd0 tx=0x7f7638016000 comp rx=0 tx=0).stop 2024-04-15T15:31:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- 172.21.15.73:0/1061052561 shutdown_connections 2024-04-15T15:31:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 --2- 172.21.15.73:0/1061052561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41d3200 0x55a5f41b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 --2- 172.21.15.73:0/1061052561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d28e0 0x55a5f4184d40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 --2- 172.21.15.73:0/1061052561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41865e0 0x55a5f4184800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- 172.21.15.73:0/1061052561 >> 172.21.15.73:0/1061052561 conn(0x55a5f4070510 msgr2=0x55a5f41dfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- 172.21.15.73:0/1061052561 shutdown_connections 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- 172.21.15.73:0/1061052561 wait complete. 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- start start 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 Processor -- start 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41865e0 0x55a5f41e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d28e0 0x55a5f41e5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41e6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a5f3fdb8c0 con 0x55a5f41d3200 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55a5f4093390 con 0x55a5f41865e0 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55a5f3f93530 con 0x55a5f41d28e0 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 10 client.0 _ll_register_callbacks cb 0x7f76300f0190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f764d200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f764d200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41e6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45872/0 (socket says 172.21.15.73:45872) 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f764d200640 1 -- 172.21.15.73:0/4195010922 learned_addr learned my addr 172.21.15.73:0/4195010922 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7647e00640 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41865e0 0x55a5f41e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7647400640 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d28e0 0x55a5f41e5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f764d200640 1 -- 172.21.15.73:0/4195010922 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d28e0 msgr2=0x55a5f41e5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f764d200640 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d28e0 0x55a5f41e5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f764d200640 1 -- 172.21.15.73:0/4195010922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41865e0 msgr2=0x55a5f41e59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f764d200640 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41865e0 0x55a5f41e59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f764d200640 1 -- 172.21.15.73:0/4195010922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f402f6e0 con 0x55a5f41d3200 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7647400640 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d28e0 0x55a5f41e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f764d200640 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41e6460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7640004b00 tx=0x7f7640017f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e3f00d2dbcb0ac server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7635600640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7635600640 1 -- 172.21.15.73:0/4195010922 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7640015e50 con 0x55a5f41d3200 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7635600640 1 -- 172.21.15.73:0/4195010922 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f76400039a0 con 0x55a5f41d3200 2024-04-15T15:31:41.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- 172.21.15.73:0/4195010922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7638007030 con 0x55a5f41d3200 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7635600640 1 -- 172.21.15.73:0/4195010922 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f764002a050 con 0x55a5f41d3200 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 10 client.4419 fetch_fsmap learned FSMap version 7 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- 172.21.15.73:0/4195010922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55a5f3f7c260 con 0x55a5f41d3200 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7635600640 1 -- 172.21.15.73:0/4195010922 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7638007030 con 0x55a5f41d3200 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7635600640 1 -- 172.21.15.73:0/4195010922 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f764002d020 con 0x55a5f41d3200 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 10 client.4419 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 20 client.4419 populate_metadata read hostname 'smithi073' 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x55a5f4248430 0x55a5f424a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 4 client.4419 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7652630000 1 -- 172.21.15.73:0/4195010922 --> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] -- command(tid 0: {"prefix": "status"}) -- 0x55a5f3fe4cb0 con 0x55a5f4248430 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.853+0000 7f7647e00640 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x55a5f4248430 0x55a5f424a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:41.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7647e00640 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x55a5f4248430 0x55a5f424a820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=224b664e7f26a66 server_cookie=2e89a88de50c997 in_seq=0 out_seq=0 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7635600640 10 client.4419 ms_handle_connect on v2:172.21.15.73:6834/2095978965 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7635600640 1 -- 172.21.15.73:0/4195010922 <== mds.0 v2:172.21.15.73:6834/2095978965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55a5f3fe4cb0 con 0x55a5f4248430 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7635600640 10 client.4419 handle_command_reply: tid=0 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 client.4419 shutdown 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 -- 172.21.15.73:0/4195010922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 msgr2=0x55a5f41e6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41e6460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7640004b00 tx=0x7f7640017f90 comp rx=0 tx=0).stop 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 -- 172.21.15.73:0/4195010922 shutdown_connections 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x55a5f4248430 0x55a5f424a820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5f41d3200 0x55a5f41e6460 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55a5f41d28e0 0x55a5f41e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 --2- 172.21.15.73:0/4195010922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5f41865e0 0x55a5f41e59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7635600640 0 client.4419 ms_handle_reset on v2:172.21.15.73:6834/2095978965 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 -- 172.21.15.73:0/4195010922 >> 172.21.15.73:0/4195010922 conn(0x55a5f4070510 msgr2=0x55a5f41d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:41.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 -- 172.21.15.73:0/4195010922 shutdown_connections 2024-04-15T15:31:41.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 1 -- 172.21.15.73:0/4195010922 wait complete. 2024-04-15T15:31:41.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f7652630000 20 client.4419 trim_cache size 0 max 16384 2024-04-15T15:31:41.863 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:31:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "a72de584-7db8-4f62-b310-5ee655143eeb", 2024-04-15T15:31:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-04-15T15:31:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4281, 2024-04-15T15:31:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-04-15T15:31:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-04-15T15:31:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-04-15T15:31:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 7.4213898240000002, 2024-04-15T15:31:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 7, 2024-04-15T15:31:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 25, 2024-04-15T15:31:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 25, 2024-04-15T15:31:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 14.955334722 2024-04-15T15:31:41.864 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:31:41.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 -- 172.21.15.73:0/1653216623 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f76240683b0 msgr2=0x7f762406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f76240683b0 0x7f762406a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76480b7f10 tx=0x7f7638009040 comp rx=0 tx=0).stop 2024-04-15T15:31:41.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 -- 172.21.15.73:0/1653216623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 msgr2=0x7f76480b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:41.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 0x7f76480b4be0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7630009a30 tx=0x7f762c005840 comp rx=0 tx=0).stop 2024-04-15T15:31:41.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 -- 172.21.15.73:0/1653216623 shutdown_connections 2024-04-15T15:31:41.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76480ca460 0x7f76480ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f76240683b0 0x7f762406a870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76480b7100 0x7f7648163540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 --2- 172.21.15.73:0/1653216623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f762c003a30 0x7f76480b4be0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:41.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 -- 172.21.15.73:0/1653216623 >> 172.21.15.73:0/1653216623 conn(0x7f764806ba50 msgr2=0x7f76480cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:41.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 -- 172.21.15.73:0/1653216623 shutdown_connections 2024-04-15T15:31:41.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:41.857+0000 7f764dc00640 1 -- 172.21.15.73:0/1653216623 wait complete. 2024-04-15T15:31:41.877 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T15:31:41.878 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-15T15:31:41.878 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:31:42.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.009+0000 7f8c8b800640 1 Processor -- start 2024-04-15T15:31:42.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.009+0000 7f8c8b800640 1 -- start start 2024-04-15T15:31:42.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c8b800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c840cd1b0 0x7f8c8409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:42.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c8b800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c8415cab0 0x7f8c8409afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:42.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c8b800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c840cd690 con 0x7f8c8415c6d0 2024-04-15T15:31:42.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c8b800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f8c840cd970 con 0x7f8c8415cab0 2024-04-15T15:31:42.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c8b800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8c840cdc50 con 0x7f8c840cd1b0 2024-04-15T15:31:42.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c89800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c8415cab0 0x7f8c8409afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c83e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c840cd1b0 0x7f8c8409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c89800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c8415cab0 0x7f8c8409afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50322/0 (socket says 172.21.15.73:50322) 2024-04-15T15:31:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c89800640 1 -- 172.21.15.73:0/2333284957 learned_addr learned my addr 172.21.15.73:0/2333284957 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c88e00640 1 --1- 172.21.15.73:0/2333284957 >> v1:172.21.15.118:6789/0 conn(0x7f8c8415c6d0 0x7f8c840d0d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:40386/0 (socket says 172.21.15.73:40386) 2024-04-15T15:31:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c89800640 1 -- 172.21.15.73:0/2333284957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c840cd1b0 msgr2=0x7f8c8409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c89800640 1 --2- 172.21.15.73:0/2333284957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c840cd1b0 0x7f8c8409aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c89800640 1 -- 172.21.15.73:0/2333284957 >> v1:172.21.15.118:6789/0 conn(0x7f8c8415c6d0 legacy=0x7f8c840d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.013+0000 7f8c89800640 1 -- 172.21.15.73:0/2333284957 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c840cdf30 con 0x7f8c8415cab0 2024-04-15T15:31:42.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c89800640 1 --2- 172.21.15.73:0/2333284957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c8415cab0 0x7f8c8409afa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009e50 tx=0x7f8c7c01ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec5b05ff66653eef server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:42.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c83400640 1 -- 172.21.15.73:0/2333284957 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0a58f0 con 0x7f8c8415cab0 2024-04-15T15:31:42.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c83400640 1 -- 172.21.15.73:0/2333284957 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c840d1690 con 0x7f8c8415cab0 2024-04-15T15:31:42.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c83400640 1 -- 172.21.15.73:0/2333284957 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0a5cb0 con 0x7f8c8415cab0 2024-04-15T15:31:42.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c8b800640 1 -- 172.21.15.73:0/2333284957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c8415cab0 msgr2=0x7f8c8409afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:42.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c8b800640 1 --2- 172.21.15.73:0/2333284957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c8415cab0 0x7f8c8409afa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009e50 tx=0x7f8c7c01ca00 comp rx=0 tx=0).stop 2024-04-15T15:31:42.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c8b800640 1 -- 172.21.15.73:0/2333284957 shutdown_connections 2024-04-15T15:31:42.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c8b800640 1 --2- 172.21.15.73:0/2333284957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c8415cab0 0x7f8c8409afa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:42.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c8b800640 1 --2- 172.21.15.73:0/2333284957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c840cd1b0 0x7f8c8409aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:42.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c8b800640 1 -- 172.21.15.73:0/2333284957 >> 172.21.15.73:0/2333284957 conn(0x7f8c840b3fe0 msgr2=0x7f8c840b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:42.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c8b800640 1 -- 172.21.15.73:0/2333284957 shutdown_connections 2024-04-15T15:31:42.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c8b800640 1 -- 172.21.15.73:0/2333284957 wait complete. 2024-04-15T15:31:42.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c8b800640 1 Processor -- start 2024-04-15T15:31:42.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.017+0000 7f8c8b800640 1 -- start start 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c8b800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c840cd1b0 0x7f8c84153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c8b800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c8415c6d0 0x7f8c8406e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c8b800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8415cab0 0x7f8c84157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c8b800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8c840b1c20 con 0x7f8c8415cab0 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c8b800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8c840b1aa0 con 0x7f8c840cd1b0 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c8b800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8c840b1da0 con 0x7f8c8415c6d0 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c89800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8415cab0 0x7f8c84157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c89800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8415cab0 0x7f8c84157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45878/0 (socket says 172.21.15.73:45878) 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c83e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c8415c6d0 0x7f8c8406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c89800640 1 -- 172.21.15.73:0/2996063328 learned_addr learned my addr 172.21.15.73:0/2996063328 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c88e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c840cd1b0 0x7f8c84153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c89800640 1 -- 172.21.15.73:0/2996063328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c8415c6d0 msgr2=0x7f8c8406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:42.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c89800640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c8415c6d0 0x7f8c8406e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:42.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c89800640 1 -- 172.21.15.73:0/2996063328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c840cd1b0 msgr2=0x7f8c84153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:42.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c89800640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c840cd1b0 0x7f8c84153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:42.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c89800640 1 -- 172.21.15.73:0/2996063328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8406d2c0 con 0x7f8c8415cab0 2024-04-15T15:31:42.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c89800640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8415cab0 0x7f8c84157710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0af040 tx=0x7f8c7c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:42.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c80c00640 1 -- 172.21.15.73:0/2996063328 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c009510 con 0x7f8c8415cab0 2024-04-15T15:31:42.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c80c00640 1 -- 172.21.15.73:0/2996063328 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0be070 con 0x7f8c8415cab0 2024-04-15T15:31:42.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c80c00640 1 -- 172.21.15.73:0/2996063328 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0b88d0 con 0x7f8c8415cab0 2024-04-15T15:31:42.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c8b800640 1 -- 172.21.15.73:0/2996063328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8406d870 con 0x7f8c8415cab0 2024-04-15T15:31:42.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c8b800640 1 -- 172.21.15.73:0/2996063328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8406de30 con 0x7f8c8415cab0 2024-04-15T15:31:42.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.021+0000 7f8c8b800640 1 -- 172.21.15.73:0/2996063328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c84068ab0 con 0x7f8c8415cab0 2024-04-15T15:31:42.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.025+0000 7f8c80c00640 1 -- 172.21.15.73:0/2996063328 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8c7c0b8a70 con 0x7f8c8415cab0 2024-04-15T15:31:42.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.025+0000 7f8c80c00640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c64068380 0x7f8c6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:42.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.025+0000 7f8c80c00640 1 -- 172.21.15.73:0/2996063328 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8c7c121e40 con 0x7f8c8415cab0 2024-04-15T15:31:42.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.025+0000 7f8c88e00640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c64068380 0x7f8c6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:42.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.025+0000 7f8c88e00640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c64068380 0x7f8c6406a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c78007fd0 tx=0x7f8c78007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:42.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.033+0000 7f8c80c00640 1 -- 172.21.15.73:0/2996063328 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8c7c016620 con 0x7f8c8415cab0 2024-04-15T15:31:42.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 -- 172.21.15.73:0/2996063328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8c840b4d80 con 0x7f8c8415cab0 2024-04-15T15:31:42.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c80c00640 1 -- 172.21.15.73:0/2996063328 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f8c7c0f19d0 con 0x7f8c8415cab0 2024-04-15T15:31:42.226 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 -- 172.21.15.73:0/2996063328 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c64068380 msgr2=0x7f8c6406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c64068380 0x7f8c6406a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c78007fd0 tx=0x7f8c78007e80 comp rx=0 tx=0).stop 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 -- 172.21.15.73:0/2996063328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8415cab0 msgr2=0x7f8c84157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8415cab0 0x7f8c84157710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0af040 tx=0x7f8c7c0197a0 comp rx=0 tx=0).stop 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 -- 172.21.15.73:0/2996063328 shutdown_connections 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c8415cab0 0x7f8c84157710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c64068380 0x7f8c6406a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c8415c6d0 0x7f8c8406e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 --2- 172.21.15.73:0/2996063328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c840cd1b0 0x7f8c84153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 -- 172.21.15.73:0/2996063328 >> 172.21.15.73:0/2996063328 conn(0x7f8c840b3fe0 msgr2=0x7f8c84167f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:42.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 -- 172.21.15.73:0/2996063328 shutdown_connections 2024-04-15T15:31:42.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42.225+0000 7f8c8b800640 1 -- 172.21.15.73:0/2996063328 wait complete. 2024-04-15T15:31:42.247 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-15T15:31:42.247 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:31:42.247 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-04-15T15:31:42.247 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-15T15:31:42.248 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-15T15:31:42.248 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-15T15:31:42.248 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T15:31:42.248 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:31:42.248 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-15T15:31:42.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:42.248 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-04-15T15:31:42.256 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:31:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:31:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-04-15T15:31:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:31:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-04-15T15:31:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-04-15T15:31:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:31:42.258 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:31:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:61:e3:76:67 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:31:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:31:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:31:42.259 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-15T15:31:42.260 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:31:42.260 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:31:42.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-04-15T15:31:42.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-04-15T15:31:42.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-04-15T15:31:42.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-15T15:31:42.260 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:31:42.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:31:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:31:42.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:42.415 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:31:42.433 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-04-15T15:31:42.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:42.435 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-04-15T15:31:43.761 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-04-15T15:31:43.761 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:31:43.761 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:31:43.762 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:31:43.762 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:31:43.762 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:31:43.762 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:31:43.762 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:31:43.762 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:31:43.762 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:31:43.762 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:31:43.763 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:31:43.763 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:31:43.763 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:31:43.763 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:31:43.763 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:31:43.763 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:31:43.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:31:43.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:31:43.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:43.866 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-15T15:31:43.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:43.877 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-04-15T15:31:43.926 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:31:43.926 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:31:43.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T15:31:43.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-15T15:31:43.927 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:31:44.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:31:44.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:31:44.052 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-15T15:31:44.052 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:31:44.052 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:31:44.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-15T15:31:44.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-15T15:31:44.053 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-15T15:31:44.053 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-15T15:31:44.053 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-15T15:31:44.053 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:31:44.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:31:44.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:31:44.226 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:31:44.227 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:31:44.227 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-04-15T15:31:44.227 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-04-15T15:31:44.227 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:31:44.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:31:44.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:31:44.311 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-15T15:31:44.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:31:44.311 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-15T15:31:44.320 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-15T15:31:44.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:31:44.320 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-15T15:31:44.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-04-15T15:31:44.428 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T15:31:44.481 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-04-15T15:31:44.482 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T15:31:44.483 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T15:31:44.484 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T15:31:44.484 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-04-15T15:31:44.484 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T15:31:44.484 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T15:31:44.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:44.485 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-04-15T15:31:44.536 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-15T15:31:44.536 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-15T15:31:44.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-04-15T15:31:44.601 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T15:31:44.655 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-04-15T15:31:44.655 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-04-15T15:31:44.655 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-04-15T15:31:44.655 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-04-15T15:31:44.655 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-04-15T15:31:44.655 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-04-15T15:31:44.655 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-04-15T15:31:44.655 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-04-15T15:31:44.655 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-04-15T15:31:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-04-15T15:31:44.657 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-04-15T15:31:44.657 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T15:31:44.657 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T15:31:44.657 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T15:31:44.657 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T15:31:44.657 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-04-15T15:31:44.657 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T15:31:44.657 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T15:31:44.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:44.657 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-04-15T15:31:44.676 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:2024-04-15T15:31:44.673+0000 7f15d1309580 -1 init, newargv = 0x55940b45a380 newargc=15 2024-04-15T15:31:44.676 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:ceph-fuse[34038]: starting ceph client 2024-04-15T15:31:44.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:ceph-fuse[34038]: starting fuse 2024-04-15T15:31:45.785 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-04-15T15:31:45.808 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T15:31:45.868 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-04-15T15:31:45.868 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-04-15T15:31:45.869 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-04-15T15:31:45.869 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-04-15T15:31:45.869 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-04-15T15:31:45.869 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-04-15T15:31:45.869 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-04-15T15:31:45.869 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-04-15T15:31:45.869 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-04-15T15:31:45.869 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-04-15T15:31:45.870 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-04-15T15:31:45.870 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-04-15T15:31:45.870 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T15:31:45.870 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-04-15T15:31:45.870 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-04-15T15:31:45.870 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-04-15T15:31:45.870 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-04-15T15:31:45.870 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-04-15T15:31:45.871 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-04-15T15:31:45.871 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-04-15T15:31:45.871 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-04-15T15:31:45.871 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-04-15T15:31:45.871 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-04-15T15:31:45.871 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-04-15T15:31:45.871 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T15:31:45.871 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T15:31:45.872 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T15:31:45.872 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T15:31:45.872 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-04-15T15:31:45.872 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T15:31:45.872 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T15:31:45.872 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-15T15:31:45.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:45.873 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-04-15T15:31:45.921 INFO:teuthology.orchestra.run.smithi073.stdout:44 2024-04-15T15:31:45.921 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-15T15:31:45.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-04-15T15:31:45.921 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-04-15T15:31:45.921 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-04-15T15:31:45.922 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-04-15T15:31:45.922 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-04-15T15:31:45.922 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-15T15:31:45.922 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-04-15T15:31:45.922 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-15T15:31:45.922 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-04-15T15:31:45.922 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-15T15:31:45.922 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-15T15:31:45.922 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-04-15T15:31:45.923 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-04-15T15:31:45.923 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-04-15T15:31:45.923 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-04-15T15:31:45.923 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-15T15:31:45.923 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-04-15T15:31:45.923 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-15T15:31:45.923 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-15T15:31:45.923 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-15T15:31:45.924 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-04-15T15:31:45.924 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-04-15T15:31:45.924 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-04-15T15:31:45.924 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-15T15:31:45.924 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-15T15:31:45.924 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.admin")) 2024-04-15T15:31:45.924 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-04-15T15:31:46.051 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.admin.34038.asok 2024-04-15T15:31:46.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:31:46.063 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34038.asok 2024-04-15T15:31:46.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:46.063 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34038.asok status 2024-04-15T15:31:46.236 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:31:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-04-15T15:31:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "9bf1c4ba967dd24077be6e5b87edda4ca87a6e14", 2024-04-15T15:31:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.0.0-2861-g9bf1c4ba (9bf1c4ba967dd24077be6e5b87edda4ca87a6e14) squid (dev)", 2024-04-15T15:31:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "admin", 2024-04-15T15:31:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-04-15T15:31:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-15T15:31:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "34038", 2024-04-15T15:31:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-04-15T15:31:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4428, 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4428 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2463068205 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:31:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2463068205 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4428 192.168.0.1:0/2463068205", 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/2463068205", 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 7, 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 25, 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-04-15T15:31:46.238 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:31:46.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:46.252 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-04-15T15:31:46.252 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-15T15:31:46.262 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-04-15T15:31:46.262 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-15T15:31:46.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:46.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-15T15:31:46.324 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-15T15:31:46.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:31:46.454 INFO:teuthology.orchestra.run.smithi073.stdout:# file: . 2024-04-15T15:31:46.454 INFO:teuthology.orchestra.run.smithi073.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-15T15:31:46.454 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:46.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:31:46.460 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:46.461 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:31:46.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:46.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f226a400640 1 Processor -- start 2024-04-15T15:31:46.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f226a400640 1 -- start start 2024-04-15T15:31:46.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f226a400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22640b20b0 0x7f22640b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f226a400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f226415cbd0 0x7f226415d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f226a400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22640cd3a0 con 0x7f2264146110 2024-04-15T15:31:46.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f226a400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f22640b5160 con 0x7f226415cbd0 2024-04-15T15:31:46.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f226a400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f22640b40c0 con 0x7f22640b20b0 2024-04-15T15:31:46.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2263400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2264146110 0x7f22640cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42406/0 (socket says 172.21.15.73:42406) 2024-04-15T15:31:46.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2263400640 1 -- 172.21.15.73:0/3438648950 learned_addr learned my addr 172.21.15.73:0/3438648950 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2263e00640 1 --2- 172.21.15.73:0/3438648950 >> v2:172.21.15.118:3300/0 conn(0x7f226415cbd0 0x7f226415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2262a00640 1 --2- 172.21.15.73:0/3438648950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22640b20b0 0x7f22640b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2262000640 1 -- 172.21.15.73:0/3438648950 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3248088999 0 0) 0x7f22640cd3a0 con 0x7f2264146110 2024-04-15T15:31:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2262000640 1 -- 172.21.15.73:0/3438648950 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2248003530 con 0x7f2264146110 2024-04-15T15:31:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2262000640 1 -- 172.21.15.73:0/3438648950 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4001201833 0 0) 0x7f2248003530 con 0x7f2264146110 2024-04-15T15:31:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2263e00640 1 -- 172.21.15.73:0/3438648950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22640b20b0 msgr2=0x7f22640b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2263e00640 1 --2- 172.21.15.73:0/3438648950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22640b20b0 0x7f22640b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2263e00640 1 -- 172.21.15.73:0/3438648950 >> v1:172.21.15.73:6789/0 conn(0x7f2264146110 legacy=0x7f22640cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2263e00640 1 -- 172.21.15.73:0/3438648950 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22640b43a0 con 0x7f226415cbd0 2024-04-15T15:31:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.649+0000 7f2262a00640 1 --2- 172.21.15.73:0/3438648950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22640b20b0 0x7f22640b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:46.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f2263e00640 1 --2- 172.21.15.73:0/3438648950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226415cbd0 0x7f226415d060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f225c009d90 tx=0x7f225c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71cfb0e1ad8e42ab server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:46.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f2262000640 1 -- 172.21.15.73:0/3438648950 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c0b2070 con 0x7f226415cbd0 2024-04-15T15:31:46.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f2262000640 1 -- 172.21.15.73:0/3438648950 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225c0a5580 con 0x7f226415cbd0 2024-04-15T15:31:46.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f2262000640 1 -- 172.21.15.73:0/3438648950 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254001680 con 0x7f226415cbd0 2024-04-15T15:31:46.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f226a400640 1 -- 172.21.15.73:0/3438648950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226415cbd0 msgr2=0x7f226415d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:46.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f226a400640 1 --2- 172.21.15.73:0/3438648950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226415cbd0 0x7f226415d060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f225c009d90 tx=0x7f225c01c890 comp rx=0 tx=0).stop 2024-04-15T15:31:46.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f226a400640 1 -- 172.21.15.73:0/3438648950 shutdown_connections 2024-04-15T15:31:46.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f226a400640 1 --2- 172.21.15.73:0/3438648950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226415cbd0 0x7f226415d060 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f226a400640 1 --2- 172.21.15.73:0/3438648950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22640b20b0 0x7f22640b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f226a400640 1 -- 172.21.15.73:0/3438648950 >> 172.21.15.73:0/3438648950 conn(0x7f2264067dd0 msgr2=0x7f22640d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:46.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f226a400640 1 -- 172.21.15.73:0/3438648950 shutdown_connections 2024-04-15T15:31:46.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.653+0000 7f226a400640 1 -- 172.21.15.73:0/3438648950 wait complete. 2024-04-15T15:31:46.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 Processor -- start 2024-04-15T15:31:46.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 -- start start 2024-04-15T15:31:46.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22640b20b0 0x7f226415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2264146110 0x7f22641390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f226415cbd0 0x7f22640ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2264169210 con 0x7f226415cbd0 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f22640b3d70 con 0x7f22640b20b0 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2264169390 con 0x7f2264146110 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2263e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f226415cbd0 0x7f22640ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2263e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f226415cbd0 0x7f22640ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45882/0 (socket says 172.21.15.73:45882) 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2263e00640 1 -- 172.21.15.73:0/1054683879 learned_addr learned my addr 172.21.15.73:0/1054683879 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2263400640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22640b20b0 0x7f226415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2262a00640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2264146110 0x7f22641390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2263e00640 1 -- 172.21.15.73:0/1054683879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2264146110 msgr2=0x7f22641390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2263e00640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2264146110 0x7f22641390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2263e00640 1 -- 172.21.15.73:0/1054683879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22640b20b0 msgr2=0x7f226415a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:46.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2263e00640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22640b20b0 0x7f226415a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2263e00640 1 -- 172.21.15.73:0/1054683879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2264142cf0 con 0x7f226415cbd0 2024-04-15T15:31:46.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f2263e00640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f226415cbd0 0x7f22640ad8d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f225c0b0040 tx=0x7f225c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:46.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f225b400640 1 -- 172.21.15.73:0/1054683879 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c0bd020 con 0x7f226415cbd0 2024-04-15T15:31:46.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f225b400640 1 -- 172.21.15.73:0/1054683879 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225c0b8470 con 0x7f226415cbd0 2024-04-15T15:31:46.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f225b400640 1 -- 172.21.15.73:0/1054683879 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c0b2040 con 0x7f226415cbd0 2024-04-15T15:31:46.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 -- 172.21.15.73:0/1054683879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2264142fd0 con 0x7f226415cbd0 2024-04-15T15:31:46.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 -- 172.21.15.73:0/1054683879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2264154f70 con 0x7f226415cbd0 2024-04-15T15:31:46.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.657+0000 7f226a400640 1 -- 172.21.15.73:0/1054683879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2264068ab0 con 0x7f226415cbd0 2024-04-15T15:31:46.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.661+0000 7f225b400640 1 -- 172.21.15.73:0/1054683879 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f225c0c0020 con 0x7f226415cbd0 2024-04-15T15:31:46.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.661+0000 7f225b400640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2244068380 0x7f224406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.661+0000 7f225b400640 1 -- 172.21.15.73:0/1054683879 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f225c121920 con 0x7f226415cbd0 2024-04-15T15:31:46.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.661+0000 7f2263400640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2244068380 0x7f224406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:46.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.661+0000 7f2263400640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2244068380 0x7f224406a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22540013d0 tx=0x7f2254001360 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:46.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.665+0000 7f225b400640 1 -- 172.21.15.73:0/1054683879 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f225c0c7030 con 0x7f226415cbd0 2024-04-15T15:31:46.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.825+0000 7f226a400640 1 -- 172.21.15.73:0/1054683879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f226406c220 con 0x7f226415cbd0 2024-04-15T15:31:46.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.825+0000 7f225b400640 1 -- 172.21.15.73:0/1054683879 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f225c016480 con 0x7f226415cbd0 2024-04-15T15:31:46.827 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:46.827 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:46.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 -- 172.21.15.73:0/1054683879 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2244068380 msgr2=0x7f224406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:46.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2244068380 0x7f224406a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22540013d0 tx=0x7f2254001360 comp rx=0 tx=0).stop 2024-04-15T15:31:46.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 -- 172.21.15.73:0/1054683879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f226415cbd0 msgr2=0x7f22640ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:46.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f226415cbd0 0x7f22640ad8d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f225c0b0040 tx=0x7f225c019630 comp rx=0 tx=0).stop 2024-04-15T15:31:46.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 -- 172.21.15.73:0/1054683879 shutdown_connections 2024-04-15T15:31:46.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f226415cbd0 0x7f22640ad8d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2244068380 0x7f224406a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2264146110 0x7f22641390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 --2- 172.21.15.73:0/1054683879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22640b20b0 0x7f226415a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 -- 172.21.15.73:0/1054683879 >> 172.21.15.73:0/1054683879 conn(0x7f2264067dd0 msgr2=0x7f226415be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:46.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 -- 172.21.15.73:0/1054683879 shutdown_connections 2024-04-15T15:31:46.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.829+0000 7f226a400640 1 -- 172.21.15.73:0/1054683879 wait complete. 2024-04-15T15:31:46.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:31:46.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:31:46.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.985+0000 7fa43e600640 1 Processor -- start 2024-04-15T15:31:46.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.985+0000 7fa43e600640 1 -- start start 2024-04-15T15:31:46.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa43e600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4380b27c0 0x7fa43815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa43e600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa4380b3e30 0x7fa4380b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa43e600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa438070160 con 0x7fa43815b5d0 2024-04-15T15:31:46.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa43e600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa43815b9b0 con 0x7fa4380b3e30 2024-04-15T15:31:46.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa43e600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa43815f1f0 con 0x7fa4380b27c0 2024-04-15T15:31:46.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa436a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4380b27c0 0x7fa43815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:46.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa437e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa4380b3e30 0x7fa4380b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:46.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa437400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa43815b5d0 0x7fa4380b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:40396/0 (socket says 172.21.15.73:40396) 2024-04-15T15:31:46.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa437400640 1 -- 172.21.15.73:0/3694461263 learned_addr learned my addr 172.21.15.73:0/3694461263 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:46.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa436000640 1 -- 172.21.15.73:0/3694461263 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554794390 0 0) 0x7fa438070160 con 0x7fa43815b5d0 2024-04-15T15:31:46.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa436000640 1 -- 172.21.15.73:0/3694461263 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa41c003530 con 0x7fa43815b5d0 2024-04-15T15:31:46.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa436a00640 1 -- 172.21.15.73:0/3694461263 >> v2:172.21.15.118:3300/0 conn(0x7fa4380b3e30 msgr2=0x7fa4380b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:46.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa436a00640 1 --2- 172.21.15.73:0/3694461263 >> v2:172.21.15.118:3300/0 conn(0x7fa4380b3e30 0x7fa4380b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa436a00640 1 -- 172.21.15.73:0/3694461263 >> v1:172.21.15.118:6789/0 conn(0x7fa43815b5d0 legacy=0x7fa4380b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:46.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa436a00640 1 -- 172.21.15.73:0/3694461263 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43806fe80 con 0x7fa4380b27c0 2024-04-15T15:31:46.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.989+0000 7fa437e00640 1 --2- 172.21.15.73:0/3694461263 >> v2:172.21.15.118:3300/0 conn(0x7fa4380b3e30 0x7fa4380b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:46.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa436a00640 1 --2- 172.21.15.73:0/3694461263 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4380b27c0 0x7fa43815fc90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa4240097c0 tx=0x7fa42401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8262a32eaa06483a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:46.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa436000640 1 -- 172.21.15.73:0/3694461263 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4240b0070 con 0x7fa4380b27c0 2024-04-15T15:31:46.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa436000640 1 -- 172.21.15.73:0/3694461263 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa424004030 con 0x7fa4380b27c0 2024-04-15T15:31:46.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa436000640 1 -- 172.21.15.73:0/3694461263 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424004440 con 0x7fa4380b27c0 2024-04-15T15:31:46.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa43e600640 1 -- 172.21.15.73:0/3694461263 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4380b27c0 msgr2=0x7fa43815fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:46.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa43e600640 1 --2- 172.21.15.73:0/3694461263 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4380b27c0 0x7fa43815fc90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa4240097c0 tx=0x7fa42401c350 comp rx=0 tx=0).stop 2024-04-15T15:31:46.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa43e600640 1 -- 172.21.15.73:0/3694461263 shutdown_connections 2024-04-15T15:31:46.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa43e600640 1 --2- 172.21.15.73:0/3694461263 >> v2:172.21.15.118:3300/0 conn(0x7fa4380b3e30 0x7fa4380b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa43e600640 1 --2- 172.21.15.73:0/3694461263 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4380b27c0 0x7fa43815fc90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:46.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa43e600640 1 -- 172.21.15.73:0/3694461263 >> 172.21.15.73:0/3694461263 conn(0x7fa438067dd0 msgr2=0x7fa4380d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:46.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa43e600640 1 -- 172.21.15.73:0/3694461263 shutdown_connections 2024-04-15T15:31:46.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa43e600640 1 -- 172.21.15.73:0/3694461263 wait complete. 2024-04-15T15:31:46.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.993+0000 7fa43e600640 1 Processor -- start 2024-04-15T15:31:46.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa43e600640 1 -- start start 2024-04-15T15:31:46.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa43e600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b27c0 0x7fa4380b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa43e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4380b3e30 0x7fa43814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa43e600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa43815b5d0 0x7fa438150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:46.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa43e600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa43806faa0 con 0x7fa4380b27c0 2024-04-15T15:31:46.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa43e600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa4380b4240 con 0x7fa4380b3e30 2024-04-15T15:31:46.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa43e600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa43806fc20 con 0x7fa43815b5d0 2024-04-15T15:31:46.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa437400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b27c0 0x7fa4380b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:46.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa437400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b27c0 0x7fa4380b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45894/0 (socket says 172.21.15.73:45894) 2024-04-15T15:31:46.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa437400640 1 -- 172.21.15.73:0/1453732901 learned_addr learned my addr 172.21.15.73:0/1453732901 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:46.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa437400640 1 -- 172.21.15.73:0/1453732901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa43815b5d0 msgr2=0x7fa438150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa437400640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa43815b5d0 0x7fa438150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa437400640 1 -- 172.21.15.73:0/1453732901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4380b3e30 msgr2=0x7fa43814fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa437400640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4380b3e30 0x7fa43814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa437400640 1 -- 172.21.15.73:0/1453732901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4381512d0 con 0x7fa4380b27c0 2024-04-15T15:31:47.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa437400640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b27c0 0x7fa4380b2190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c450 tx=0x7fa42800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:47.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa42f400640 1 -- 172.21.15.73:0/1453732901 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428017070 con 0x7fa4380b27c0 2024-04-15T15:31:47.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa42f400640 1 -- 172.21.15.73:0/1453732901 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa428005db0 con 0x7fa4380b27c0 2024-04-15T15:31:47.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa42f400640 1 -- 172.21.15.73:0/1453732901 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4280072f0 con 0x7fa4380b27c0 2024-04-15T15:31:47.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa43e600640 1 -- 172.21.15.73:0/1453732901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4380c8dc0 con 0x7fa4380b27c0 2024-04-15T15:31:47.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa43e600640 1 -- 172.21.15.73:0/1453732901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4380c9380 con 0x7fa4380b27c0 2024-04-15T15:31:47.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:46.997+0000 7fa43e600640 1 -- 172.21.15.73:0/1453732901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4380c8bb0 con 0x7fa4380b27c0 2024-04-15T15:31:47.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.001+0000 7fa42f400640 1 -- 172.21.15.73:0/1453732901 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa42801a070 con 0x7fa4380b27c0 2024-04-15T15:31:47.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.001+0000 7fa42f400640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa418068380 0x7fa41806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.001+0000 7fa42f400640 1 -- 172.21.15.73:0/1453732901 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa428086180 con 0x7fa4380b27c0 2024-04-15T15:31:47.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.001+0000 7fa436a00640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa418068380 0x7fa41806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.001+0000 7fa436a00640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa418068380 0x7fa41806a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa4240ad000 tx=0x7fa424004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:47.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.005+0000 7fa42f400640 1 -- 172.21.15.73:0/1453732901 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa428056410 con 0x7fa4380b27c0 2024-04-15T15:31:47.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.161+0000 7fa43e600640 1 -- 172.21.15.73:0/1453732901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa438068ab0 con 0x7fa4380b27c0 2024-04-15T15:31:47.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.161+0000 7fa42f400640 1 -- 172.21.15.73:0/1453732901 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fa428055d10 con 0x7fa4380b27c0 2024-04-15T15:31:47.164 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:31:47.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 -- 172.21.15.73:0/1453732901 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa418068380 msgr2=0x7fa41806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa418068380 0x7fa41806a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa4240ad000 tx=0x7fa424004740 comp rx=0 tx=0).stop 2024-04-15T15:31:47.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 -- 172.21.15.73:0/1453732901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b27c0 msgr2=0x7fa4380b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b27c0 0x7fa4380b2190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c450 tx=0x7fa42800c910 comp rx=0 tx=0).stop 2024-04-15T15:31:47.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 -- 172.21.15.73:0/1453732901 shutdown_connections 2024-04-15T15:31:47.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa418068380 0x7fa41806a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa43815b5d0 0x7fa438150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4380b3e30 0x7fa43814fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 --2- 172.21.15.73:0/1453732901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b27c0 0x7fa4380b2190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 -- 172.21.15.73:0/1453732901 >> 172.21.15.73:0/1453732901 conn(0x7fa438067dd0 msgr2=0x7fa43806de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:47.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 -- 172.21.15.73:0/1453732901 shutdown_connections 2024-04-15T15:31:47.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.165+0000 7fa43e600640 1 -- 172.21.15.73:0/1453732901 wait complete. 2024-04-15T15:31:47.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:31:47.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.321+0000 7f6318600640 1 Processor -- start 2024-04-15T15:31:47.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.321+0000 7f6318600640 1 -- start start 2024-04-15T15:31:47.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.321+0000 7f6318600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6310146110 0x7f63100cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.321+0000 7f6318600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 0x7f6310072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.321+0000 7f6318600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63100cd3a0 con 0x7f63100b20b0 2024-04-15T15:31:47.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.321+0000 7f6318600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f63100b29c0 con 0x7f6310146110 2024-04-15T15:31:47.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.321+0000 7f6318600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f63100b5160 con 0x7f63100b2530 2024-04-15T15:31:47.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.321+0000 7f6315c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6310146110 0x7f63100cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f6315c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6310146110 0x7f63100cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45052/0 (socket says 172.21.15.73:45052) 2024-04-15T15:31:47.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f6315c00640 1 -- 172.21.15.73:0/2645337678 learned_addr learned my addr 172.21.15.73:0/2645337678 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:47.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f6316600640 1 --2- 172.21.15.73:0/2645337678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 0x7f6310072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f6315c00640 1 -- 172.21.15.73:0/2645337678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 msgr2=0x7f6310072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:47.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f6315c00640 1 --2- 172.21.15.73:0/2645337678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 0x7f6310072520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f6315c00640 1 -- 172.21.15.73:0/2645337678 >> v1:172.21.15.118:6789/0 conn(0x7f63100b20b0 legacy=0x7f6310071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:47.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f6315c00640 1 -- 172.21.15.73:0/2645337678 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63100b40c0 con 0x7f6310146110 2024-04-15T15:31:47.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f6316600640 1 --2- 172.21.15.73:0/2645337678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 0x7f6310072520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:47.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f6315c00640 1 --2- 172.21.15.73:0/2645337678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 0x7f63100cd7b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6304009870 tx=0x7f630401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed18d8bdc01b649d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:47.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f630fe00640 1 -- 172.21.15.73:0/2645337678 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63040a95f0 con 0x7f6310146110 2024-04-15T15:31:47.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f630fe00640 1 -- 172.21.15.73:0/2645337678 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63040a9790 con 0x7f6310146110 2024-04-15T15:31:47.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.325+0000 7f630fe00640 1 -- 172.21.15.73:0/2645337678 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63040a9b60 con 0x7f6310146110 2024-04-15T15:31:47.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 -- 172.21.15.73:0/2645337678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 msgr2=0x7f63100cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 --2- 172.21.15.73:0/2645337678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 0x7f63100cd7b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6304009870 tx=0x7f630401c530 comp rx=0 tx=0).stop 2024-04-15T15:31:47.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 -- 172.21.15.73:0/2645337678 shutdown_connections 2024-04-15T15:31:47.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 --2- 172.21.15.73:0/2645337678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 0x7f6310072520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 --2- 172.21.15.73:0/2645337678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 0x7f63100cd7b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 -- 172.21.15.73:0/2645337678 >> 172.21.15.73:0/2645337678 conn(0x7f6310067dd0 msgr2=0x7f63100d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:47.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 -- 172.21.15.73:0/2645337678 shutdown_connections 2024-04-15T15:31:47.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 -- 172.21.15.73:0/2645337678 wait complete. 2024-04-15T15:31:47.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 Processor -- start 2024-04-15T15:31:47.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 -- start start 2024-04-15T15:31:47.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63100b20b0 0x7f63100aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 0x7f631013c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 0x7f63100ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f63100b3d70 con 0x7f6310146110 2024-04-15T15:31:47.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f63100b4c40 con 0x7f63100b20b0 2024-04-15T15:31:47.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6318600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f63100cdcf0 con 0x7f63100b2530 2024-04-15T15:31:47.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6316600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 0x7f63100ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6316600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 0x7f63100ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45064/0 (socket says 172.21.15.73:45064) 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6316600640 1 -- 172.21.15.73:0/1978641087 learned_addr learned my addr 172.21.15.73:0/1978641087 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6315c00640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63100b20b0 0x7f63100aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6315200640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 0x7f631013c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6316600640 1 -- 172.21.15.73:0/1978641087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 msgr2=0x7f631013c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6316600640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 0x7f631013c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6316600640 1 -- 172.21.15.73:0/1978641087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63100b20b0 msgr2=0x7f63100aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6316600640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63100b20b0 0x7f63100aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6316600640 1 -- 172.21.15.73:0/1978641087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63100ad130 con 0x7f6310146110 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.329+0000 7f6315200640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 0x7f631013c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f6316600640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 0x7f63100ae1d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f630800cef0 tx=0x7f630800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f630d600640 1 -- 172.21.15.73:0/1978641087 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630801a070 con 0x7f6310146110 2024-04-15T15:31:47.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f630d600640 1 -- 172.21.15.73:0/1978641087 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f630800d860 con 0x7f6310146110 2024-04-15T15:31:47.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f630d600640 1 -- 172.21.15.73:0/1978641087 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630800dc50 con 0x7f6310146110 2024-04-15T15:31:47.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f6318600640 1 -- 172.21.15.73:0/1978641087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63100ad410 con 0x7f6310146110 2024-04-15T15:31:47.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f6318600640 1 -- 172.21.15.73:0/1978641087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63100ad9d0 con 0x7f6310146110 2024-04-15T15:31:47.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f6318600640 1 -- 172.21.15.73:0/1978641087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6310068ab0 con 0x7f6310146110 2024-04-15T15:31:47.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f630d600640 1 -- 172.21.15.73:0/1978641087 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f630801d070 con 0x7f6310146110 2024-04-15T15:31:47.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f630d600640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62f00683b0 0x7f62f006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f630d600640 1 -- 172.21.15.73:0/1978641087 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f63080875d0 con 0x7f6310146110 2024-04-15T15:31:47.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f6315c00640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62f00683b0 0x7f62f006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.333+0000 7f6315c00640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62f00683b0 0x7f62f006a870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f63040ae000 tx=0x7f63040b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.337+0000 7f630d600640 1 -- 172.21.15.73:0/1978641087 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6308057190 con 0x7f6310146110 2024-04-15T15:31:47.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 -- 172.21.15.73:0/1978641087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f631006cdf0 con 0x7f6310146110 2024-04-15T15:31:47.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f630d600640 1 -- 172.21.15.73:0/1978641087 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f630805b490 con 0x7f6310146110 2024-04-15T15:31:47.498 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:31:47.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 -- 172.21.15.73:0/1978641087 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62f00683b0 msgr2=0x7f62f006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62f00683b0 0x7f62f006a870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f63040ae000 tx=0x7f63040b3040 comp rx=0 tx=0).stop 2024-04-15T15:31:47.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 -- 172.21.15.73:0/1978641087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 msgr2=0x7f63100ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 0x7f63100ae1d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f630800cef0 tx=0x7f630800a710 comp rx=0 tx=0).stop 2024-04-15T15:31:47.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 -- 172.21.15.73:0/1978641087 shutdown_connections 2024-04-15T15:31:47.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6310146110 0x7f63100ae1d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62f00683b0 0x7f62f006a870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63100b2530 0x7f631013c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 --2- 172.21.15.73:0/1978641087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63100b20b0 0x7f63100aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 -- 172.21.15.73:0/1978641087 >> 172.21.15.73:0/1978641087 conn(0x7f6310067dd0 msgr2=0x7f631013d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:47.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 -- 172.21.15.73:0/1978641087 shutdown_connections 2024-04-15T15:31:47.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.497+0000 7f6318600640 1 -- 172.21.15.73:0/1978641087 wait complete. 2024-04-15T15:31:47.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:31:47.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.653+0000 7f32e5800640 1 Processor -- start 2024-04-15T15:31:47.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32e5800640 1 -- start start 2024-04-15T15:31:47.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32e5800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 0x7f32e00b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32e5800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f32e015cbd0 0x7f32e015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32e5800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e00cd3a0 con 0x7f32e0146110 2024-04-15T15:31:47.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32e5800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f32e00b5160 con 0x7f32e015cbd0 2024-04-15T15:31:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32e5800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f32e00b40c0 con 0x7f32e00b20b0 2024-04-15T15:31:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32df400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f32e015cbd0 0x7f32e015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32df400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f32e015cbd0 0x7f32e015d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45078/0 (socket says 172.21.15.73:45078) 2024-04-15T15:31:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32df400640 1 -- 172.21.15.73:0/2743902588 learned_addr learned my addr 172.21.15.73:0/2743902588 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32de000640 1 --2- 172.21.15.73:0/2743902588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 0x7f32e00b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32df400640 1 -- 172.21.15.73:0/2743902588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 msgr2=0x7f32e00b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32df400640 1 --2- 172.21.15.73:0/2743902588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 0x7f32e00b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32df400640 1 -- 172.21.15.73:0/2743902588 >> v1:172.21.15.118:6789/0 conn(0x7f32e0146110 legacy=0x7f32e00cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32df400640 1 -- 172.21.15.73:0/2743902588 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e00b43a0 con 0x7f32e015cbd0 2024-04-15T15:31:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.657+0000 7f32de000640 1 --2- 172.21.15.73:0/2743902588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 0x7f32e00b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32df400640 1 --2- 172.21.15.73:0/2743902588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 0x7f32e015d060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009e50 tx=0x7f32d801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ecd68c5e4051a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:47.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32dd600640 1 -- 172.21.15.73:0/2743902588 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d80a5760 con 0x7f32e015cbd0 2024-04-15T15:31:47.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32dd600640 1 -- 172.21.15.73:0/2743902588 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d80a5900 con 0x7f32e015cbd0 2024-04-15T15:31:47.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32dd600640 1 -- 172.21.15.73:0/2743902588 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d80a5cd0 con 0x7f32e015cbd0 2024-04-15T15:31:47.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32e5800640 1 -- 172.21.15.73:0/2743902588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 msgr2=0x7f32e015d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32e5800640 1 --2- 172.21.15.73:0/2743902588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 0x7f32e015d060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009e50 tx=0x7f32d801c9f0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32e5800640 1 -- 172.21.15.73:0/2743902588 shutdown_connections 2024-04-15T15:31:47.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32e5800640 1 --2- 172.21.15.73:0/2743902588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 0x7f32e015d060 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32e5800640 1 --2- 172.21.15.73:0/2743902588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 0x7f32e00b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32e5800640 1 -- 172.21.15.73:0/2743902588 >> 172.21.15.73:0/2743902588 conn(0x7f32e0067dd0 msgr2=0x7f32e00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:47.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32e5800640 1 -- 172.21.15.73:0/2743902588 shutdown_connections 2024-04-15T15:31:47.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32e5800640 1 -- 172.21.15.73:0/2743902588 wait complete. 2024-04-15T15:31:47.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32e5800640 1 Processor -- start 2024-04-15T15:31:47.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.661+0000 7f32e5800640 1 -- start start 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32e5800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 0x7f32e013fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32e5800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32e0146110 0x7f32e013ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32e5800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 0x7f32e00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32e5800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f32e0169210 con 0x7f32e015cbd0 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32e5800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f32e00b3d70 con 0x7f32e0146110 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32e5800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f32e0169390 con 0x7f32e00b20b0 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32df400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 0x7f32e00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32df400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 0x7f32e00cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45086/0 (socket says 172.21.15.73:45086) 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32df400640 1 -- 172.21.15.73:0/3219187519 learned_addr learned my addr 172.21.15.73:0/3219187519 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32de000640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32e0146110 0x7f32e013ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32dea00640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 0x7f32e013fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32df400640 1 -- 172.21.15.73:0/3219187519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 msgr2=0x7f32e013fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32df400640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 0x7f32e013fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32df400640 1 -- 172.21.15.73:0/3219187519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32e0146110 msgr2=0x7f32e013ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32df400640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32e0146110 0x7f32e013ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32df400640 1 -- 172.21.15.73:0/3219187519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e0140450 con 0x7f32e015cbd0 2024-04-15T15:31:47.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32df400640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 0x7f32e00cf420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32d80af040 tx=0x7f32d8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:47.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32d6a00640 1 -- 172.21.15.73:0/3219187519 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d80bc020 con 0x7f32e015cbd0 2024-04-15T15:31:47.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32d6a00640 1 -- 172.21.15.73:0/3219187519 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d80b8670 con 0x7f32e015cbd0 2024-04-15T15:31:47.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32d6a00640 1 -- 172.21.15.73:0/3219187519 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d80b8a40 con 0x7f32e015cbd0 2024-04-15T15:31:47.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32e5800640 1 -- 172.21.15.73:0/3219187519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e013a7d0 con 0x7f32e015cbd0 2024-04-15T15:31:47.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32e5800640 1 -- 172.21.15.73:0/3219187519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e013ad90 con 0x7f32e015cbd0 2024-04-15T15:31:47.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32e5800640 1 -- 172.21.15.73:0/3219187519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e0068ab0 con 0x7f32e015cbd0 2024-04-15T15:31:47.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.665+0000 7f32d6a00640 1 -- 172.21.15.73:0/3219187519 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f32d80bf020 con 0x7f32e015cbd0 2024-04-15T15:31:47.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.669+0000 7f32d6a00640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32c0068380 0x7f32c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.669+0000 7f32d6a00640 1 -- 172.21.15.73:0/3219187519 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f32d8121d30 con 0x7f32e015cbd0 2024-04-15T15:31:47.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.669+0000 7f32dea00640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32c0068380 0x7f32c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.669+0000 7f32dea00640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32c0068380 0x7f32c006a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32d0004e30 tx=0x7f32d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:47.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.673+0000 7f32d6a00640 1 -- 172.21.15.73:0/3219187519 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f32d80c6030 con 0x7f32e015cbd0 2024-04-15T15:31:47.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 -- 172.21.15.73:0/3219187519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f32e013af60 con 0x7f32e015cbd0 2024-04-15T15:31:47.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32d6a00640 1 -- 172.21.15.73:0/3219187519 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f32d80165e0 con 0x7f32e015cbd0 2024-04-15T15:31:47.830 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:31:47.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 -- 172.21.15.73:0/3219187519 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32c0068380 msgr2=0x7f32c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32c0068380 0x7f32c006a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32d0004e30 tx=0x7f32d0009040 comp rx=0 tx=0).stop 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 -- 172.21.15.73:0/3219187519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 msgr2=0x7f32e00cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 0x7f32e00cf420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32d80af040 tx=0x7f32d8019790 comp rx=0 tx=0).stop 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 -- 172.21.15.73:0/3219187519 shutdown_connections 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32e015cbd0 0x7f32e00cf420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32e0146110 0x7f32e013ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32c0068380 0x7f32c006a840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 --2- 172.21.15.73:0/3219187519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e00b20b0 0x7f32e013fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 -- 172.21.15.73:0/3219187519 >> 172.21.15.73:0/3219187519 conn(0x7f32e0067dd0 msgr2=0x7f32e00aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 -- 172.21.15.73:0/3219187519 shutdown_connections 2024-04-15T15:31:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.829+0000 7f32e5800640 1 -- 172.21.15.73:0/3219187519 wait complete. 2024-04-15T15:31:47.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:31:47.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.989+0000 7f3626400640 1 Processor -- start 2024-04-15T15:31:47.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.989+0000 7f3626400640 1 -- start start 2024-04-15T15:31:47.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.989+0000 7f3626400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3620146110 0x7f36200cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.989+0000 7f3626400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36200b20b0 0x7f36200b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:47.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.989+0000 7f3626400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36200cd3a0 con 0x7f3620071e10 2024-04-15T15:31:47.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.989+0000 7f3626400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f36200b5160 con 0x7f3620146110 2024-04-15T15:31:47.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.989+0000 7f3626400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f36200b40c0 con 0x7f36200b20b0 2024-04-15T15:31:47.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3620146110 0x7f36200cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3620146110 0x7f36200cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45088/0 (socket says 172.21.15.73:45088) 2024-04-15T15:31:47.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361f400640 1 -- 172.21.15.73:0/1667582583 learned_addr learned my addr 172.21.15.73:0/1667582583 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:47.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361fe00640 1 --1- 172.21.15.73:0/1667582583 >> v1:172.21.15.73:6789/0 conn(0x7f3620071e10 0x7f36200722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37426/0 (socket says 172.21.15.73:37426) 2024-04-15T15:31:47.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f3616a00640 1 --2- 172.21.15.73:0/1667582583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36200b20b0 0x7f36200b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:47.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361f400640 1 -- 172.21.15.73:0/1667582583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36200b20b0 msgr2=0x7f36200b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:47.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361f400640 1 --2- 172.21.15.73:0/1667582583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36200b20b0 0x7f36200b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:47.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361f400640 1 -- 172.21.15.73:0/1667582583 >> v1:172.21.15.73:6789/0 conn(0x7f3620071e10 legacy=0x7f36200722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361f400640 1 -- 172.21.15.73:0/1667582583 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36200b43a0 con 0x7f3620146110 2024-04-15T15:31:47.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361ea00640 1 -- 172.21.15.73:0/1667582583 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430972908 0 0) 0x7f36200cd3a0 con 0x7f3620071e10 2024-04-15T15:31:47.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361f400640 1 --2- 172.21.15.73:0/1667582583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 0x7f36200cd7b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3610009e50 tx=0x7f361001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484f8e5c9cd9cd02 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:47.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361ea00640 1 -- 172.21.15.73:0/1667582583 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36100a57f0 con 0x7f3620146110 2024-04-15T15:31:47.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361ea00640 1 -- 172.21.15.73:0/1667582583 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36100a5990 con 0x7f3620146110 2024-04-15T15:31:47.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.993+0000 7f361ea00640 1 -- 172.21.15.73:0/1667582583 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36100a5d60 con 0x7f3620146110 2024-04-15T15:31:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.997+0000 7f3626400640 1 -- 172.21.15.73:0/1667582583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 msgr2=0x7f36200cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.997+0000 7f3626400640 1 --2- 172.21.15.73:0/1667582583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 0x7f36200cd7b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3610009e50 tx=0x7f361001ca30 comp rx=0 tx=0).stop 2024-04-15T15:31:48.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.997+0000 7f3626400640 1 -- 172.21.15.73:0/1667582583 shutdown_connections 2024-04-15T15:31:48.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.997+0000 7f3626400640 1 --2- 172.21.15.73:0/1667582583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36200b20b0 0x7f36200b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.997+0000 7f3626400640 1 --2- 172.21.15.73:0/1667582583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 0x7f36200cd7b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.997+0000 7f3626400640 1 -- 172.21.15.73:0/1667582583 >> 172.21.15.73:0/1667582583 conn(0x7f3620067dd0 msgr2=0x7f36200d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:48.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.997+0000 7f3626400640 1 -- 172.21.15.73:0/1667582583 shutdown_connections 2024-04-15T15:31:48.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:47.997+0000 7f3626400640 1 -- 172.21.15.73:0/1667582583 wait complete. 2024-04-15T15:31:48.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3626400640 1 Processor -- start 2024-04-15T15:31:48.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3626400640 1 -- start start 2024-04-15T15:31:48.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3626400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3620071e10 0x7f362013b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3626400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36200b20b0 0x7f362015be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3626400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 0x7f362015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3626400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f36200cdcf0 con 0x7f3620146110 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3626400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f36200b3d70 con 0x7f3620071e10 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3626400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f362015dbe0 con 0x7f36200b20b0 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 0x7f362015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 0x7f362015c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45098/0 (socket says 172.21.15.73:45098) 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361fe00640 1 -- 172.21.15.73:0/3394013961 learned_addr learned my addr 172.21.15.73:0/3394013961 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361f400640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3620071e10 0x7f362013b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3616a00640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36200b20b0 0x7f362015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361fe00640 1 -- 172.21.15.73:0/3394013961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36200b20b0 msgr2=0x7f362015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361fe00640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36200b20b0 0x7f362015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361fe00640 1 -- 172.21.15.73:0/3394013961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3620071e10 msgr2=0x7f362013b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361fe00640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3620071e10 0x7f362013b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361fe00640 1 -- 172.21.15.73:0/3394013961 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362013b710 con 0x7f3620146110 2024-04-15T15:31:48.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361f400640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3620071e10 0x7f362013b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:48.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f361fe00640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 0x7f362015c3b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f361800c410 tx=0x7f361800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:48.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3617e00640 1 -- 172.21.15.73:0/3394013961 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36180074e0 con 0x7f3620146110 2024-04-15T15:31:48.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3617e00640 1 -- 172.21.15.73:0/3394013961 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36180047f0 con 0x7f3620146110 2024-04-15T15:31:48.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3617e00640 1 -- 172.21.15.73:0/3394013961 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3618007680 con 0x7f3620146110 2024-04-15T15:31:48.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3626400640 1 -- 172.21.15.73:0/3394013961 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3620140a20 con 0x7f3620146110 2024-04-15T15:31:48.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.001+0000 7f3626400640 1 -- 172.21.15.73:0/3394013961 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3620140fe0 con 0x7f3620146110 2024-04-15T15:31:48.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.005+0000 7f3626400640 1 -- 172.21.15.73:0/3394013961 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3620068ab0 con 0x7f3620146110 2024-04-15T15:31:48.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.005+0000 7f3617e00640 1 -- 172.21.15.73:0/3394013961 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3618011070 con 0x7f3620146110 2024-04-15T15:31:48.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.005+0000 7f3617e00640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35fc068380 0x7f35fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.005+0000 7f3617e00640 1 -- 172.21.15.73:0/3394013961 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f36180868d0 con 0x7f3620146110 2024-04-15T15:31:48.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.005+0000 7f361f400640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35fc068380 0x7f35fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.005+0000 7f361f400640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35fc068380 0x7f35fc06a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f36100ae000 tx=0x7f36100a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:48.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.009+0000 7f3617e00640 1 -- 172.21.15.73:0/3394013961 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3618056ab0 con 0x7f3620146110 2024-04-15T15:31:48.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 -- 172.21.15.73:0/3394013961 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f36200cc680 con 0x7f3620146110 2024-04-15T15:31:48.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3617e00640 1 -- 172.21.15.73:0/3394013961 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f36180563b0 con 0x7f3620146110 2024-04-15T15:31:48.174 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:31:48.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 -- 172.21.15.73:0/3394013961 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35fc068380 msgr2=0x7f35fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35fc068380 0x7f35fc06a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f36100ae000 tx=0x7f36100a7070 comp rx=0 tx=0).stop 2024-04-15T15:31:48.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 -- 172.21.15.73:0/3394013961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 msgr2=0x7f362015c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 0x7f362015c3b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f361800c410 tx=0x7f361800c8d0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 -- 172.21.15.73:0/3394013961 shutdown_connections 2024-04-15T15:31:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3620146110 0x7f362015c3b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35fc068380 0x7f35fc06a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36200b20b0 0x7f362015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 --2- 172.21.15.73:0/3394013961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3620071e10 0x7f362013b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 -- 172.21.15.73:0/3394013961 >> 172.21.15.73:0/3394013961 conn(0x7f3620067dd0 msgr2=0x7f36200b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 -- 172.21.15.73:0/3394013961 shutdown_connections 2024-04-15T15:31:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.173+0000 7f3626400640 1 -- 172.21.15.73:0/3394013961 wait complete. 2024-04-15T15:31:48.195 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:31:48.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f9705400640 1 Processor -- start 2024-04-15T15:31:48.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f9705400640 1 -- start start 2024-04-15T15:31:48.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f9705400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f970015b5d0 0x7f970015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f9705400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f97000b27c0 0x7f97000b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f9705400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9700070160 con 0x7f97000b3e30 2024-04-15T15:31:48.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f9705400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f970015b9b0 con 0x7f97000b27c0 2024-04-15T15:31:48.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f9705400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f970015f1f0 con 0x7f970015b5d0 2024-04-15T15:31:48.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f96fde00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f97000b3e30 0x7f97000b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37430/0 (socket says 172.21.15.73:37430) 2024-04-15T15:31:48.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f96fde00640 1 -- 172.21.15.73:0/2258978756 learned_addr learned my addr 172.21.15.73:0/2258978756 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:48.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f96ff200640 1 --2- 172.21.15.73:0/2258978756 >> v2:172.21.15.73:3300/0 conn(0x7f97000b27c0 0x7f97000b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f96fe800640 1 --2- 172.21.15.73:0/2258978756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f970015b5d0 0x7f970015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f96ff200640 1 -- 172.21.15.73:0/2258978756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f970015b5d0 msgr2=0x7f970015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:48.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f96ff200640 1 --2- 172.21.15.73:0/2258978756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f970015b5d0 0x7f970015fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f96ff200640 1 -- 172.21.15.73:0/2258978756 >> v1:172.21.15.73:6789/0 conn(0x7f97000b3e30 legacy=0x7f97000b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f96ff200640 1 -- 172.21.15.73:0/2258978756 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970006fe80 con 0x7f97000b27c0 2024-04-15T15:31:48.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.329+0000 7f96fd400640 1 -- 172.21.15.73:0/2258978756 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3441576609 0 0) 0x7f9700070160 con 0x7f97000b3e30 2024-04-15T15:31:48.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f96ff200640 1 --2- 172.21.15.73:0/2258978756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 0x7f97000b4740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009d90 tx=0x7f96f801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b632812782b353ff server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f96fd400640 1 -- 172.21.15.73:0/2258978756 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f80b2070 con 0x7f97000b27c0 2024-04-15T15:31:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f96fd400640 1 -- 172.21.15.73:0/2258978756 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f80a56e0 con 0x7f97000b27c0 2024-04-15T15:31:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f96fd400640 1 -- 172.21.15.73:0/2258978756 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f80a5ab0 con 0x7f97000b27c0 2024-04-15T15:31:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f9705400640 1 -- 172.21.15.73:0/2258978756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 msgr2=0x7f97000b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f9705400640 1 --2- 172.21.15.73:0/2258978756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 0x7f97000b4740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009d90 tx=0x7f96f801c820 comp rx=0 tx=0).stop 2024-04-15T15:31:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f9705400640 1 -- 172.21.15.73:0/2258978756 shutdown_connections 2024-04-15T15:31:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f9705400640 1 --2- 172.21.15.73:0/2258978756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 0x7f97000b4740 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f9705400640 1 --2- 172.21.15.73:0/2258978756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f970015b5d0 0x7f970015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f9705400640 1 -- 172.21.15.73:0/2258978756 >> 172.21.15.73:0/2258978756 conn(0x7f9700067dd0 msgr2=0x7f97000d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f9705400640 1 -- 172.21.15.73:0/2258978756 shutdown_connections 2024-04-15T15:31:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.333+0000 7f9705400640 1 -- 172.21.15.73:0/2258978756 wait complete. 2024-04-15T15:31:48.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f9705400640 1 Processor -- start 2024-04-15T15:31:48.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f9705400640 1 -- start start 2024-04-15T15:31:48.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f9705400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 0x7f97000aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f9705400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97000b3e30 0x7f97000aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f9705400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f970015b5d0 0x7f97000aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f9705400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f970006faa0 con 0x7f97000b27c0 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f9705400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f97000b4250 con 0x7f97000b3e30 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f9705400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f970006fc20 con 0x7f970015b5d0 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96fe800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 0x7f97000aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96fe800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 0x7f97000aa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45108/0 (socket says 172.21.15.73:45108) 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96fe800640 1 -- 172.21.15.73:0/387923247 learned_addr learned my addr 172.21.15.73:0/387923247 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96fe800640 1 -- 172.21.15.73:0/387923247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f970015b5d0 msgr2=0x7f97000aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96fe800640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f970015b5d0 0x7f97000aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96fe800640 1 -- 172.21.15.73:0/387923247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97000b3e30 msgr2=0x7f97000aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96fe800640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97000b3e30 0x7f97000aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96fe800640 1 -- 172.21.15.73:0/387923247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97000af540 con 0x7f97000b27c0 2024-04-15T15:31:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96fe800640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 0x7f97000aa510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f96f000e960 tx=0x7f96f000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96f6a00640 1 -- 172.21.15.73:0/387923247 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f0017070 con 0x7f97000b27c0 2024-04-15T15:31:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f9705400640 1 -- 172.21.15.73:0/387923247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97000ac7b0 con 0x7f97000b27c0 2024-04-15T15:31:48.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f9705400640 1 -- 172.21.15.73:0/387923247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9700160080 con 0x7f97000b27c0 2024-04-15T15:31:48.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96f6a00640 1 -- 172.21.15.73:0/387923247 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f000ca00 con 0x7f97000b27c0 2024-04-15T15:31:48.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.337+0000 7f96f6a00640 1 -- 172.21.15.73:0/387923247 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f0021060 con 0x7f97000b27c0 2024-04-15T15:31:48.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.341+0000 7f9705400640 1 -- 172.21.15.73:0/387923247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d80052a0 con 0x7f97000b27c0 2024-04-15T15:31:48.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.341+0000 7f96f6a00640 1 -- 172.21.15.73:0/387923247 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f96f001a070 con 0x7f97000b27c0 2024-04-15T15:31:48.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.341+0000 7f96f6a00640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f96e0068380 0x7f96e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.341+0000 7f96f6a00640 1 -- 172.21.15.73:0/387923247 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f96f0086ea0 con 0x7f97000b27c0 2024-04-15T15:31:48.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.341+0000 7f96fde00640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f96e0068380 0x7f96e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.341+0000 7f96fde00640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f96e0068380 0x7f96e006a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9700148dd0 tx=0x7f96ec007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:48.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.345+0000 7f96f6a00640 1 -- 172.21.15.73:0/387923247 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f96f0057000 con 0x7f97000b27c0 2024-04-15T15:31:48.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 -- 172.21.15.73:0/387923247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f96d8005590 con 0x7f97000b27c0 2024-04-15T15:31:48.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f96f6a00640 1 -- 172.21.15.73:0/387923247 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f96f0056900 con 0x7f97000b27c0 2024-04-15T15:31:48.518 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-15T15:31:48.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 -- 172.21.15.73:0/387923247 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f96e0068380 msgr2=0x7f96e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f96e0068380 0x7f96e006a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9700148dd0 tx=0x7f96ec007970 comp rx=0 tx=0).stop 2024-04-15T15:31:48.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 -- 172.21.15.73:0/387923247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 msgr2=0x7f97000aa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 0x7f97000aa510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f96f000e960 tx=0x7f96f000ee20 comp rx=0 tx=0).stop 2024-04-15T15:31:48.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 -- 172.21.15.73:0/387923247 shutdown_connections 2024-04-15T15:31:48.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f96e0068380 0x7f96e006a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f970015b5d0 0x7f97000aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97000b3e30 0x7f97000aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 --2- 172.21.15.73:0/387923247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97000b27c0 0x7f97000aa510 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 -- 172.21.15.73:0/387923247 >> 172.21.15.73:0/387923247 conn(0x7f9700067dd0 msgr2=0x7f970015db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:48.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 -- 172.21.15.73:0/387923247 shutdown_connections 2024-04-15T15:31:48.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.517+0000 7f9705400640 1 -- 172.21.15.73:0/387923247 wait complete. 2024-04-15T15:31:48.540 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:31:48.540 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:31:48.550 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f8325800640 1 Processor -- start 2024-04-15T15:31:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f8325800640 1 -- start start 2024-04-15T15:31:48.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f8325800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f832015b5d0 0x7f832015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f8325800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b3e30 0x7f83200b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f8325800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83200b25f0 0x7f83200b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f8325800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f832015b9b0 con 0x7f83200b25f0 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f8325800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f8320070160 con 0x7f832015b5d0 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f8325800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f832015f1f0 con 0x7f83200b3e30 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f831f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83200b25f0 0x7f83200b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f831f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83200b25f0 0x7f83200b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45124/0 (socket says 172.21.15.73:45124) 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f831f400640 1 -- 172.21.15.73:0/1265490209 learned_addr learned my addr 172.21.15.73:0/1265490209 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f8316000640 1 --2- 172.21.15.73:0/1265490209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b3e30 0x7f83200b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f831ea00640 1 --2- 172.21.15.73:0/1265490209 >> v2:172.21.15.118:3300/0 conn(0x7f832015b5d0 0x7f832015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f831f400640 1 -- 172.21.15.73:0/1265490209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b3e30 msgr2=0x7f83200b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f831f400640 1 --2- 172.21.15.73:0/1265490209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b3e30 0x7f83200b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f831f400640 1 -- 172.21.15.73:0/1265490209 >> v2:172.21.15.118:3300/0 conn(0x7f832015b5d0 msgr2=0x7f832015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f831f400640 1 --2- 172.21.15.73:0/1265490209 >> v2:172.21.15.118:3300/0 conn(0x7f832015b5d0 0x7f832015fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.721+0000 7f831f400640 1 -- 172.21.15.73:0/1265490209 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832006fe80 con 0x7f83200b25f0 2024-04-15T15:31:48.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f831f400640 1 --2- 172.21.15.73:0/1265490209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83200b25f0 0x7f83200b4740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83200d1010 tx=0x7f831801e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280467aed254f049 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f831e000640 1 -- 172.21.15.73:0/1265490209 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83180ac430 con 0x7f83200b25f0 2024-04-15T15:31:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f831e000640 1 -- 172.21.15.73:0/1265490209 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83180b1070 con 0x7f83200b25f0 2024-04-15T15:31:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f831e000640 1 -- 172.21.15.73:0/1265490209 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83180ac5f0 con 0x7f83200b25f0 2024-04-15T15:31:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f8325800640 1 -- 172.21.15.73:0/1265490209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83200b25f0 msgr2=0x7f83200b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f8325800640 1 --2- 172.21.15.73:0/1265490209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83200b25f0 0x7f83200b4740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83200d1010 tx=0x7f831801e610 comp rx=0 tx=0).stop 2024-04-15T15:31:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f8325800640 1 -- 172.21.15.73:0/1265490209 shutdown_connections 2024-04-15T15:31:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f8325800640 1 --2- 172.21.15.73:0/1265490209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83200b25f0 0x7f83200b4740 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f8325800640 1 --2- 172.21.15.73:0/1265490209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b3e30 0x7f83200b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f8325800640 1 --2- 172.21.15.73:0/1265490209 >> v2:172.21.15.118:3300/0 conn(0x7f832015b5d0 0x7f832015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f8325800640 1 -- 172.21.15.73:0/1265490209 >> 172.21.15.73:0/1265490209 conn(0x7f8320067dd0 msgr2=0x7f83200d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f8325800640 1 -- 172.21.15.73:0/1265490209 shutdown_connections 2024-04-15T15:31:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.725+0000 7f8325800640 1 -- 172.21.15.73:0/1265490209 wait complete. 2024-04-15T15:31:48.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8325800640 1 Processor -- start 2024-04-15T15:31:48.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8325800640 1 -- start start 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8325800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b25f0 0x7f8320148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8325800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83200b3e30 0x7f832015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8325800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832015b5d0 0x7f8320164620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8325800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f83200b4390 con 0x7f832015b5d0 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8325800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f83200b4210 con 0x7f83200b3e30 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8325800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f832006faa0 con 0x7f83200b25f0 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832015b5d0 0x7f8320164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832015b5d0 0x7f8320164620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45132/0 (socket says 172.21.15.73:45132) 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831f400640 1 -- 172.21.15.73:0/3328710718 learned_addr learned my addr 172.21.15.73:0/3328710718 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8316000640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83200b3e30 0x7f832015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831ea00640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b25f0 0x7f8320148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831f400640 1 -- 172.21.15.73:0/3328710718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b25f0 msgr2=0x7f8320148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831f400640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b25f0 0x7f8320148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831f400640 1 -- 172.21.15.73:0/3328710718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83200b3e30 msgr2=0x7f832015bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831f400640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83200b3e30 0x7f832015bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831f400640 1 -- 172.21.15.73:0/3328710718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832015c080 con 0x7f832015b5d0 2024-04-15T15:31:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831ea00640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b25f0 0x7f8320148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f831f400640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832015b5d0 0x7f8320164620 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f83180ae040 tx=0x7f831801ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8317400640 1 -- 172.21.15.73:0/3328710718 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83180bb070 con 0x7f832015b5d0 2024-04-15T15:31:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8317400640 1 -- 172.21.15.73:0/3328710718 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83180ace50 con 0x7f832015b5d0 2024-04-15T15:31:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8317400640 1 -- 172.21.15.73:0/3328710718 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83180b78a0 con 0x7f832015b5d0 2024-04-15T15:31:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8325800640 1 -- 172.21.15.73:0/3328710718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8320164e50 con 0x7f832015b5d0 2024-04-15T15:31:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.729+0000 7f8325800640 1 -- 172.21.15.73:0/3328710718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8320165410 con 0x7f832015b5d0 2024-04-15T15:31:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.733+0000 7f8325800640 1 -- 172.21.15.73:0/3328710718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8320068ab0 con 0x7f832015b5d0 2024-04-15T15:31:48.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.733+0000 7f8317400640 1 -- 172.21.15.73:0/3328710718 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f83180be070 con 0x7f832015b5d0 2024-04-15T15:31:48.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.733+0000 7f8317400640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82fc0683b0 0x7f82fc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:48.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.733+0000 7f8317400640 1 -- 172.21.15.73:0/3328710718 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8318121070 con 0x7f832015b5d0 2024-04-15T15:31:48.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.733+0000 7f831ea00640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82fc0683b0 0x7f82fc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:48.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.733+0000 7f831ea00640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82fc0683b0 0x7f82fc06a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f831000b970 tx=0x7f8310008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:48.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.737+0000 7f8317400640 1 -- 172.21.15.73:0/3328710718 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8318018320 con 0x7f832015b5d0 2024-04-15T15:31:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.897+0000 7f8325800640 1 -- 172.21.15.73:0/3328710718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83200b08f0 con 0x7f832015b5d0 2024-04-15T15:31:48.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.897+0000 7f8317400640 1 -- 172.21.15.73:0/3328710718 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f83180f0c90 con 0x7f832015b5d0 2024-04-15T15:31:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:48.900 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:48.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 -- 172.21.15.73:0/3328710718 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82fc0683b0 msgr2=0x7f82fc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82fc0683b0 0x7f82fc06a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f831000b970 tx=0x7f8310008040 comp rx=0 tx=0).stop 2024-04-15T15:31:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 -- 172.21.15.73:0/3328710718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832015b5d0 msgr2=0x7f8320164620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832015b5d0 0x7f8320164620 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f83180ae040 tx=0x7f831801ce50 comp rx=0 tx=0).stop 2024-04-15T15:31:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 -- 172.21.15.73:0/3328710718 shutdown_connections 2024-04-15T15:31:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f832015b5d0 0x7f8320164620 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83200b3e30 0x7f832015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82fc0683b0 0x7f82fc06a870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 --2- 172.21.15.73:0/3328710718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83200b25f0 0x7f8320148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 -- 172.21.15.73:0/3328710718 >> 172.21.15.73:0/3328710718 conn(0x7f8320067dd0 msgr2=0x7f83200ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 -- 172.21.15.73:0/3328710718 shutdown_connections 2024-04-15T15:31:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:48.901+0000 7f8325800640 1 -- 172.21.15.73:0/3328710718 wait complete. 2024-04-15T15:31:48.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:31:48.922 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:31:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.057+0000 7fd646800640 1 Processor -- start 2024-04-15T15:31:49.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.057+0000 7fd646800640 1 -- start start 2024-04-15T15:31:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd646800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd64015fe40 0x7fd6400b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd646800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6400b3250 0x7fd6400cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd646800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6400ccfe0 con 0x7fd64015fa60 2024-04-15T15:31:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd646800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd6400d09f0 con 0x7fd64015fe40 2024-04-15T15:31:49.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd646800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd6400d0cd0 con 0x7fd6400b3250 2024-04-15T15:31:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd645400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd64015fa60 0x7fd6400cd4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37446/0 (socket says 172.21.15.73:37446) 2024-04-15T15:31:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd645400640 1 -- 172.21.15.73:0/2282357635 learned_addr learned my addr 172.21.15.73:0/2282357635 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd644a00640 1 --2- 172.21.15.73:0/2282357635 >> v2:172.21.15.118:3300/0 conn(0x7fd64015fe40 0x7fd6400b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd645e00640 1 --2- 172.21.15.73:0/2282357635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6400b3250 0x7fd6400cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd63fe00640 1 -- 172.21.15.73:0/2282357635 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655896634 0 0) 0x7fd6400ccfe0 con 0x7fd64015fa60 2024-04-15T15:31:49.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd63fe00640 1 -- 172.21.15.73:0/2282357635 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd628003530 con 0x7fd64015fa60 2024-04-15T15:31:49.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd63fe00640 1 -- 172.21.15.73:0/2282357635 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2635916759 0 0) 0x7fd628003530 con 0x7fd64015fa60 2024-04-15T15:31:49.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd644a00640 1 -- 172.21.15.73:0/2282357635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6400b3250 msgr2=0x7fd6400cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:49.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd644a00640 1 --2- 172.21.15.73:0/2282357635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6400b3250 0x7fd6400cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd644a00640 1 -- 172.21.15.73:0/2282357635 >> v1:172.21.15.73:6789/0 conn(0x7fd64015fa60 legacy=0x7fd6400cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd644a00640 1 -- 172.21.15.73:0/2282357635 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6400d0fb0 con 0x7fd64015fe40 2024-04-15T15:31:49.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.061+0000 7fd645e00640 1 --2- 172.21.15.73:0/2282357635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6400b3250 0x7fd6400cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:49.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd644a00640 1 --2- 172.21.15.73:0/2282357635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd64015fe40 0x7fd6400b51c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0097c0 tx=0x7fd62c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c05b49765110edf server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:49.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd63fe00640 1 -- 172.21.15.73:0/2282357635 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0b0070 con 0x7fd64015fe40 2024-04-15T15:31:49.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd63fe00640 1 -- 172.21.15.73:0/2282357635 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62c0ab400 con 0x7fd64015fe40 2024-04-15T15:31:49.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd63fe00640 1 -- 172.21.15.73:0/2282357635 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634001a00 con 0x7fd64015fe40 2024-04-15T15:31:49.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 -- 172.21.15.73:0/2282357635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd64015fe40 msgr2=0x7fd6400b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 --2- 172.21.15.73:0/2282357635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd64015fe40 0x7fd6400b51c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0097c0 tx=0x7fd62c01c360 comp rx=0 tx=0).stop 2024-04-15T15:31:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 -- 172.21.15.73:0/2282357635 shutdown_connections 2024-04-15T15:31:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 --2- 172.21.15.73:0/2282357635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6400b3250 0x7fd6400cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 --2- 172.21.15.73:0/2282357635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd64015fe40 0x7fd6400b51c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 -- 172.21.15.73:0/2282357635 >> 172.21.15.73:0/2282357635 conn(0x7fd6400b3e60 msgr2=0x7fd6400b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 -- 172.21.15.73:0/2282357635 shutdown_connections 2024-04-15T15:31:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 -- 172.21.15.73:0/2282357635 wait complete. 2024-04-15T15:31:49.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 Processor -- start 2024-04-15T15:31:49.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 -- start start 2024-04-15T15:31:49.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6400b3250 0x7fd64015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd64015fa60 0x7fd6401580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd64015fe40 0x7fd640158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd640160d10 con 0x7fd64015fa60 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd640160b90 con 0x7fd6400b3250 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.065+0000 7fd646800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd640160e90 con 0x7fd64015fe40 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd644a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd64015fa60 0x7fd6401580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd644a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd64015fa60 0x7fd6401580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45140/0 (socket says 172.21.15.73:45140) 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd644a00640 1 -- 172.21.15.73:0/3560205107 learned_addr learned my addr 172.21.15.73:0/3560205107 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd645400640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6400b3250 0x7fd64015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd645e00640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd64015fe40 0x7fd640158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd644a00640 1 -- 172.21.15.73:0/3560205107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd64015fe40 msgr2=0x7fd640158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd644a00640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd64015fe40 0x7fd640158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd644a00640 1 -- 172.21.15.73:0/3560205107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6400b3250 msgr2=0x7fd64015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd644a00640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6400b3250 0x7fd64015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd644a00640 1 -- 172.21.15.73:0/3560205107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd640156bf0 con 0x7fd64015fa60 2024-04-15T15:31:49.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd644a00640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd64015fa60 0x7fd6401580e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd62c01aa70 tx=0x7fd62c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:49.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd63d600640 1 -- 172.21.15.73:0/3560205107 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0b0070 con 0x7fd64015fa60 2024-04-15T15:31:49.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd63d600640 1 -- 172.21.15.73:0/3560205107 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62c0b1040 con 0x7fd64015fa60 2024-04-15T15:31:49.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd646800640 1 -- 172.21.15.73:0/3560205107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64015ab40 con 0x7fd64015fa60 2024-04-15T15:31:49.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd63d600640 1 -- 172.21.15.73:0/3560205107 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c003c30 con 0x7fd64015fa60 2024-04-15T15:31:49.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd646800640 1 -- 172.21.15.73:0/3560205107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64015b100 con 0x7fd64015fa60 2024-04-15T15:31:49.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd646800640 1 -- 172.21.15.73:0/3560205107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd64004fd60 con 0x7fd64015fa60 2024-04-15T15:31:49.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd63d600640 1 -- 172.21.15.73:0/3560205107 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd62c0bd060 con 0x7fd64015fa60 2024-04-15T15:31:49.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.069+0000 7fd63d600640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd620068380 0x7fd62006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.073+0000 7fd63d600640 1 -- 172.21.15.73:0/3560205107 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd62c11ff80 con 0x7fd64015fa60 2024-04-15T15:31:49.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.073+0000 7fd645400640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd620068380 0x7fd62006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.073+0000 7fd645400640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd620068380 0x7fd62006a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd634001340 tx=0x7fd634009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:49.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.077+0000 7fd63d600640 1 -- 172.21.15.73:0/3560205107 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd62c015fb0 con 0x7fd64015fa60 2024-04-15T15:31:49.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.229+0000 7fd646800640 1 -- 172.21.15.73:0/3560205107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd6400caa40 con 0x7fd64015fa60 2024-04-15T15:31:49.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.229+0000 7fd63d600640 1 -- 172.21.15.73:0/3560205107 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fd62c0bd350 con 0x7fd64015fa60 2024-04-15T15:31:49.233 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 -- 172.21.15.73:0/3560205107 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd620068380 msgr2=0x7fd62006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd620068380 0x7fd62006a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd634001340 tx=0x7fd634009040 comp rx=0 tx=0).stop 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 -- 172.21.15.73:0/3560205107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd64015fa60 msgr2=0x7fd6401580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd64015fa60 0x7fd6401580e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd62c01aa70 tx=0x7fd62c019160 comp rx=0 tx=0).stop 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 -- 172.21.15.73:0/3560205107 shutdown_connections 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd620068380 0x7fd62006a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd64015fe40 0x7fd640158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd64015fa60 0x7fd6401580e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 --2- 172.21.15.73:0/3560205107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6400b3250 0x7fd64015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 -- 172.21.15.73:0/3560205107 >> 172.21.15.73:0/3560205107 conn(0x7fd6400b3e60 msgr2=0x7fd6400b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 -- 172.21.15.73:0/3560205107 shutdown_connections 2024-04-15T15:31:49.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.233+0000 7fd646800640 1 -- 172.21.15.73:0/3560205107 wait complete. 2024-04-15T15:31:49.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:31:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb97800640 1 Processor -- start 2024-04-15T15:31:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb97800640 1 -- start start 2024-04-15T15:31:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb97800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbb900b20b0 0x7fbb900b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb97800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbb9015cbd0 0x7fbb9015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb97800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb900cd3a0 con 0x7fbb90146110 2024-04-15T15:31:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb97800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbb900b5160 con 0x7fbb9015cbd0 2024-04-15T15:31:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb97800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fbb900b40c0 con 0x7fbb900b20b0 2024-04-15T15:31:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb94e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbb90146110 0x7fbb900cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37456/0 (socket says 172.21.15.73:37456) 2024-04-15T15:31:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb94e00640 1 -- 172.21.15.73:0/2330478726 learned_addr learned my addr 172.21.15.73:0/2330478726 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb95800640 1 --2- 172.21.15.73:0/2330478726 >> v2:172.21.15.73:3300/0 conn(0x7fbb9015cbd0 0x7fbb9015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb8fe00640 1 --2- 172.21.15.73:0/2330478726 >> v2:172.21.15.118:3300/0 conn(0x7fbb900b20b0 0x7fbb900b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb8f400640 1 -- 172.21.15.73:0/2330478726 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285025443 0 0) 0x7fbb900cd3a0 con 0x7fbb90146110 2024-04-15T15:31:49.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb8f400640 1 -- 172.21.15.73:0/2330478726 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb78003530 con 0x7fbb90146110 2024-04-15T15:31:49.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb95800640 1 -- 172.21.15.73:0/2330478726 >> v2:172.21.15.118:3300/0 conn(0x7fbb900b20b0 msgr2=0x7fbb900b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:49.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb95800640 1 --2- 172.21.15.73:0/2330478726 >> v2:172.21.15.118:3300/0 conn(0x7fbb900b20b0 0x7fbb900b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb95800640 1 -- 172.21.15.73:0/2330478726 >> v1:172.21.15.73:6789/0 conn(0x7fbb90146110 legacy=0x7fbb900cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.393+0000 7fbb95800640 1 -- 172.21.15.73:0/2330478726 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb900b43a0 con 0x7fbb9015cbd0 2024-04-15T15:31:49.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb95800640 1 --2- 172.21.15.73:0/2330478726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9015cbd0 0x7fbb9015d020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb900cd570 tx=0x7fbb8801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76599d7811b8eb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:49.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb8f400640 1 -- 172.21.15.73:0/2330478726 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb880b2070 con 0x7fbb9015cbd0 2024-04-15T15:31:49.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb8f400640 1 -- 172.21.15.73:0/2330478726 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb880a58e0 con 0x7fbb9015cbd0 2024-04-15T15:31:49.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb8f400640 1 -- 172.21.15.73:0/2330478726 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb880a5cb0 con 0x7fbb9015cbd0 2024-04-15T15:31:49.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb97800640 1 -- 172.21.15.73:0/2330478726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9015cbd0 msgr2=0x7fbb9015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb97800640 1 --2- 172.21.15.73:0/2330478726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9015cbd0 0x7fbb9015d020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb900cd570 tx=0x7fbb8801c930 comp rx=0 tx=0).stop 2024-04-15T15:31:49.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb97800640 1 -- 172.21.15.73:0/2330478726 shutdown_connections 2024-04-15T15:31:49.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb97800640 1 --2- 172.21.15.73:0/2330478726 >> v2:172.21.15.118:3300/0 conn(0x7fbb900b20b0 0x7fbb900b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb97800640 1 --2- 172.21.15.73:0/2330478726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9015cbd0 0x7fbb9015d020 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb97800640 1 -- 172.21.15.73:0/2330478726 >> 172.21.15.73:0/2330478726 conn(0x7fbb90067dd0 msgr2=0x7fbb900d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:49.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb97800640 1 -- 172.21.15.73:0/2330478726 shutdown_connections 2024-04-15T15:31:49.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb97800640 1 -- 172.21.15.73:0/2330478726 wait complete. 2024-04-15T15:31:49.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb97800640 1 Processor -- start 2024-04-15T15:31:49.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.397+0000 7fbb97800640 1 -- start start 2024-04-15T15:31:49.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb97800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b20b0 0x7fbb9015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb97800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb90146110 0x7fbb90157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb97800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9015cbd0 0x7fbb900b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb97800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbb90169210 con 0x7fbb90146110 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb97800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbb900b3d70 con 0x7fbb9015cbd0 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb97800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbb90169390 con 0x7fbb900b20b0 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb90146110 0x7fbb90157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb90146110 0x7fbb90157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45146/0 (socket says 172.21.15.73:45146) 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8fe00640 1 -- 172.21.15.73:0/775423270 learned_addr learned my addr 172.21.15.73:0/775423270 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb95800640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9015cbd0 0x7fbb900b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb94e00640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b20b0 0x7fbb9015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8fe00640 1 -- 172.21.15.73:0/775423270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b20b0 msgr2=0x7fbb9015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8fe00640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b20b0 0x7fbb9015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8fe00640 1 -- 172.21.15.73:0/775423270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9015cbd0 msgr2=0x7fbb900b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8fe00640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9015cbd0 0x7fbb900b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8fe00640 1 -- 172.21.15.73:0/775423270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9015aa50 con 0x7fbb90146110 2024-04-15T15:31:49.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb95800640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9015cbd0 0x7fbb900b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:49.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb94e00640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b20b0 0x7fbb9015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:49.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8fe00640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb90146110 0x7fbb90157ee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00e930 tx=0x7fbb7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:49.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8cc00640 1 -- 172.21.15.73:0/775423270 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c017070 con 0x7fbb90146110 2024-04-15T15:31:49.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8cc00640 1 -- 172.21.15.73:0/775423270 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7c00ca00 con 0x7fbb90146110 2024-04-15T15:31:49.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb97800640 1 -- 172.21.15.73:0/775423270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9015acf0 con 0x7fbb90146110 2024-04-15T15:31:49.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8cc00640 1 -- 172.21.15.73:0/775423270 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c00cdb0 con 0x7fbb90146110 2024-04-15T15:31:49.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb97800640 1 -- 172.21.15.73:0/775423270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9015b2b0 con 0x7fbb90146110 2024-04-15T15:31:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb97800640 1 -- 172.21.15.73:0/775423270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb90068ab0 con 0x7fbb90146110 2024-04-15T15:31:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.401+0000 7fbb8cc00640 1 -- 172.21.15.73:0/775423270 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb7c01a070 con 0x7fbb90146110 2024-04-15T15:31:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.405+0000 7fbb8cc00640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbb70068380 0x7fbb7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.405+0000 7fbb8cc00640 1 -- 172.21.15.73:0/775423270 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbb7c086e00 con 0x7fbb90146110 2024-04-15T15:31:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.405+0000 7fbb94e00640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbb70068380 0x7fbb7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.405+0000 7fbb94e00640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbb70068380 0x7fbb7006a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb84005890 tx=0x7fbb84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:49.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.409+0000 7fbb8cc00640 1 -- 172.21.15.73:0/775423270 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb7c0570a0 con 0x7fbb90146110 2024-04-15T15:31:49.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.565+0000 7fbb97800640 1 -- 172.21.15.73:0/775423270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbb90144d40 con 0x7fbb90146110 2024-04-15T15:31:49.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.565+0000 7fbb8cc00640 1 -- 172.21.15.73:0/775423270 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fbb7c0569a0 con 0x7fbb90146110 2024-04-15T15:31:49.568 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:31:49.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 -- 172.21.15.73:0/775423270 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbb70068380 msgr2=0x7fbb7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbb70068380 0x7fbb7006a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb84005890 tx=0x7fbb84009040 comp rx=0 tx=0).stop 2024-04-15T15:31:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 -- 172.21.15.73:0/775423270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb90146110 msgr2=0x7fbb90157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb90146110 0x7fbb90157ee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00e930 tx=0x7fbb7c00edf0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 -- 172.21.15.73:0/775423270 shutdown_connections 2024-04-15T15:31:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9015cbd0 0x7fbb900b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb90146110 0x7fbb90157ee0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbb70068380 0x7fbb7006a840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 --2- 172.21.15.73:0/775423270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b20b0 0x7fbb9015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 -- 172.21.15.73:0/775423270 >> 172.21.15.73:0/775423270 conn(0x7fbb90067dd0 msgr2=0x7fbb901591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 -- 172.21.15.73:0/775423270 shutdown_connections 2024-04-15T15:31:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.569+0000 7fbb97800640 1 -- 172.21.15.73:0/775423270 wait complete. 2024-04-15T15:31:49.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:31:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.725+0000 7f9b3b200640 1 Processor -- start 2024-04-15T15:31:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.725+0000 7f9b3b200640 1 -- start start 2024-04-15T15:31:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b3b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b34146110 0x7f9b340cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b3b200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b340b20b0 0x7f9b340b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b3b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b34071e10 0x7f9b340722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b3b200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9b340cd3a0 con 0x7f9b34146110 2024-04-15T15:31:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b3b200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f9b340b5160 con 0x7f9b340b20b0 2024-04-15T15:31:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b3b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9b340b40c0 con 0x7f9b34071e10 2024-04-15T15:31:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b33e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b34146110 0x7f9b340cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b33e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b34146110 0x7f9b340cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45152/0 (socket says 172.21.15.73:45152) 2024-04-15T15:31:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b33e00640 1 -- 172.21.15.73:0/4145800081 learned_addr learned my addr 172.21.15.73:0/4145800081 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b2b400640 1 --2- 172.21.15.73:0/4145800081 >> v2:172.21.15.118:3300/0 conn(0x7f9b340b20b0 0x7f9b340b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b39200640 1 --2- 172.21.15.73:0/4145800081 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b34071e10 0x7f9b340722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b33e00640 1 -- 172.21.15.73:0/4145800081 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b34071e10 msgr2=0x7f9b340722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b33e00640 1 --2- 172.21.15.73:0/4145800081 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b34071e10 0x7f9b340722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b33e00640 1 -- 172.21.15.73:0/4145800081 >> v2:172.21.15.118:3300/0 conn(0x7f9b340b20b0 msgr2=0x7f9b340b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b33e00640 1 --2- 172.21.15.73:0/4145800081 >> v2:172.21.15.118:3300/0 conn(0x7f9b340b20b0 0x7f9b340b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b33e00640 1 -- 172.21.15.73:0/4145800081 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b340b43a0 con 0x7f9b34146110 2024-04-15T15:31:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.729+0000 7f9b2b400640 1 --2- 172.21.15.73:0/4145800081 >> v2:172.21.15.118:3300/0 conn(0x7f9b340b20b0 0x7f9b340b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:49.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b33e00640 1 --2- 172.21.15.73:0/4145800081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b34146110 0x7f9b340cd7b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9b340701c0 tx=0x7f9b2401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2ac5143b36e66f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b33400640 1 -- 172.21.15.73:0/4145800081 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b240b1070 con 0x7f9b34146110 2024-04-15T15:31:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b33400640 1 -- 172.21.15.73:0/4145800081 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b240ac630 con 0x7f9b34146110 2024-04-15T15:31:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b33400640 1 -- 172.21.15.73:0/4145800081 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b240a8050 con 0x7f9b34146110 2024-04-15T15:31:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 -- 172.21.15.73:0/4145800081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b34146110 msgr2=0x7f9b340cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 --2- 172.21.15.73:0/4145800081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b34146110 0x7f9b340cd7b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9b340701c0 tx=0x7f9b2401c520 comp rx=0 tx=0).stop 2024-04-15T15:31:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 -- 172.21.15.73:0/4145800081 shutdown_connections 2024-04-15T15:31:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 --2- 172.21.15.73:0/4145800081 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b34071e10 0x7f9b340722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 --2- 172.21.15.73:0/4145800081 >> v2:172.21.15.118:3300/0 conn(0x7f9b340b20b0 0x7f9b340b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 --2- 172.21.15.73:0/4145800081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b34146110 0x7f9b340cd7b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 -- 172.21.15.73:0/4145800081 >> 172.21.15.73:0/4145800081 conn(0x7f9b34067dd0 msgr2=0x7f9b340d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 -- 172.21.15.73:0/4145800081 shutdown_connections 2024-04-15T15:31:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 -- 172.21.15.73:0/4145800081 wait complete. 2024-04-15T15:31:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 Processor -- start 2024-04-15T15:31:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 -- start start 2024-04-15T15:31:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b34071e10 0x7f9b340abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b340b20b0 0x7f9b340aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b34146110 0x7f9b340b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b340b3d70 con 0x7f9b340b20b0 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9b340b4c40 con 0x7f9b34146110 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b3b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9b340cdcf0 con 0x7f9b34071e10 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b2b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b340b20b0 0x7f9b340aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b2b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b340b20b0 0x7f9b340aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45158/0 (socket says 172.21.15.73:45158) 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.733+0000 7f9b2b400640 1 -- 172.21.15.73:0/1344582511 learned_addr learned my addr 172.21.15.73:0/1344582511 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b33e00640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b34071e10 0x7f9b340abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b39200640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b34146110 0x7f9b340b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b2b400640 1 -- 172.21.15.73:0/1344582511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b34071e10 msgr2=0x7f9b340abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b2b400640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b34071e10 0x7f9b340abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b2b400640 1 -- 172.21.15.73:0/1344582511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b34146110 msgr2=0x7f9b340b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b2b400640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b34146110 0x7f9b340b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b2b400640 1 -- 172.21.15.73:0/1344582511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b341fbd50 con 0x7f9b340b20b0 2024-04-15T15:31:49.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b2b400640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b340b20b0 0x7f9b340aeb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00d800 tx=0x7f9b1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:49.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b30c00640 1 -- 172.21.15.73:0/1344582511 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00b6c0 con 0x7f9b340b20b0 2024-04-15T15:31:49.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b30c00640 1 -- 172.21.15.73:0/1344582511 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1c019070 con 0x7f9b340b20b0 2024-04-15T15:31:49.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b3b200640 1 -- 172.21.15.73:0/1344582511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b340af070 con 0x7f9b340b20b0 2024-04-15T15:31:49.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b30c00640 1 -- 172.21.15.73:0/1344582511 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00baa0 con 0x7f9b340b20b0 2024-04-15T15:31:49.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b3b200640 1 -- 172.21.15.73:0/1344582511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b341fb270 con 0x7f9b340b20b0 2024-04-15T15:31:49.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b3b200640 1 -- 172.21.15.73:0/1344582511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b34068ab0 con 0x7f9b340b20b0 2024-04-15T15:31:49.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b30c00640 1 -- 172.21.15.73:0/1344582511 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9b1c00bc40 con 0x7f9b340b20b0 2024-04-15T15:31:49.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b30c00640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b10068380 0x7f9b1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:49.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.737+0000 7f9b30c00640 1 -- 172.21.15.73:0/1344582511 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9b1c087130 con 0x7f9b340b20b0 2024-04-15T15:31:49.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.741+0000 7f9b33e00640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b10068380 0x7f9b1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:49.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.741+0000 7f9b33e00640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b10068380 0x7f9b1006a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b240ae000 tx=0x7f9b24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.745+0000 7f9b30c00640 1 -- 172.21.15.73:0/1344582511 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b1c0573a0 con 0x7f9b340b20b0 2024-04-15T15:31:49.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.901+0000 7f9b3b200640 1 -- 172.21.15.73:0/1344582511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9b34142160 con 0x7f9b340b20b0 2024-04-15T15:31:49.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.901+0000 7f9b30c00640 1 -- 172.21.15.73:0/1344582511 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f9b1c056ca0 con 0x7f9b340b20b0 2024-04-15T15:31:49.903 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:31:49.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 -- 172.21.15.73:0/1344582511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b10068380 msgr2=0x7f9b1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b10068380 0x7f9b1006a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b240ae000 tx=0x7f9b24008040 comp rx=0 tx=0).stop 2024-04-15T15:31:49.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 -- 172.21.15.73:0/1344582511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b340b20b0 msgr2=0x7f9b340aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:49.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b340b20b0 0x7f9b340aeb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00d800 tx=0x7f9b1c00dcc0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 -- 172.21.15.73:0/1344582511 shutdown_connections 2024-04-15T15:31:49.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b34146110 0x7f9b340b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b340b20b0 0x7f9b340aeb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b10068380 0x7f9b1006a840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 --2- 172.21.15.73:0/1344582511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b34071e10 0x7f9b340abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:49.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 -- 172.21.15.73:0/1344582511 >> 172.21.15.73:0/1344582511 conn(0x7f9b34067dd0 msgr2=0x7f9b3415ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:49.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 -- 172.21.15.73:0/1344582511 shutdown_connections 2024-04-15T15:31:49.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:49.905+0000 7f9b3b200640 1 -- 172.21.15.73:0/1344582511 wait complete. 2024-04-15T15:31:49.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:31:50.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.061+0000 7f2c4ce00640 1 Processor -- start 2024-04-15T15:31:50.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.061+0000 7f2c4ce00640 1 -- start start 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.061+0000 7f2c4ce00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2c48146110 0x7f2c480cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.061+0000 7f2c4ce00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c480b20b0 0x7f2c480b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.061+0000 7f2c4ce00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c480cd3a0 con 0x7f2c48071e10 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.061+0000 7f2c4ce00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f2c480b5160 con 0x7f2c48146110 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.061+0000 7f2c4ce00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2c480b40c0 con 0x7f2c480b20b0 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.061+0000 7f2c46800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2c48071e10 0x7f2c480722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37472/0 (socket says 172.21.15.73:37472) 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.061+0000 7f2c46800640 1 -- 172.21.15.73:0/3916318288 learned_addr learned my addr 172.21.15.73:0/3916318288 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c45e00640 1 --2- 172.21.15.73:0/3916318288 >> v2:172.21.15.118:3300/0 conn(0x7f2c48146110 0x7f2c480cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c3d400640 1 --2- 172.21.15.73:0/3916318288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c480b20b0 0x7f2c480b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c45400640 1 -- 172.21.15.73:0/3916318288 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481228915 0 0) 0x7f2c480cd3a0 con 0x7f2c48071e10 2024-04-15T15:31:50.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c45400640 1 -- 172.21.15.73:0/3916318288 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c2c003530 con 0x7f2c48071e10 2024-04-15T15:31:50.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c3d400640 1 -- 172.21.15.73:0/3916318288 >> v2:172.21.15.118:3300/0 conn(0x7f2c48146110 msgr2=0x7f2c480cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:50.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c45400640 1 -- 172.21.15.73:0/3916318288 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2497322790 0 0) 0x7f2c2c003530 con 0x7f2c48071e10 2024-04-15T15:31:50.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c3d400640 1 --2- 172.21.15.73:0/3916318288 >> v2:172.21.15.118:3300/0 conn(0x7f2c48146110 0x7f2c480cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c3d400640 1 -- 172.21.15.73:0/3916318288 >> v1:172.21.15.73:6789/0 conn(0x7f2c48071e10 legacy=0x7f2c480722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c3d400640 1 -- 172.21.15.73:0/3916318288 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c480b43a0 con 0x7f2c480b20b0 2024-04-15T15:31:50.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c45e00640 1 --2- 172.21.15.73:0/3916318288 >> v2:172.21.15.118:3300/0 conn(0x7f2c48146110 0x7f2c480cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:50.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c3d400640 1 --2- 172.21.15.73:0/3916318288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c480b20b0 0x7f2c480b2530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c300097c0 tx=0x7f2c3001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a4873420c26998 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:50.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.065+0000 7f2c45400640 1 -- 172.21.15.73:0/3916318288 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c300b0070 con 0x7f2c480b20b0 2024-04-15T15:31:50.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c45400640 1 -- 172.21.15.73:0/3916318288 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c300ab400 con 0x7f2c480b20b0 2024-04-15T15:31:50.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c45400640 1 -- 172.21.15.73:0/3916318288 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40001a00 con 0x7f2c480b20b0 2024-04-15T15:31:50.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 -- 172.21.15.73:0/3916318288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c480b20b0 msgr2=0x7f2c480b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 --2- 172.21.15.73:0/3916318288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c480b20b0 0x7f2c480b2530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c300097c0 tx=0x7f2c3001c3c0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 -- 172.21.15.73:0/3916318288 shutdown_connections 2024-04-15T15:31:50.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 --2- 172.21.15.73:0/3916318288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c480b20b0 0x7f2c480b2530 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 --2- 172.21.15.73:0/3916318288 >> v2:172.21.15.118:3300/0 conn(0x7f2c48146110 0x7f2c480cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 -- 172.21.15.73:0/3916318288 >> 172.21.15.73:0/3916318288 conn(0x7f2c48067dd0 msgr2=0x7f2c480d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:50.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 -- 172.21.15.73:0/3916318288 shutdown_connections 2024-04-15T15:31:50.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 -- 172.21.15.73:0/3916318288 wait complete. 2024-04-15T15:31:50.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 Processor -- start 2024-04-15T15:31:50.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 -- start start 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c48071e10 0x7f2c4813a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c480b20b0 0x7f2c481f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c48146110 0x7f2c4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2c480cdcf0 con 0x7f2c480b20b0 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2c480b3d70 con 0x7f2c48071e10 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c4ce00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4815dbe0 con 0x7f2c48146110 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c3d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c480b20b0 0x7f2c481f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c3d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c480b20b0 0x7f2c481f7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45172/0 (socket says 172.21.15.73:45172) 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c3d400640 1 -- 172.21.15.73:0/1670094497 learned_addr learned my addr 172.21.15.73:0/1670094497 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c46800640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c48146110 0x7f2c4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c45e00640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c48071e10 0x7f2c4813a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c3d400640 1 -- 172.21.15.73:0/1670094497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c48146110 msgr2=0x7f2c4806ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c3d400640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c48146110 0x7f2c4806ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c3d400640 1 -- 172.21.15.73:0/1670094497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c48071e10 msgr2=0x7f2c4813a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c3d400640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c48071e10 0x7f2c4813a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.069+0000 7f2c3d400640 1 -- 172.21.15.73:0/1670094497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c481f8330 con 0x7f2c480b20b0 2024-04-15T15:31:50.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c3d400640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c480b20b0 0x7f2c481f7730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2c300ae040 tx=0x7f2c3001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:50.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c3ea00640 1 -- 172.21.15.73:0/1670094497 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c300b0050 con 0x7f2c480b20b0 2024-04-15T15:31:50.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c3ea00640 1 -- 172.21.15.73:0/1670094497 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c300bc070 con 0x7f2c480b20b0 2024-04-15T15:31:50.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c3ea00640 1 -- 172.21.15.73:0/1670094497 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c300b78b0 con 0x7f2c480b20b0 2024-04-15T15:31:50.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c4ce00640 1 -- 172.21.15.73:0/1670094497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4813ad30 con 0x7f2c480b20b0 2024-04-15T15:31:50.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c4ce00640 1 -- 172.21.15.73:0/1670094497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4813c460 con 0x7f2c480b20b0 2024-04-15T15:31:50.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c4ce00640 1 -- 172.21.15.73:0/1670094497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c48068ab0 con 0x7f2c480b20b0 2024-04-15T15:31:50.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c3ea00640 1 -- 172.21.15.73:0/1670094497 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2c300b7a50 con 0x7f2c480b20b0 2024-04-15T15:31:50.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c3ea00640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2c24068380 0x7f2c2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c3ea00640 1 -- 172.21.15.73:0/1670094497 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2c301213c0 con 0x7f2c480b20b0 2024-04-15T15:31:50.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.073+0000 7f2c45e00640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2c24068380 0x7f2c2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.077+0000 7f2c45e00640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2c24068380 0x7f2c2406a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c48143310 tx=0x7f2c38009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:50.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.077+0000 7f2c3ea00640 1 -- 172.21.15.73:0/1670094497 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2c481f8330 con 0x7f2c480b20b0 2024-04-15T15:31:50.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.233+0000 7f2c4ce00640 1 -- 172.21.15.73:0/1670094497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2c480cd620 con 0x7f2c480b20b0 2024-04-15T15:31:50.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.233+0000 7f2c3ea00640 1 -- 172.21.15.73:0/1670094497 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f2c30015fb0 con 0x7f2c480b20b0 2024-04-15T15:31:50.235 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:31:50.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 -- 172.21.15.73:0/1670094497 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2c24068380 msgr2=0x7f2c2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2c24068380 0x7f2c2406a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c48143310 tx=0x7f2c38009190 comp rx=0 tx=0).stop 2024-04-15T15:31:50.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 -- 172.21.15.73:0/1670094497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c480b20b0 msgr2=0x7f2c481f7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c480b20b0 0x7f2c481f7730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2c300ae040 tx=0x7f2c3001ac00 comp rx=0 tx=0).stop 2024-04-15T15:31:50.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 -- 172.21.15.73:0/1670094497 shutdown_connections 2024-04-15T15:31:50.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2c24068380 0x7f2c2406a840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c48146110 0x7f2c4806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c480b20b0 0x7f2c481f7730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 --2- 172.21.15.73:0/1670094497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c48071e10 0x7f2c4813a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 -- 172.21.15.73:0/1670094497 >> 172.21.15.73:0/1670094497 conn(0x7f2c48067dd0 msgr2=0x7f2c480cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:50.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 -- 172.21.15.73:0/1670094497 shutdown_connections 2024-04-15T15:31:50.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.237+0000 7f2c4ce00640 1 -- 172.21.15.73:0/1670094497 wait complete. 2024-04-15T15:31:50.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:31:50.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.389+0000 7f8e07a00640 1 Processor -- start 2024-04-15T15:31:50.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.389+0000 7f8e07a00640 1 -- start start 2024-04-15T15:31:50.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8e07a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e000b20b0 0x7f8e000b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8e07a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e000cd3a0 con 0x7f8e00146110 2024-04-15T15:31:50.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8e07a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e000b5160 con 0x7f8e0015cbd0 2024-04-15T15:31:50.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8e07a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8e000b40c0 con 0x7f8e000b20b0 2024-04-15T15:31:50.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8df7e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e000b20b0 0x7f8e000b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8e05000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8e00146110 0x7f8e000cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37476/0 (socket says 172.21.15.73:37476) 2024-04-15T15:31:50.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8df7e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e000b20b0 0x7f8e000b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45188/0 (socket says 172.21.15.73:45188) 2024-04-15T15:31:50.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8e05000640 1 -- 172.21.15.73:0/2680190815 learned_addr learned my addr 172.21.15.73:0/2680190815 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:50.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8df7e00640 1 -- 172.21.15.73:0/2680190815 >> v1:172.21.15.118:6789/0 conn(0x7f8e0015cbd0 legacy=0x7f8e0015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:50.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8df7e00640 1 -- 172.21.15.73:0/2680190815 >> v1:172.21.15.73:6789/0 conn(0x7f8e00146110 legacy=0x7f8e000cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8dffe00640 1 -- 172.21.15.73:0/2680190815 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586790026 0 0) 0x7f8e000cd3a0 con 0x7f8e00146110 2024-04-15T15:31:50.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.393+0000 7f8df7e00640 1 -- 172.21.15.73:0/2680190815 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e000b43a0 con 0x7f8e000b20b0 2024-04-15T15:31:50.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8df7e00640 1 --2- 172.21.15.73:0/2680190815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 0x7f8e000b2530 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8e000701c0 tx=0x7f8de801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df898584fd171d3a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:50.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8dffe00640 1 -- 172.21.15.73:0/2680190815 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de80b0070 con 0x7f8e000b20b0 2024-04-15T15:31:50.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8dffe00640 1 -- 172.21.15.73:0/2680190815 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de80ab600 con 0x7f8e000b20b0 2024-04-15T15:31:50.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8dffe00640 1 -- 172.21.15.73:0/2680190815 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de80ab9d0 con 0x7f8e000b20b0 2024-04-15T15:31:50.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8e07a00640 1 -- 172.21.15.73:0/2680190815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 msgr2=0x7f8e000b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8e07a00640 1 --2- 172.21.15.73:0/2680190815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 0x7f8e000b2530 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8e000701c0 tx=0x7f8de801c440 comp rx=0 tx=0).stop 2024-04-15T15:31:50.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8e07a00640 1 -- 172.21.15.73:0/2680190815 shutdown_connections 2024-04-15T15:31:50.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8e07a00640 1 --2- 172.21.15.73:0/2680190815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 0x7f8e000b2530 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8e07a00640 1 -- 172.21.15.73:0/2680190815 >> 172.21.15.73:0/2680190815 conn(0x7f8e00067dd0 msgr2=0x7f8e000d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:50.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8e07a00640 1 -- 172.21.15.73:0/2680190815 shutdown_connections 2024-04-15T15:31:50.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8e07a00640 1 -- 172.21.15.73:0/2680190815 wait complete. 2024-04-15T15:31:50.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8e07a00640 1 Processor -- start 2024-04-15T15:31:50.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.397+0000 7f8e07a00640 1 -- start start 2024-04-15T15:31:50.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e07a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 0x7f8e00158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e07a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e00146110 0x7f8e000cf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e07a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e0015cbd0 0x7f8e00139950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e07a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0016a220 con 0x7f8e000b20b0 2024-04-15T15:31:50.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e07a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8e000b3d70 con 0x7f8e00146110 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e07a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0016a3a0 con 0x7f8e0015cbd0 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e05000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 0x7f8e00158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e05000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 0x7f8e00158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45198/0 (socket says 172.21.15.73:45198) 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e05000640 1 -- 172.21.15.73:0/1720205390 learned_addr learned my addr 172.21.15.73:0/1720205390 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e05000640 1 -- 172.21.15.73:0/1720205390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e0015cbd0 msgr2=0x7f8e00139950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8df7e00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e00146110 0x7f8e000cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e05a00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e0015cbd0 0x7f8e00139950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e05000640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e0015cbd0 0x7f8e00139950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e05000640 1 -- 172.21.15.73:0/1720205390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e00146110 msgr2=0x7f8e000cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e05000640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e00146110 0x7f8e000cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e05000640 1 -- 172.21.15.73:0/1720205390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e001592c0 con 0x7f8e000b20b0 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8df7e00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e00146110 0x7f8e000cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e05000640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 0x7f8e00158880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8df00011f0 tx=0x7f8df000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:50.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8dfd600640 1 -- 172.21.15.73:0/1720205390 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0018070 con 0x7f8e000b20b0 2024-04-15T15:31:50.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8dfd600640 1 -- 172.21.15.73:0/1720205390 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df00074e0 con 0x7f8e000b20b0 2024-04-15T15:31:50.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8dfd600640 1 -- 172.21.15.73:0/1720205390 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0004a10 con 0x7f8e000b20b0 2024-04-15T15:31:50.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e07a00640 1 -- 172.21.15.73:0/1720205390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e00158dc0 con 0x7f8e000b20b0 2024-04-15T15:31:50.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e07a00640 1 -- 172.21.15.73:0/1720205390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0013a8f0 con 0x7f8e000b20b0 2024-04-15T15:31:50.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.401+0000 7f8e07a00640 1 -- 172.21.15.73:0/1720205390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e00068ab0 con 0x7f8e000b20b0 2024-04-15T15:31:50.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.405+0000 7f8dfd600640 1 -- 172.21.15.73:0/1720205390 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8df0004bb0 con 0x7f8e000b20b0 2024-04-15T15:31:50.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.405+0000 7f8dfd600640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ddc0683b0 0x7f8ddc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.405+0000 7f8dfd600640 1 -- 172.21.15.73:0/1720205390 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8df0085f50 con 0x7f8e000b20b0 2024-04-15T15:31:50.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.405+0000 7f8df7e00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ddc0683b0 0x7f8ddc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.405+0000 7f8df7e00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ddc0683b0 0x7f8ddc06a870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8de80ad000 tx=0x7f8de8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:50.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.409+0000 7f8dfd600640 1 -- 172.21.15.73:0/1720205390 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8df00561d0 con 0x7f8e000b20b0 2024-04-15T15:31:50.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 -- 172.21.15.73:0/1720205390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8e000cd380 con 0x7f8e000b20b0 2024-04-15T15:31:50.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8dfd600640 1 -- 172.21.15.73:0/1720205390 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f8df0055ad0 con 0x7f8e000b20b0 2024-04-15T15:31:50.583 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-15T15:31:50.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 -- 172.21.15.73:0/1720205390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ddc0683b0 msgr2=0x7f8ddc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ddc0683b0 0x7f8ddc06a870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8de80ad000 tx=0x7f8de8008040 comp rx=0 tx=0).stop 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 -- 172.21.15.73:0/1720205390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 msgr2=0x7f8e00158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 0x7f8e00158880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8df00011f0 tx=0x7f8df000c9b0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 -- 172.21.15.73:0/1720205390 shutdown_connections 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ddc0683b0 0x7f8ddc06a870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e0015cbd0 0x7f8e00139950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e00146110 0x7f8e000cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 --2- 172.21.15.73:0/1720205390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e000b20b0 0x7f8e00158880 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 -- 172.21.15.73:0/1720205390 >> 172.21.15.73:0/1720205390 conn(0x7f8e00067dd0 msgr2=0x7f8e00156760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 -- 172.21.15.73:0/1720205390 shutdown_connections 2024-04-15T15:31:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.581+0000 7f8e07a00640 1 -- 172.21.15.73:0/1720205390 wait complete. 2024-04-15T15:31:50.603 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-04-15T15:31:50.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:50.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-15T15:31:50.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:ceph-fuse[34038]: fuse finished with error 0 and tester_r 0 2024-04-15T15:31:50.646 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:31:50.660 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:31:50.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:31:50.660 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-15T15:31:50.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:50.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.905+0000 7f917b600640 1 Processor -- start 2024-04-15T15:31:50.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.905+0000 7f917b600640 1 -- start start 2024-04-15T15:31:50.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.905+0000 7f917b600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f917406fc90 0x7f917415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f917b600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f917406f5a0 con 0x7f917415e910 2024-04-15T15:31:50.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f917b600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f917415f480 con 0x7f9174072520 2024-04-15T15:31:50.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f917b600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f917415b9e0 con 0x7f917406fc90 2024-04-15T15:31:50.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f916be00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f917415e910 0x7f9174071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37478/0 (socket says 172.21.15.73:37478) 2024-04-15T15:31:50.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f916be00640 1 -- 172.21.15.73:0/4046264264 learned_addr learned my addr 172.21.15.73:0/4046264264 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:50.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f9178c00640 1 --2- 172.21.15.73:0/4046264264 >> v2:172.21.15.118:3300/0 conn(0x7f917406fc90 0x7f917415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f9173e00640 1 -- 172.21.15.73:0/4046264264 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115000362 0 0) 0x7f915c001120 con 0x7f917415e910 2024-04-15T15:31:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f9173e00640 1 -- 172.21.15.73:0/4046264264 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9158003450 con 0x7f917415e910 2024-04-15T15:31:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f9178c00640 1 -- 172.21.15.73:0/4046264264 >> v1:172.21.15.118:6789/0 conn(0x7f9174072520 legacy=0x7f91740b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f9178c00640 1 -- 172.21.15.73:0/4046264264 >> v1:172.21.15.73:6789/0 conn(0x7f917415e910 legacy=0x7f9174071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f9178c00640 1 -- 172.21.15.73:0/4046264264 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917415f760 con 0x7f917406fc90 2024-04-15T15:31:50.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.909+0000 7f9178c00640 1 --2- 172.21.15.73:0/4046264264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917406fc90 0x7f917415be70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f917415bb60 tx=0x7f916401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cc35c14489987c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:50.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f9173e00640 1 -- 172.21.15.73:0/4046264264 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91640ab610 con 0x7f917406fc90 2024-04-15T15:31:50.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f9173e00640 1 -- 172.21.15.73:0/4046264264 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91640b0070 con 0x7f917406fc90 2024-04-15T15:31:50.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f9173e00640 1 -- 172.21.15.73:0/4046264264 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91640ab9d0 con 0x7f917406fc90 2024-04-15T15:31:50.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 -- 172.21.15.73:0/4046264264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917406fc90 msgr2=0x7f917415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 --2- 172.21.15.73:0/4046264264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917406fc90 0x7f917415be70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f917415bb60 tx=0x7f916401c470 comp rx=0 tx=0).stop 2024-04-15T15:31:50.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 -- 172.21.15.73:0/4046264264 shutdown_connections 2024-04-15T15:31:50.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 --2- 172.21.15.73:0/4046264264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917406fc90 0x7f917415be70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 -- 172.21.15.73:0/4046264264 >> 172.21.15.73:0/4046264264 conn(0x7f9174067dd0 msgr2=0x7f91740d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:50.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 -- 172.21.15.73:0/4046264264 shutdown_connections 2024-04-15T15:31:50.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 -- 172.21.15.73:0/4046264264 wait complete. 2024-04-15T15:31:50.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 Processor -- start 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 -- start start 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f917406fc90 0x7f9174148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9174072520 0x7f91740c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917415e910 0x7f91741f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f91740b4930 con 0x7f917406fc90 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9174070070 con 0x7f917415e910 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f917b600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f91740b4ab0 con 0x7f9174072520 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f9178c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f917406fc90 0x7f9174148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f9178c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f917406fc90 0x7f9174148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45204/0 (socket says 172.21.15.73:45204) 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f9178c00640 1 -- 172.21.15.73:0/3332656591 learned_addr learned my addr 172.21.15.73:0/3332656591 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f9179600640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917415e910 0x7f91741f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f916be00640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9174072520 0x7f91740c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.913+0000 7f9178c00640 1 -- 172.21.15.73:0/3332656591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9174072520 msgr2=0x7f91740c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9178c00640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9174072520 0x7f91740c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9178c00640 1 -- 172.21.15.73:0/3332656591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917415e910 msgr2=0x7f91741f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9178c00640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917415e910 0x7f91741f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9178c00640 1 -- 172.21.15.73:0/3332656591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91740c6860 con 0x7f917406fc90 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9179600640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917415e910 0x7f91741f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f916be00640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9174072520 0x7f91740c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9178c00640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f917406fc90 0x7f9174148d60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f91640ad040 tx=0x7f916401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9171600640 1 -- 172.21.15.73:0/3332656591 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91640abe60 con 0x7f917406fc90 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9171600640 1 -- 172.21.15.73:0/3332656591 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91640bf630 con 0x7f917406fc90 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9171600640 1 -- 172.21.15.73:0/3332656591 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91640bfa20 con 0x7f917406fc90 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f917b600640 1 -- 172.21.15.73:0/3332656591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91740c6b40 con 0x7f917406fc90 2024-04-15T15:31:50.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f917b600640 1 -- 172.21.15.73:0/3332656591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91740c7100 con 0x7f917406fc90 2024-04-15T15:31:50.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f917b600640 1 -- 172.21.15.73:0/3332656591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9174068ab0 con 0x7f917406fc90 2024-04-15T15:31:50.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9171600640 1 -- 172.21.15.73:0/3332656591 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91640bd020 con 0x7f917406fc90 2024-04-15T15:31:50.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9171600640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9150068380 0x7f915006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:50.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f9171600640 1 -- 172.21.15.73:0/3332656591 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f91641213c0 con 0x7f917406fc90 2024-04-15T15:31:50.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.917+0000 7f916be00640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9150068380 0x7f915006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:50.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.921+0000 7f916be00640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9150068380 0x7f915006a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f915c007fd0 tx=0x7f915c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:50.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:50.921+0000 7f9171600640 1 -- 172.21.15.73:0/3332656591 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f91640a8050 con 0x7f917406fc90 2024-04-15T15:31:51.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 -- 172.21.15.73:0/3332656591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9174072a00 con 0x7f917406fc90 2024-04-15T15:31:51.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f9171600640 1 -- 172.21.15.73:0/3332656591 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f9164016090 con 0x7f917406fc90 2024-04-15T15:31:51.082 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:51.083 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:51.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 -- 172.21.15.73:0/3332656591 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9150068380 msgr2=0x7f915006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9150068380 0x7f915006a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f915c007fd0 tx=0x7f915c009040 comp rx=0 tx=0).stop 2024-04-15T15:31:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 -- 172.21.15.73:0/3332656591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f917406fc90 msgr2=0x7f9174148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f917406fc90 0x7f9174148d60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f91640ad040 tx=0x7f916401acb0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 -- 172.21.15.73:0/3332656591 shutdown_connections 2024-04-15T15:31:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917415e910 0x7f91741f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9150068380 0x7f915006a840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9174072520 0x7f91740c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 --2- 172.21.15.73:0/3332656591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f917406fc90 0x7f9174148d60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 -- 172.21.15.73:0/3332656591 >> 172.21.15.73:0/3332656591 conn(0x7f9174067dd0 msgr2=0x7f91740d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 -- 172.21.15.73:0/3332656591 shutdown_connections 2024-04-15T15:31:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.081+0000 7f917b600640 1 -- 172.21.15.73:0/3332656591 wait complete. 2024-04-15T15:31:51.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:51.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.237+0000 7fe78d200640 1 Processor -- start 2024-04-15T15:31:51.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.237+0000 7fe78d200640 1 -- start start 2024-04-15T15:31:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.237+0000 7fe78d200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe78806fc90 0x7fe78815e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.237+0000 7fe78d200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78815ee50 0x7fe788071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.237+0000 7fe78d200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe78806f5a0 con 0x7fe78815be70 2024-04-15T15:31:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.237+0000 7fe78d200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe7880b2830 con 0x7fe78806fc90 2024-04-15T15:31:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.237+0000 7fe78d200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe78815b9e0 con 0x7fe78815ee50 2024-04-15T15:31:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.237+0000 7fe785e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe78815be70 0x7fe7880b2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37490/0 (socket says 172.21.15.73:37490) 2024-04-15T15:31:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.237+0000 7fe785e00640 1 -- 172.21.15.73:0/934558383 learned_addr learned my addr 172.21.15.73:0/934558383 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.237+0000 7fe785400640 1 --2- 172.21.15.73:0/934558383 >> v2:172.21.15.73:3300/0 conn(0x7fe78806fc90 0x7fe78815e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe786800640 1 --2- 172.21.15.73:0/934558383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78815ee50 0x7fe788071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe784a00640 1 -- 172.21.15.73:0/934558383 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200540928 0 0) 0x7fe7780014a0 con 0x7fe78815be70 2024-04-15T15:31:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe784a00640 1 -- 172.21.15.73:0/934558383 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe76c005740 con 0x7fe78815be70 2024-04-15T15:31:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe785400640 1 -- 172.21.15.73:0/934558383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78815ee50 msgr2=0x7fe788071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe785400640 1 --2- 172.21.15.73:0/934558383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78815ee50 0x7fe788071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe785400640 1 -- 172.21.15.73:0/934558383 >> v1:172.21.15.73:6789/0 conn(0x7fe78815be70 legacy=0x7fe7880b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe785400640 1 -- 172.21.15.73:0/934558383 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe788070140 con 0x7fe78806fc90 2024-04-15T15:31:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe786800640 1 --2- 172.21.15.73:0/934558383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78815ee50 0x7fe788071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:51.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe785400640 1 --2- 172.21.15.73:0/934558383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78806fc90 0x7fe78815e910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe7740097c0 tx=0x7fe77401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5767bcd7d9a07eb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe784a00640 1 -- 172.21.15.73:0/934558383 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7740b0070 con 0x7fe78806fc90 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe784a00640 1 -- 172.21.15.73:0/934558383 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7740ab600 con 0x7fe78806fc90 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe784a00640 1 -- 172.21.15.73:0/934558383 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7740ab9d0 con 0x7fe78806fc90 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe78d200640 1 -- 172.21.15.73:0/934558383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78806fc90 msgr2=0x7fe78815e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe78d200640 1 --2- 172.21.15.73:0/934558383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78806fc90 0x7fe78815e910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe7740097c0 tx=0x7fe77401c4a0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe78d200640 1 -- 172.21.15.73:0/934558383 shutdown_connections 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe78d200640 1 --2- 172.21.15.73:0/934558383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78815ee50 0x7fe788071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe78d200640 1 --2- 172.21.15.73:0/934558383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78806fc90 0x7fe78815e910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.241+0000 7fe78d200640 1 -- 172.21.15.73:0/934558383 >> 172.21.15.73:0/934558383 conn(0x7fe788067dd0 msgr2=0x7fe7880d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 -- 172.21.15.73:0/934558383 shutdown_connections 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 -- 172.21.15.73:0/934558383 wait complete. 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 Processor -- start 2024-04-15T15:31:51.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 -- start start 2024-04-15T15:31:51.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78806fc90 0x7fe788150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe78815be70 0x7fe7881500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78815ee50 0x7fe78815d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe78815b320 con 0x7fe78815ee50 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe78815c250 con 0x7fe78815be70 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe7880b4620 con 0x7fe78806fc90 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe786800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78815ee50 0x7fe78815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe786800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78815ee50 0x7fe78815d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45218/0 (socket says 172.21.15.73:45218) 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe786800640 1 -- 172.21.15.73:0/1209360425 learned_addr learned my addr 172.21.15.73:0/1209360425 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe785e00640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78806fc90 0x7fe788150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe785400640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe78815be70 0x7fe7881500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe786800640 1 -- 172.21.15.73:0/1209360425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78806fc90 msgr2=0x7fe788150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe786800640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78806fc90 0x7fe788150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe786800640 1 -- 172.21.15.73:0/1209360425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe78815be70 msgr2=0x7fe7881500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe786800640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe78815be70 0x7fe7881500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe786800640 1 -- 172.21.15.73:0/1209360425 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7881586a0 con 0x7fe78815ee50 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe785400640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe78815be70 0x7fe7881500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:51.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe786800640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78815ee50 0x7fe78815d510 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe78000d800 tx=0x7fe78000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:51.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe77e000640 1 -- 172.21.15.73:0/1209360425 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7800096a0 con 0x7fe78815ee50 2024-04-15T15:31:51.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe77e000640 1 -- 172.21.15.73:0/1209360425 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe780019070 con 0x7fe78815ee50 2024-04-15T15:31:51.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe77e000640 1 -- 172.21.15.73:0/1209360425 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780009a80 con 0x7fe78815ee50 2024-04-15T15:31:51.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 -- 172.21.15.73:0/1209360425 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe788151890 con 0x7fe78815ee50 2024-04-15T15:31:51.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.245+0000 7fe78d200640 1 -- 172.21.15.73:0/1209360425 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe788151e50 con 0x7fe78815ee50 2024-04-15T15:31:51.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.249+0000 7fe78d200640 1 -- 172.21.15.73:0/1209360425 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe788068ab0 con 0x7fe78815ee50 2024-04-15T15:31:51.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.249+0000 7fe77e000640 1 -- 172.21.15.73:0/1209360425 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe780009c20 con 0x7fe78815ee50 2024-04-15T15:31:51.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.249+0000 7fe77e000640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe768068380 0x7fe76806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.249+0000 7fe77e000640 1 -- 172.21.15.73:0/1209360425 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe780087140 con 0x7fe78815ee50 2024-04-15T15:31:51.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.249+0000 7fe785e00640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe768068380 0x7fe76806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.249+0000 7fe785e00640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe768068380 0x7fe76806a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe778005c10 tx=0x7fe778009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:51.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.253+0000 7fe77e000640 1 -- 172.21.15.73:0/1209360425 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe7800573b0 con 0x7fe78815ee50 2024-04-15T15:31:51.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 -- 172.21.15.73:0/1209360425 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7880cefa0 con 0x7fe78815ee50 2024-04-15T15:31:51.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe77e000640 1 -- 172.21.15.73:0/1209360425 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fe780056cb0 con 0x7fe78815ee50 2024-04-15T15:31:51.418 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:51.419 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:51.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 -- 172.21.15.73:0/1209360425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe768068380 msgr2=0x7fe76806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe768068380 0x7fe76806a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe778005c10 tx=0x7fe778009040 comp rx=0 tx=0).stop 2024-04-15T15:31:51.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 -- 172.21.15.73:0/1209360425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78815ee50 msgr2=0x7fe78815d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78815ee50 0x7fe78815d510 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe78000d800 tx=0x7fe78000dcc0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 -- 172.21.15.73:0/1209360425 shutdown_connections 2024-04-15T15:31:51.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe78815ee50 0x7fe78815d510 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe78815be70 0x7fe7881500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe768068380 0x7fe76806a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 --2- 172.21.15.73:0/1209360425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe78806fc90 0x7fe788150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 -- 172.21.15.73:0/1209360425 >> 172.21.15.73:0/1209360425 conn(0x7fe788067dd0 msgr2=0x7fe7880d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 -- 172.21.15.73:0/1209360425 shutdown_connections 2024-04-15T15:31:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.417+0000 7fe78d200640 1 -- 172.21.15.73:0/1209360425 wait complete. 2024-04-15T15:31:51.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-15T15:31:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.577+0000 7f3f75c00640 1 Processor -- start 2024-04-15T15:31:51.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.577+0000 7f3f75c00640 1 -- start start 2024-04-15T15:31:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f75c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 0x7f3f700b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f75c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f7015cbd0 0x7f3f7015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f75c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f700cd3a0 con 0x7f3f70146110 2024-04-15T15:31:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f75c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3f700b5160 con 0x7f3f7015cbd0 2024-04-15T15:31:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f75c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3f700b40c0 con 0x7f3f700b20b0 2024-04-15T15:31:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f6f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f7015cbd0 0x7f3f7015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f6ea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3f70146110 0x7f3f700cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37498/0 (socket says 172.21.15.73:37498) 2024-04-15T15:31:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f6ea00640 1 -- 172.21.15.73:0/4283623870 learned_addr learned my addr 172.21.15.73:0/4283623870 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f6e000640 1 --2- 172.21.15.73:0/4283623870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 0x7f3f700b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f6f400640 1 -- 172.21.15.73:0/4283623870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 msgr2=0x7f3f700b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f6f400640 1 --2- 172.21.15.73:0/4283623870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 0x7f3f700b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f6f400640 1 -- 172.21.15.73:0/4283623870 >> v1:172.21.15.73:6789/0 conn(0x7f3f70146110 legacy=0x7f3f700cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f6f400640 1 -- 172.21.15.73:0/4283623870 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f700b43a0 con 0x7f3f7015cbd0 2024-04-15T15:31:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.581+0000 7f3f6e000640 1 --2- 172.21.15.73:0/4283623870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 0x7f3f700b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f6f400640 1 --2- 172.21.15.73:0/4283623870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 0x7f3f7015d060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009d90 tx=0x7f3f6801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03d565254eaf3e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f6d600640 1 -- 172.21.15.73:0/4283623870 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f680b2070 con 0x7f3f7015cbd0 2024-04-15T15:31:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f6d600640 1 -- 172.21.15.73:0/4283623870 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f680a5920 con 0x7f3f7015cbd0 2024-04-15T15:31:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f6d600640 1 -- 172.21.15.73:0/4283623870 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f680a5cf0 con 0x7f3f7015cbd0 2024-04-15T15:31:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f75c00640 1 -- 172.21.15.73:0/4283623870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 msgr2=0x7f3f7015d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f75c00640 1 --2- 172.21.15.73:0/4283623870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 0x7f3f7015d060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009d90 tx=0x7f3f6801c970 comp rx=0 tx=0).stop 2024-04-15T15:31:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f75c00640 1 -- 172.21.15.73:0/4283623870 shutdown_connections 2024-04-15T15:31:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f75c00640 1 --2- 172.21.15.73:0/4283623870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 0x7f3f700b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f75c00640 1 --2- 172.21.15.73:0/4283623870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 0x7f3f7015d060 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f75c00640 1 -- 172.21.15.73:0/4283623870 >> 172.21.15.73:0/4283623870 conn(0x7f3f70067dd0 msgr2=0x7f3f700d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f75c00640 1 -- 172.21.15.73:0/4283623870 shutdown_connections 2024-04-15T15:31:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f75c00640 1 -- 172.21.15.73:0/4283623870 wait complete. 2024-04-15T15:31:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f75c00640 1 Processor -- start 2024-04-15T15:31:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.585+0000 7f3f75c00640 1 -- start start 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f75c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 0x7f3f7015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f75c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f70146110 0x7f3f7013bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f75c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 0x7f3f70153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f75c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3f70169210 con 0x7f3f7015cbd0 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f75c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3f700b3d70 con 0x7f3f70146110 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f75c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3f70169390 con 0x7f3f700b20b0 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 0x7f3f70153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 0x7f3f70153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45226/0 (socket says 172.21.15.73:45226) 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6f400640 1 -- 172.21.15.73:0/2977316992 learned_addr learned my addr 172.21.15.73:0/2977316992 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6ea00640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 0x7f3f7015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6e000640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f70146110 0x7f3f7013bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6f400640 1 -- 172.21.15.73:0/2977316992 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 msgr2=0x7f3f7015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6f400640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 0x7f3f7015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6f400640 1 -- 172.21.15.73:0/2977316992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f70146110 msgr2=0x7f3f7013bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6f400640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f70146110 0x7f3f7013bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6f400640 1 -- 172.21.15.73:0/2977316992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7013c800 con 0x7f3f7015cbd0 2024-04-15T15:31:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6e000640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f70146110 0x7f3f7013bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f6f400640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 0x7f3f70153aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009d90 tx=0x7f3f68019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f66a00640 1 -- 172.21.15.73:0/2977316992 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f680b2040 con 0x7f3f7015cbd0 2024-04-15T15:31:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f66a00640 1 -- 172.21.15.73:0/2977316992 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f680bf070 con 0x7f3f7015cbd0 2024-04-15T15:31:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f66a00640 1 -- 172.21.15.73:0/2977316992 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f680ad8e0 con 0x7f3f7015cbd0 2024-04-15T15:31:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f75c00640 1 -- 172.21.15.73:0/2977316992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7013cae0 con 0x7f3f7015cbd0 2024-04-15T15:31:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f75c00640 1 -- 172.21.15.73:0/2977316992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7013d0a0 con 0x7f3f7015cbd0 2024-04-15T15:31:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f75c00640 1 -- 172.21.15.73:0/2977316992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7013d2e0 con 0x7f3f7015cbd0 2024-04-15T15:31:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.589+0000 7f3f66a00640 1 -- 172.21.15.73:0/2977316992 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f680ada80 con 0x7f3f7015cbd0 2024-04-15T15:31:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.593+0000 7f3f66a00640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f50068380 0x7f3f5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.593+0000 7f3f66a00640 1 -- 172.21.15.73:0/2977316992 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3f68121ff0 con 0x7f3f7015cbd0 2024-04-15T15:31:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.593+0000 7f3f6ea00640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f50068380 0x7f3f5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:51.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.593+0000 7f3f6ea00640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f50068380 0x7f3f5006a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3f60000f70 tx=0x7f3f60007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:51.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.597+0000 7f3f66a00640 1 -- 172.21.15.73:0/2977316992 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f7013d2e0 con 0x7f3f7015cbd0 2024-04-15T15:31:51.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.785+0000 7f3f75c00640 1 -- 172.21.15.73:0/2977316992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3f70068ab0 con 0x7f3f7015cbd0 2024-04-15T15:31:51.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.897+0000 7f3f66a00640 1 -- 172.21.15.73:0/2977316992 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f3f68016560 con 0x7f3f7015cbd0 2024-04-15T15:31:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 -- 172.21.15.73:0/2977316992 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f50068380 msgr2=0x7f3f5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f50068380 0x7f3f5006a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3f60000f70 tx=0x7f3f60007e90 comp rx=0 tx=0).stop 2024-04-15T15:31:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 -- 172.21.15.73:0/2977316992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 msgr2=0x7f3f70153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 0x7f3f70153aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009d90 tx=0x7f3f68019710 comp rx=0 tx=0).stop 2024-04-15T15:31:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 -- 172.21.15.73:0/2977316992 shutdown_connections 2024-04-15T15:31:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7015cbd0 0x7f3f70153aa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f70146110 0x7f3f7013bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f50068380 0x7f3f5006a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 --2- 172.21.15.73:0/2977316992 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f700b20b0 0x7f3f7015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:51.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 -- 172.21.15.73:0/2977316992 >> 172.21.15.73:0/2977316992 conn(0x7f3f70067dd0 msgr2=0x7f3f700b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:51.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 -- 172.21.15.73:0/2977316992 shutdown_connections 2024-04-15T15:31:51.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:51.901+0000 7f3f75c00640 1 -- 172.21.15.73:0/2977316992 wait complete. 2024-04-15T15:31:51.921 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-15T15:31:51.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-15T15:31:52.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.057+0000 7ff892200640 1 Processor -- start 2024-04-15T15:31:52.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.057+0000 7ff892200640 1 -- start start 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.057+0000 7ff892200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff88c15b5d0 0x7ff88c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.057+0000 7ff892200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff88c0b27c0 0x7ff88c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.057+0000 7ff892200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff88c070160 con 0x7ff88c0b3e30 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.057+0000 7ff892200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff88c15b9b0 con 0x7ff88c15b5d0 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.057+0000 7ff892200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ff88c15f1f0 con 0x7ff88c0b27c0 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.057+0000 7ff88b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff88c15b5d0 0x7ff88c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.057+0000 7ff88b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff88c15b5d0 0x7ff88c15fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45238/0 (socket says 172.21.15.73:45238) 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.057+0000 7ff88b400640 1 -- 172.21.15.73:0/2112344230 learned_addr learned my addr 172.21.15.73:0/2112344230 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff88b400640 1 -- 172.21.15.73:0/2112344230 >> v2:172.21.15.118:3300/0 conn(0x7ff88c0b27c0 msgr2=0x7ff88c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff88be00640 1 --2- 172.21.15.73:0/2112344230 >> v2:172.21.15.118:3300/0 conn(0x7ff88c0b27c0 0x7ff88c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff88b400640 1 --2- 172.21.15.73:0/2112344230 >> v2:172.21.15.118:3300/0 conn(0x7ff88c0b27c0 0x7ff88c0b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:52.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff88b400640 1 -- 172.21.15.73:0/2112344230 >> v1:172.21.15.118:6789/0 conn(0x7ff88c0b3e30 legacy=0x7ff88c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:52.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff88b400640 1 -- 172.21.15.73:0/2112344230 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c06fe80 con 0x7ff88c15b5d0 2024-04-15T15:31:52.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff88be00640 1 --2- 172.21.15.73:0/2112344230 >> v2:172.21.15.118:3300/0 conn(0x7ff88c0b27c0 0x7ff88c0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:52.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff88b400640 1 --2- 172.21.15.73:0/2112344230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c15b5d0 0x7ff88c15fc90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009870 tx=0x7ff87c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f7f91566256399 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:52.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff88aa00640 1 -- 172.21.15.73:0/2112344230 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0b2070 con 0x7ff88c15b5d0 2024-04-15T15:31:52.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff88aa00640 1 -- 172.21.15.73:0/2112344230 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff87c0ad440 con 0x7ff88c15b5d0 2024-04-15T15:31:52.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff88aa00640 1 -- 172.21.15.73:0/2112344230 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0ad810 con 0x7ff88c15b5d0 2024-04-15T15:31:52.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff892200640 1 -- 172.21.15.73:0/2112344230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c15b5d0 msgr2=0x7ff88c15fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:52.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff892200640 1 --2- 172.21.15.73:0/2112344230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c15b5d0 0x7ff88c15fc90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009870 tx=0x7ff87c01c390 comp rx=0 tx=0).stop 2024-04-15T15:31:52.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff892200640 1 -- 172.21.15.73:0/2112344230 shutdown_connections 2024-04-15T15:31:52.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff892200640 1 --2- 172.21.15.73:0/2112344230 >> v2:172.21.15.118:3300/0 conn(0x7ff88c0b27c0 0x7ff88c0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:52.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff892200640 1 --2- 172.21.15.73:0/2112344230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c15b5d0 0x7ff88c15fc90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:52.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff892200640 1 -- 172.21.15.73:0/2112344230 >> 172.21.15.73:0/2112344230 conn(0x7ff88c067dd0 msgr2=0x7ff88c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:52.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.061+0000 7ff892200640 1 -- 172.21.15.73:0/2112344230 shutdown_connections 2024-04-15T15:31:52.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff892200640 1 -- 172.21.15.73:0/2112344230 wait complete. 2024-04-15T15:31:52.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff892200640 1 Processor -- start 2024-04-15T15:31:52.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff892200640 1 -- start start 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff892200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c0b27c0 0x7ff88c15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff892200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff88c0b3e30 0x7ff88c153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff892200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff88c15b5d0 0x7ff88c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff892200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c06faa0 con 0x7ff88c0b27c0 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff892200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c0cfd00 con 0x7ff88c0b3e30 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff892200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff88c06fc20 con 0x7ff88c15b5d0 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c0b27c0 0x7ff88c15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c0b27c0 0x7ff88c15c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45242/0 (socket says 172.21.15.73:45242) 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88b400640 1 -- 172.21.15.73:0/4117788860 learned_addr learned my addr 172.21.15.73:0/4117788860 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff882a00640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff88c0b3e30 0x7ff88c153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88be00640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff88c15b5d0 0x7ff88c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:52.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88b400640 1 -- 172.21.15.73:0/4117788860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff88c15b5d0 msgr2=0x7ff88c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:52.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88b400640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff88c15b5d0 0x7ff88c153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:52.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88b400640 1 -- 172.21.15.73:0/4117788860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff88c0b3e30 msgr2=0x7ff88c153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:52.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88b400640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff88c0b3e30 0x7ff88c153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:52.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88b400640 1 -- 172.21.15.73:0/4117788860 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c15c800 con 0x7ff88c0b27c0 2024-04-15T15:31:52.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff882a00640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff88c0b3e30 0x7ff88c153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:52.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88be00640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff88c15b5d0 0x7ff88c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:52.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff88b400640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c0b27c0 0x7ff88c15c2c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0b0040 tx=0x7ff87c019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:52.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.065+0000 7ff883e00640 1 -- 172.21.15.73:0/4117788860 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0bd070 con 0x7ff88c0b27c0 2024-04-15T15:31:52.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.069+0000 7ff883e00640 1 -- 172.21.15.73:0/4117788860 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff87c0b6790 con 0x7ff88c0b27c0 2024-04-15T15:31:52.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.069+0000 7ff892200640 1 -- 172.21.15.73:0/4117788860 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c15db60 con 0x7ff88c0b27c0 2024-04-15T15:31:52.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.069+0000 7ff883e00640 1 -- 172.21.15.73:0/4117788860 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0b2070 con 0x7ff88c0b27c0 2024-04-15T15:31:52.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.069+0000 7ff892200640 1 -- 172.21.15.73:0/4117788860 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c0b02b0 con 0x7ff88c0b27c0 2024-04-15T15:31:52.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.069+0000 7ff892200640 1 -- 172.21.15.73:0/4117788860 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88c15e080 con 0x7ff88c0b27c0 2024-04-15T15:31:52.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.069+0000 7ff883e00640 1 -- 172.21.15.73:0/4117788860 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff87c0c0070 con 0x7ff88c0b27c0 2024-04-15T15:31:52.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.069+0000 7ff883e00640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff868068380 0x7ff86806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:52.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.069+0000 7ff883e00640 1 -- 172.21.15.73:0/4117788860 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff87c120c90 con 0x7ff88c0b27c0 2024-04-15T15:31:52.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.069+0000 7ff882a00640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff868068380 0x7ff86806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:52.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.069+0000 7ff882a00640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff868068380 0x7ff86806a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0b2790 tx=0x7ff874008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:52.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.073+0000 7ff883e00640 1 -- 172.21.15.73:0/4117788860 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff87c0160d0 con 0x7ff88c0b27c0 2024-04-15T15:31:52.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.265+0000 7ff892200640 1 -- 172.21.15.73:0/4117788860 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff88c068ab0 con 0x7ff88c0b27c0 2024-04-15T15:31:52.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff883e00640 1 -- 172.21.15.73:0/4117788860 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7ff87c0f0de0 con 0x7ff88c0b27c0 2024-04-15T15:31:52.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 -- 172.21.15.73:0/4117788860 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff868068380 msgr2=0x7ff86806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:52.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff868068380 0x7ff86806a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0b2790 tx=0x7ff874008040 comp rx=0 tx=0).stop 2024-04-15T15:31:52.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 -- 172.21.15.73:0/4117788860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c0b27c0 msgr2=0x7ff88c15c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:52.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c0b27c0 0x7ff88c15c2c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0b0040 tx=0x7ff87c019130 comp rx=0 tx=0).stop 2024-04-15T15:31:52.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 -- 172.21.15.73:0/4117788860 shutdown_connections 2024-04-15T15:31:52.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff868068380 0x7ff86806a840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:52.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff88c15b5d0 0x7ff88c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:52.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff88c0b3e30 0x7ff88c153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:52.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 --2- 172.21.15.73:0/4117788860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c0b27c0 0x7ff88c15c2c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:52.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 -- 172.21.15.73:0/4117788860 >> 172.21.15.73:0/4117788860 conn(0x7ff88c067dd0 msgr2=0x7ff88c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:52.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 -- 172.21.15.73:0/4117788860 shutdown_connections 2024-04-15T15:31:52.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:52.905+0000 7ff892200640 1 -- 172.21.15.73:0/4117788860 wait complete. 2024-04-15T15:31:52.929 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-15T15:31:52.929 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:31:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f2100a00640 1 Processor -- start 2024-04-15T15:31:53.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f2100a00640 1 -- start start 2024-04-15T15:31:53.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f2100a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20fc15c6d0 0x7f20fc0d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f2100a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc09b170 0x7f20fc0d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f2100a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20fc0cd690 con 0x7f20fc0cd1b0 2024-04-15T15:31:53.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f2100a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f20fc0cd970 con 0x7f20fc15c6d0 2024-04-15T15:31:53.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f2100a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f20fc0cdc50 con 0x7f20fc09b170 2024-04-15T15:31:53.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f20f9e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20fc15c6d0 0x7f20fc0d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f20f9e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20fc15c6d0 0x7f20fc0d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45246/0 (socket says 172.21.15.73:45246) 2024-04-15T15:31:53.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f20f9e00640 1 -- 172.21.15.73:0/855690674 learned_addr learned my addr 172.21.15.73:0/855690674 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:53.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f20fa800640 1 --2- 172.21.15.73:0/855690674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc09b170 0x7f20fc0d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f20f9e00640 1 -- 172.21.15.73:0/855690674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc09b170 msgr2=0x7f20fc0d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:53.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f20f9e00640 1 --2- 172.21.15.73:0/855690674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc09b170 0x7f20fc0d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f20f9e00640 1 -- 172.21.15.73:0/855690674 >> v1:172.21.15.118:6789/0 conn(0x7f20fc0cd1b0 legacy=0x7f20fc09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f20f9e00640 1 -- 172.21.15.73:0/855690674 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20fc0cdf30 con 0x7f20fc15c6d0 2024-04-15T15:31:53.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.065+0000 7f20fa800640 1 --2- 172.21.15.73:0/855690674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc09b170 0x7f20fc0d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:53.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f20f9e00640 1 --2- 172.21.15.73:0/855690674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc15c6d0 0x7f20fc0d0d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f20ec006fd0 tx=0x7f20ec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9064e21160401 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:53.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f20f9400640 1 -- 172.21.15.73:0/855690674 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0a95f0 con 0x7f20fc15c6d0 2024-04-15T15:31:53.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f20f9400640 1 -- 172.21.15.73:0/855690674 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ec0a9790 con 0x7f20fc15c6d0 2024-04-15T15:31:53.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f20f9400640 1 -- 172.21.15.73:0/855690674 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0a9b60 con 0x7f20fc15c6d0 2024-04-15T15:31:53.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f2100a00640 1 -- 172.21.15.73:0/855690674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc15c6d0 msgr2=0x7f20fc0d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f2100a00640 1 --2- 172.21.15.73:0/855690674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc15c6d0 0x7f20fc0d0d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f20ec006fd0 tx=0x7f20ec01c510 comp rx=0 tx=0).stop 2024-04-15T15:31:53.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f2100a00640 1 -- 172.21.15.73:0/855690674 shutdown_connections 2024-04-15T15:31:53.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f2100a00640 1 --2- 172.21.15.73:0/855690674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc09b170 0x7f20fc0d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f2100a00640 1 --2- 172.21.15.73:0/855690674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc15c6d0 0x7f20fc0d0d70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f2100a00640 1 -- 172.21.15.73:0/855690674 >> 172.21.15.73:0/855690674 conn(0x7f20fc0b3fe0 msgr2=0x7f20fc0b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:53.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f2100a00640 1 -- 172.21.15.73:0/855690674 shutdown_connections 2024-04-15T15:31:53.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f2100a00640 1 -- 172.21.15.73:0/855690674 wait complete. 2024-04-15T15:31:53.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f2100a00640 1 Processor -- start 2024-04-15T15:31:53.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.069+0000 7f2100a00640 1 -- start start 2024-04-15T15:31:53.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f2100a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20fc09b170 0x7f20fc1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f2100a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc0cd1b0 0x7f20fc15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f2100a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc15c6d0 0x7f20fc0af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f2100a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc0b1c20 con 0x7f20fc15c6d0 2024-04-15T15:31:53.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f2100a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc0b1aa0 con 0x7f20fc09b170 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f2100a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f20fc0b1da0 con 0x7f20fc0cd1b0 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20fc09b170 0x7f20fc1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20fc09b170 0x7f20fc1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51014/0 (socket says 172.21.15.73:51014) 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f9e00640 1 -- 172.21.15.73:0/2347146605 learned_addr learned my addr 172.21.15.73:0/2347146605 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f3e00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc0cd1b0 0x7f20fc15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20fa800640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc15c6d0 0x7f20fc0af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f9e00640 1 -- 172.21.15.73:0/2347146605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc0cd1b0 msgr2=0x7f20fc15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f9e00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc0cd1b0 0x7f20fc15cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f9e00640 1 -- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc15c6d0 msgr2=0x7f20fc0af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f9e00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc15c6d0 0x7f20fc0af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f9e00640 1 -- 172.21.15.73:0/2347146605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20fc165980 con 0x7f20fc09b170 2024-04-15T15:31:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20fa800640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc15c6d0 0x7f20fc0af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:53.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f9e00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20fc09b170 0x7f20fc1555b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20ec01a140 tx=0x7f20ec0192b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:53.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f2000640 1 -- 172.21.15.73:0/2347146605 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0a9dd0 con 0x7f20fc09b170 2024-04-15T15:31:53.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f2000640 1 -- 172.21.15.73:0/2347146605 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ec0b5070 con 0x7f20fc09b170 2024-04-15T15:31:53.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f2100a00640 1 -- 172.21.15.73:0/2347146605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20fc165c20 con 0x7f20fc09b170 2024-04-15T15:31:53.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f20f2000640 1 -- 172.21.15.73:0/2347146605 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec006240 con 0x7f20fc09b170 2024-04-15T15:31:53.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f2100a00640 1 -- 172.21.15.73:0/2347146605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20fc1661e0 con 0x7f20fc09b170 2024-04-15T15:31:53.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.073+0000 7f2100a00640 1 -- 172.21.15.73:0/2347146605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20fc068ab0 con 0x7f20fc09b170 2024-04-15T15:31:53.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.077+0000 7f20f2000640 1 -- 172.21.15.73:0/2347146605 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f20ec0c0060 con 0x7f20fc09b170 2024-04-15T15:31:53.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.077+0000 7f20f2000640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20d8068380 0x7f20d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.077+0000 7f20f2000640 1 -- 172.21.15.73:0/2347146605 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f20ec120f50 con 0x7f20fc09b170 2024-04-15T15:31:53.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.077+0000 7f20f3e00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20d8068380 0x7f20d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.077+0000 7f20f3e00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20d8068380 0x7f20d806a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0c8940 tx=0x7f20e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:53.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.081+0000 7f20f2000640 1 -- 172.21.15.73:0/2347146605 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20ec0ad020 con 0x7f20fc09b170 2024-04-15T15:31:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 -- 172.21.15.73:0/2347146605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20fc0b4d80 con 0x7f20fc09b170 2024-04-15T15:31:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f20f2000640 1 -- 172.21.15.73:0/2347146605 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f20ec016130 con 0x7f20fc09b170 2024-04-15T15:31:53.274 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:53.275 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:31:33.826027+0000","modified":"2024-04-15T15:31:52.268632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-15T15:31:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-04-15T15:31:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 -- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20d8068380 msgr2=0x7f20d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20d8068380 0x7f20d806a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0c8940 tx=0x7f20e4009040 comp rx=0 tx=0).stop 2024-04-15T15:31:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 -- 172.21.15.73:0/2347146605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20fc09b170 msgr2=0x7f20fc1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20fc09b170 0x7f20fc1555b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20ec01a140 tx=0x7f20ec0192b0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 -- 172.21.15.73:0/2347146605 shutdown_connections 2024-04-15T15:31:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc15c6d0 0x7f20fc0af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20d8068380 0x7f20d806a840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20fc0cd1b0 0x7f20fc15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 --2- 172.21.15.73:0/2347146605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20fc09b170 0x7f20fc1555b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 -- 172.21.15.73:0/2347146605 >> 172.21.15.73:0/2347146605 conn(0x7f20fc0b3fe0 msgr2=0x7f20fc1596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 -- 172.21.15.73:0/2347146605 shutdown_connections 2024-04-15T15:31:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.273+0000 7f2100a00640 1 -- 172.21.15.73:0/2347146605 wait complete. 2024-04-15T15:31:53.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.433+0000 7f89a6400640 1 Processor -- start 2024-04-15T15:31:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.433+0000 7f89a6400640 1 -- start start 2024-04-15T15:31:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.433+0000 7f89a6400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f89a00b27c0 0x7f89a015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.433+0000 7f89a6400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a0070160 con 0x7f89a015b5d0 2024-04-15T15:31:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.433+0000 7f89a6400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a015f1f0 con 0x7f89a00b3e30 2024-04-15T15:31:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.433+0000 7f89a6400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f89a015b9b0 con 0x7f89a00b27c0 2024-04-15T15:31:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.437+0000 7f899ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f89a00b27c0 0x7f89a015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.437+0000 7f899f400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f89a015b5d0 0x7f89a00b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37502/0 (socket says 172.21.15.73:37502) 2024-04-15T15:31:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.437+0000 7f899f400640 1 -- 172.21.15.73:0/2988436972 learned_addr learned my addr 172.21.15.73:0/2988436972 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.437+0000 7f899ea00640 1 -- 172.21.15.73:0/2988436972 >> v1:172.21.15.118:6789/0 conn(0x7f89a00b3e30 legacy=0x7f89a00b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.437+0000 7f899ea00640 1 -- 172.21.15.73:0/2988436972 >> v1:172.21.15.73:6789/0 conn(0x7f89a015b5d0 legacy=0x7f89a00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.437+0000 7f899ea00640 1 -- 172.21.15.73:0/2988436972 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a006fe80 con 0x7f89a00b27c0 2024-04-15T15:31:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.437+0000 7f899ea00640 1 --2- 172.21.15.73:0/2988436972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b27c0 0x7f89a015fc90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f898c0097c0 tx=0x7f898c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2772fba6be039d64 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.437+0000 7f899e000640 1 -- 172.21.15.73:0/2988436972 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0b0070 con 0x7f89a00b27c0 2024-04-15T15:31:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.437+0000 7f899e000640 1 -- 172.21.15.73:0/2988436972 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898c0ab600 con 0x7f89a00b27c0 2024-04-15T15:31:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.437+0000 7f899e000640 1 -- 172.21.15.73:0/2988436972 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0ab9d0 con 0x7f89a00b27c0 2024-04-15T15:31:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 -- 172.21.15.73:0/2988436972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b27c0 msgr2=0x7f89a015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 --2- 172.21.15.73:0/2988436972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b27c0 0x7f89a015fc90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f898c0097c0 tx=0x7f898c01c2e0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 -- 172.21.15.73:0/2988436972 shutdown_connections 2024-04-15T15:31:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 --2- 172.21.15.73:0/2988436972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b27c0 0x7f89a015fc90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 -- 172.21.15.73:0/2988436972 >> 172.21.15.73:0/2988436972 conn(0x7f89a0067dd0 msgr2=0x7f89a00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 -- 172.21.15.73:0/2988436972 shutdown_connections 2024-04-15T15:31:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 -- 172.21.15.73:0/2988436972 wait complete. 2024-04-15T15:31:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 Processor -- start 2024-04-15T15:31:53.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 -- start start 2024-04-15T15:31:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a00b27c0 0x7f89a014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b3e30 0x7f89a014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a015b5d0 0x7f89a0150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f89a006faa0 con 0x7f89a00b3e30 2024-04-15T15:31:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f89a00b4240 con 0x7f89a015b5d0 2024-04-15T15:31:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f89a6400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f89a006fc20 con 0x7f89a00b27c0 2024-04-15T15:31:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b3e30 0x7f89a014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b3e30 0x7f89a014ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45260/0 (socket says 172.21.15.73:45260) 2024-04-15T15:31:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899ea00640 1 -- 172.21.15.73:0/1618192633 learned_addr learned my addr 172.21.15.73:0/1618192633 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899f400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a00b27c0 0x7f89a014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899fe00640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a015b5d0 0x7f89a0150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899ea00640 1 -- 172.21.15.73:0/1618192633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a00b27c0 msgr2=0x7f89a014cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899ea00640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a00b27c0 0x7f89a014cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899ea00640 1 -- 172.21.15.73:0/1618192633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a015b5d0 msgr2=0x7f89a0150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899ea00640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a015b5d0 0x7f89a0150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899ea00640 1 -- 172.21.15.73:0/1618192633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a014f620 con 0x7f89a00b3e30 2024-04-15T15:31:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f899ea00640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b3e30 0x7f89a014ecd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f898c0097c0 tx=0x7f898c019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.441+0000 7f8997400640 1 -- 172.21.15.73:0/1618192633 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0b8030 con 0x7f89a00b3e30 2024-04-15T15:31:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.445+0000 7f8997400640 1 -- 172.21.15.73:0/1618192633 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898c0ab400 con 0x7f89a00b3e30 2024-04-15T15:31:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.445+0000 7f89a6400640 1 -- 172.21.15.73:0/1618192633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a014f900 con 0x7f89a00b3e30 2024-04-15T15:31:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.445+0000 7f8997400640 1 -- 172.21.15.73:0/1618192633 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0b0040 con 0x7f89a00b3e30 2024-04-15T15:31:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.445+0000 7f89a6400640 1 -- 172.21.15.73:0/1618192633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a00b0590 con 0x7f89a00b3e30 2024-04-15T15:31:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.445+0000 7f89a6400640 1 -- 172.21.15.73:0/1618192633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a0068ab0 con 0x7f89a00b3e30 2024-04-15T15:31:53.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.445+0000 7f8997400640 1 -- 172.21.15.73:0/1618192633 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f898c0bb070 con 0x7f89a00b3e30 2024-04-15T15:31:53.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.445+0000 7f8997400640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8980068380 0x7f898006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.445+0000 7f8997400640 1 -- 172.21.15.73:0/1618192633 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f898c1204a0 con 0x7f89a00b3e30 2024-04-15T15:31:53.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.445+0000 7f899f400640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8980068380 0x7f898006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.445+0000 7f899f400640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8980068380 0x7f898006a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f89900012f0 tx=0x7f8990001a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.449+0000 7f8997400640 1 -- 172.21.15.73:0/1618192633 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f898c0c2070 con 0x7f89a00b3e30 2024-04-15T15:31:53.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.609+0000 7f89a6400640 1 -- 172.21.15.73:0/1618192633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89a006f370 con 0x7f89a00b3e30 2024-04-15T15:31:53.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.609+0000 7f8997400640 1 -- 172.21.15.73:0/1618192633 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f898c016050 con 0x7f89a00b3e30 2024-04-15T15:31:53.611 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:53.612 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 -- 172.21.15.73:0/1618192633 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8980068380 msgr2=0x7f898006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8980068380 0x7f898006a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f89900012f0 tx=0x7f8990001a40 comp rx=0 tx=0).stop 2024-04-15T15:31:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 -- 172.21.15.73:0/1618192633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b3e30 msgr2=0x7f89a014ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b3e30 0x7f89a014ecd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f898c0097c0 tx=0x7f898c019080 comp rx=0 tx=0).stop 2024-04-15T15:31:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 -- 172.21.15.73:0/1618192633 shutdown_connections 2024-04-15T15:31:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a015b5d0 0x7f89a0150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00b3e30 0x7f89a014ecd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8980068380 0x7f898006a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 --2- 172.21.15.73:0/1618192633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a00b27c0 0x7f89a014cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 -- 172.21.15.73:0/1618192633 >> 172.21.15.73:0/1618192633 conn(0x7f89a0067dd0 msgr2=0x7f89a006c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 -- 172.21.15.73:0/1618192633 shutdown_connections 2024-04-15T15:31:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.613+0000 7f89a6400640 1 -- 172.21.15.73:0/1618192633 wait complete. 2024-04-15T15:31:53.633 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-15T15:31:53.633 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:31:53.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.765+0000 7f6145800640 1 Processor -- start 2024-04-15T15:31:53.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.765+0000 7f6145800640 1 -- start start 2024-04-15T15:31:53.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.765+0000 7f6145800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6140146110 0x7f61400cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f6145800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6140072c30 con 0x7f61400b20b0 2024-04-15T15:31:53.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f6145800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61400cd3a0 con 0x7f61400b2530 2024-04-15T15:31:53.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f6145800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f61400b5160 con 0x7f6140146110 2024-04-15T15:31:53.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f613ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6140146110 0x7f61400cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f6137e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f61400b20b0 0x7f6140071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37518/0 (socket says 172.21.15.73:37518) 2024-04-15T15:31:53.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f6137e00640 1 -- 172.21.15.73:0/1212045349 learned_addr learned my addr 172.21.15.73:0/1212045349 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:53.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f613e000640 1 -- 172.21.15.73:0/1212045349 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917435290 0 0) 0x7f6140072c30 con 0x7f61400b20b0 2024-04-15T15:31:53.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f613e000640 1 -- 172.21.15.73:0/1212045349 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6124003530 con 0x7f61400b20b0 2024-04-15T15:31:53.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f613ea00640 1 -- 172.21.15.73:0/1212045349 >> v1:172.21.15.118:6789/0 conn(0x7f61400b2530 legacy=0x7f6140072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f613ea00640 1 -- 172.21.15.73:0/1212045349 >> v1:172.21.15.73:6789/0 conn(0x7f61400b20b0 legacy=0x7f6140071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f613ea00640 1 -- 172.21.15.73:0/1212045349 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61400b40c0 con 0x7f6140146110 2024-04-15T15:31:53.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f613ea00640 1 --2- 172.21.15.73:0/1212045349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 0x7f61400cd7b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f61400cd570 tx=0x7f613001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a70d91d63ba3e65 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:53.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f613e000640 1 -- 172.21.15.73:0/1212045349 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61300a7070 con 0x7f6140146110 2024-04-15T15:31:53.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f613e000640 1 -- 172.21.15.73:0/1212045349 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61300b0070 con 0x7f6140146110 2024-04-15T15:31:53.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.769+0000 7f613e000640 1 -- 172.21.15.73:0/1212045349 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61300ab870 con 0x7f6140146110 2024-04-15T15:31:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 -- 172.21.15.73:0/1212045349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 msgr2=0x7f61400cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 --2- 172.21.15.73:0/1212045349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 0x7f61400cd7b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f61400cd570 tx=0x7f613001c470 comp rx=0 tx=0).stop 2024-04-15T15:31:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 -- 172.21.15.73:0/1212045349 shutdown_connections 2024-04-15T15:31:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 --2- 172.21.15.73:0/1212045349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 0x7f61400cd7b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 -- 172.21.15.73:0/1212045349 >> 172.21.15.73:0/1212045349 conn(0x7f6140067dd0 msgr2=0x7f61400d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 -- 172.21.15.73:0/1212045349 shutdown_connections 2024-04-15T15:31:53.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 -- 172.21.15.73:0/1212045349 wait complete. 2024-04-15T15:31:53.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 Processor -- start 2024-04-15T15:31:53.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 -- start start 2024-04-15T15:31:53.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61400b20b0 0x7f6140167160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61400b2530 0x7f6140151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 0x7f61400b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f61400b2940 con 0x7f6140146110 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f61400b4c40 con 0x7f61400b20b0 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6145800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f61400b3d70 con 0x7f61400b2530 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f613f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 0x7f61400b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f613ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61400b20b0 0x7f6140167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f613ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61400b20b0 0x7f6140167160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51042/0 (socket says 172.21.15.73:51042) 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f613f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 0x7f61400b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45290/0 (socket says 172.21.15.73:45290) 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f613ea00640 1 -- 172.21.15.73:0/2007737984 learned_addr learned my addr 172.21.15.73:0/2007737984 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f6137e00640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61400b2530 0x7f6140151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f613f400640 1 -- 172.21.15.73:0/2007737984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61400b2530 msgr2=0x7f6140151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f613f400640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61400b2530 0x7f6140151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f613f400640 1 -- 172.21.15.73:0/2007737984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61400b20b0 msgr2=0x7f6140167160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.773+0000 7f613f400640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61400b20b0 0x7f6140167160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f613f400640 1 -- 172.21.15.73:0/2007737984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614013cf30 con 0x7f6140146110 2024-04-15T15:31:53.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f613f400640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 0x7f61400b0aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f613800c700 tx=0x7f613800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:53.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f6136a00640 1 -- 172.21.15.73:0/2007737984 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138003b80 con 0x7f6140146110 2024-04-15T15:31:53.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f6136a00640 1 -- 172.21.15.73:0/2007737984 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6138003d20 con 0x7f6140146110 2024-04-15T15:31:53.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f6145800640 1 -- 172.21.15.73:0/2007737984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61400b1130 con 0x7f6140146110 2024-04-15T15:31:53.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f6136a00640 1 -- 172.21.15.73:0/2007737984 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613800aa30 con 0x7f6140146110 2024-04-15T15:31:53.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f6145800640 1 -- 172.21.15.73:0/2007737984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61400b16f0 con 0x7f6140146110 2024-04-15T15:31:53.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f6145800640 1 -- 172.21.15.73:0/2007737984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6140068ab0 con 0x7f6140146110 2024-04-15T15:31:53.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f6136a00640 1 -- 172.21.15.73:0/2007737984 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f613800abd0 con 0x7f6140146110 2024-04-15T15:31:53.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f6136a00640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f611c0683b0 0x7f611c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:53.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f6136a00640 1 -- 172.21.15.73:0/2007737984 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f61380869f0 con 0x7f6140146110 2024-04-15T15:31:53.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.777+0000 7f613ea00640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f611c0683b0 0x7f611c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:53.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.781+0000 7f613ea00640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f611c0683b0 0x7f611c06a870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6130000c10 tx=0x7f61300a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:53.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.781+0000 7f6136a00640 1 -- 172.21.15.73:0/2007737984 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f614013cf30 con 0x7f6140146110 2024-04-15T15:31:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.937+0000 7f6145800640 1 -- 172.21.15.73:0/2007737984 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61400008e0 con 0x7f611c0683b0 2024-04-15T15:31:53.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.949+0000 7f6136a00640 1 -- 172.21.15.73:0/2007737984 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7f61400008e0 con 0x7f611c0683b0 2024-04-15T15:31:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:53.957 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:31:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 -- 172.21.15.73:0/2007737984 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f611c0683b0 msgr2=0x7f611c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f611c0683b0 0x7f611c06a870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6130000c10 tx=0x7f61300a7000 comp rx=0 tx=0).stop 2024-04-15T15:31:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 -- 172.21.15.73:0/2007737984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 msgr2=0x7f61400b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 0x7f61400b0aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f613800c700 tx=0x7f613800cbc0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 -- 172.21.15.73:0/2007737984 shutdown_connections 2024-04-15T15:31:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6140146110 0x7f61400b0aa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f611c0683b0 0x7f611c06a870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61400b2530 0x7f6140151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 --2- 172.21.15.73:0/2007737984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61400b20b0 0x7f6140167160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 -- 172.21.15.73:0/2007737984 >> 172.21.15.73:0/2007737984 conn(0x7f6140067dd0 msgr2=0x7f6140157230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:53.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 -- 172.21.15.73:0/2007737984 shutdown_connections 2024-04-15T15:31:53.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:53.953+0000 7f6145800640 1 -- 172.21.15.73:0/2007737984 wait complete. 2024-04-15T15:31:53.974 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-15T15:31:53.360080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223632,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751088,"statfs":{"total":773094113280,"available":772865114112,"internally_reserved":0,"allocated":3383296,"data_stored":2029150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002675"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749471+0000","last_change":"2024-04-15T15:31:33.445529+0000","last_active":"2024-04-15T15:31:41.749471+0000","last_peered":"2024-04-15T15:31:41.749471+0000","last_clean":"2024-04-15T15:31:41.749471+0000","last_became_active":"2024-04-15T15:31:33.444843+0000","last_became_peered":"2024-04-15T15:31:33.444843+0000","last_unstale":"2024-04-15T15:31:41.749471+0000","last_undegraded":"2024-04-15T15:31:41.749471+0000","last_fullsized":"2024-04-15T15:31:41.749471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:55:28.751007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494876+0000","last_change":"2024-04-15T15:31:34.469462+0000","last_active":"2024-04-15T15:31:39.494876+0000","last_peered":"2024-04-15T15:31:39.494876+0000","last_clean":"2024-04-15T15:31:39.494876+0000","last_became_active":"2024-04-15T15:31:34.468636+0000","last_became_peered":"2024-04-15T15:31:34.468636+0000","last_unstale":"2024-04-15T15:31:39.494876+0000","last_undegraded":"2024-04-15T15:31:39.494876+0000","last_fullsized":"2024-04-15T15:31:39.494876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494365+0000","last_change":"2024-04-15T15:31:38.508287+0000","last_active":"2024-04-15T15:31:39.494365+0000","last_peered":"2024-04-15T15:31:39.494365+0000","last_clean":"2024-04-15T15:31:39.494365+0000","last_became_active":"2024-04-15T15:31:38.507377+0000","last_became_peered":"2024-04-15T15:31:38.507377+0000","last_unstale":"2024-04-15T15:31:39.494365+0000","last_undegraded":"2024-04-15T15:31:39.494365+0000","last_fullsized":"2024-04-15T15:31:39.494365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:19.820153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495019+0000","last_change":"2024-04-15T15:31:33.461774+0000","last_active":"2024-04-15T15:31:39.495019+0000","last_peered":"2024-04-15T15:31:39.495019+0000","last_clean":"2024-04-15T15:31:39.495019+0000","last_became_active":"2024-04-15T15:31:33.461439+0000","last_became_peered":"2024-04-15T15:31:33.461439+0000","last_unstale":"2024-04-15T15:31:39.495019+0000","last_undegraded":"2024-04-15T15:31:39.495019+0000","last_fullsized":"2024-04-15T15:31:39.495019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750446+0000","last_change":"2024-04-15T15:31:34.482829+0000","last_active":"2024-04-15T15:31:41.750446+0000","last_peered":"2024-04-15T15:31:41.750446+0000","last_clean":"2024-04-15T15:31:41.750446+0000","last_became_active":"2024-04-15T15:31:34.481691+0000","last_became_peered":"2024-04-15T15:31:34.481691+0000","last_unstale":"2024-04-15T15:31:41.750446+0000","last_undegraded":"2024-04-15T15:31:41.750446+0000","last_fullsized":"2024-04-15T15:31:41.750446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494732+0000","last_change":"2024-04-15T15:31:38.509783+0000","last_active":"2024-04-15T15:31:39.494732+0000","last_peered":"2024-04-15T15:31:39.494732+0000","last_clean":"2024-04-15T15:31:39.494732+0000","last_became_active":"2024-04-15T15:31:38.509318+0000","last_became_peered":"2024-04-15T15:31:38.509318+0000","last_unstale":"2024-04-15T15:31:39.494732+0000","last_undegraded":"2024-04-15T15:31:39.494732+0000","last_fullsized":"2024-04-15T15:31:39.494732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:41.291523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496578+0000","last_change":"2024-04-15T15:31:33.469801+0000","last_active":"2024-04-15T15:31:39.496578+0000","last_peered":"2024-04-15T15:31:39.496578+0000","last_clean":"2024-04-15T15:31:39.496578+0000","last_became_active":"2024-04-15T15:31:33.469406+0000","last_became_peered":"2024-04-15T15:31:33.469406+0000","last_unstale":"2024-04-15T15:31:39.496578+0000","last_undegraded":"2024-04-15T15:31:39.496578+0000","last_fullsized":"2024-04-15T15:31:39.496578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397887+0000","last_change":"2024-04-15T15:31:34.480152+0000","last_active":"2024-04-15T15:31:41.397887+0000","last_peered":"2024-04-15T15:31:41.397887+0000","last_clean":"2024-04-15T15:31:41.397887+0000","last_became_active":"2024-04-15T15:31:34.479857+0000","last_became_peered":"2024-04-15T15:31:34.479857+0000","last_unstale":"2024-04-15T15:31:41.397887+0000","last_undegraded":"2024-04-15T15:31:41.397887+0000","last_fullsized":"2024-04-15T15:31:41.397887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495216+0000","last_change":"2024-04-15T15:31:38.513301+0000","last_active":"2024-04-15T15:31:39.495216+0000","last_peered":"2024-04-15T15:31:39.495216+0000","last_clean":"2024-04-15T15:31:39.495216+0000","last_became_active":"2024-04-15T15:31:38.512294+0000","last_became_peered":"2024-04-15T15:31:38.512294+0000","last_unstale":"2024-04-15T15:31:39.495216+0000","last_undegraded":"2024-04-15T15:31:39.495216+0000","last_fullsized":"2024-04-15T15:31:39.495216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:58.375388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495343+0000","last_change":"2024-04-15T15:31:33.468436+0000","last_active":"2024-04-15T15:31:39.495343+0000","last_peered":"2024-04-15T15:31:39.495343+0000","last_clean":"2024-04-15T15:31:39.495343+0000","last_became_active":"2024-04-15T15:31:33.468066+0000","last_became_peered":"2024-04-15T15:31:33.468066+0000","last_unstale":"2024-04-15T15:31:39.495343+0000","last_undegraded":"2024-04-15T15:31:39.495343+0000","last_fullsized":"2024-04-15T15:31:39.495343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397924+0000","last_change":"2024-04-15T15:31:34.478455+0000","last_active":"2024-04-15T15:31:41.397924+0000","last_peered":"2024-04-15T15:31:41.397924+0000","last_clean":"2024-04-15T15:31:41.397924+0000","last_became_active":"2024-04-15T15:31:34.477083+0000","last_became_peered":"2024-04-15T15:31:34.477083+0000","last_unstale":"2024-04-15T15:31:41.397924+0000","last_undegraded":"2024-04-15T15:31:41.397924+0000","last_fullsized":"2024-04-15T15:31:41.397924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:28.573374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495022+0000","last_change":"2024-04-15T15:31:38.513693+0000","last_active":"2024-04-15T15:31:39.495022+0000","last_peered":"2024-04-15T15:31:39.495022+0000","last_clean":"2024-04-15T15:31:39.495022+0000","last_became_active":"2024-04-15T15:31:38.508340+0000","last_became_peered":"2024-04-15T15:31:38.508340+0000","last_unstale":"2024-04-15T15:31:39.495022+0000","last_undegraded":"2024-04-15T15:31:39.495022+0000","last_fullsized":"2024-04-15T15:31:39.495022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:40:02.295646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043775+0000","last_change":"2024-04-15T15:31:34.470639+0000","last_active":"2024-04-15T15:31:41.043775+0000","last_peered":"2024-04-15T15:31:41.043775+0000","last_clean":"2024-04-15T15:31:41.043775+0000","last_became_active":"2024-04-15T15:31:34.470352+0000","last_became_peered":"2024-04-15T15:31:34.470352+0000","last_unstale":"2024-04-15T15:31:41.043775+0000","last_undegraded":"2024-04-15T15:31:41.043775+0000","last_fullsized":"2024-04-15T15:31:41.043775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495785+0000","last_change":"2024-04-15T15:31:33.468093+0000","last_active":"2024-04-15T15:31:39.495785+0000","last_peered":"2024-04-15T15:31:39.495785+0000","last_clean":"2024-04-15T15:31:39.495785+0000","last_became_active":"2024-04-15T15:31:33.464597+0000","last_became_peered":"2024-04-15T15:31:33.464597+0000","last_unstale":"2024-04-15T15:31:39.495785+0000","last_undegraded":"2024-04-15T15:31:39.495785+0000","last_fullsized":"2024-04-15T15:31:39.495785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:31.218635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495353+0000","last_change":"2024-04-15T15:31:38.508916+0000","last_active":"2024-04-15T15:31:39.495353+0000","last_peered":"2024-04-15T15:31:39.495353+0000","last_clean":"2024-04-15T15:31:39.495353+0000","last_became_active":"2024-04-15T15:31:38.507396+0000","last_became_peered":"2024-04-15T15:31:38.507396+0000","last_unstale":"2024-04-15T15:31:39.495353+0000","last_undegraded":"2024-04-15T15:31:39.495353+0000","last_fullsized":"2024-04-15T15:31:39.495353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:16.026259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494597+0000","last_change":"2024-04-15T15:31:34.478907+0000","last_active":"2024-04-15T15:31:39.494597+0000","last_peered":"2024-04-15T15:31:39.494597+0000","last_clean":"2024-04-15T15:31:39.494597+0000","last_became_active":"2024-04-15T15:31:34.478612+0000","last_became_peered":"2024-04-15T15:31:34.478612+0000","last_unstale":"2024-04-15T15:31:39.494597+0000","last_undegraded":"2024-04-15T15:31:39.494597+0000","last_fullsized":"2024-04-15T15:31:39.494597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660317+0000","last_change":"2024-04-15T15:31:33.464608+0000","last_active":"2024-04-15T15:31:41.660317+0000","last_peered":"2024-04-15T15:31:41.660317+0000","last_clean":"2024-04-15T15:31:41.660317+0000","last_became_active":"2024-04-15T15:31:33.463697+0000","last_became_peered":"2024-04-15T15:31:33.463697+0000","last_unstale":"2024-04-15T15:31:41.660317+0000","last_undegraded":"2024-04-15T15:31:41.660317+0000","last_fullsized":"2024-04-15T15:31:41.660317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495009+0000","last_change":"2024-04-15T15:31:38.512929+0000","last_active":"2024-04-15T15:31:39.495009+0000","last_peered":"2024-04-15T15:31:39.495009+0000","last_clean":"2024-04-15T15:31:39.495009+0000","last_became_active":"2024-04-15T15:31:38.512502+0000","last_became_peered":"2024-04-15T15:31:38.512502+0000","last_unstale":"2024-04-15T15:31:39.495009+0000","last_undegraded":"2024-04-15T15:31:39.495009+0000","last_fullsized":"2024-04-15T15:31:39.495009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:07.300884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494687+0000","last_change":"2024-04-15T15:31:34.475733+0000","last_active":"2024-04-15T15:31:39.494687+0000","last_peered":"2024-04-15T15:31:39.494687+0000","last_clean":"2024-04-15T15:31:39.494687+0000","last_became_active":"2024-04-15T15:31:34.475366+0000","last_became_peered":"2024-04-15T15:31:34.475366+0000","last_unstale":"2024-04-15T15:31:39.494687+0000","last_undegraded":"2024-04-15T15:31:39.494687+0000","last_fullsized":"2024-04-15T15:31:39.494687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660301+0000","last_change":"2024-04-15T15:31:33.471618+0000","last_active":"2024-04-15T15:31:41.660301+0000","last_peered":"2024-04-15T15:31:41.660301+0000","last_clean":"2024-04-15T15:31:41.660301+0000","last_became_active":"2024-04-15T15:31:33.471405+0000","last_became_peered":"2024-04-15T15:31:33.471405+0000","last_unstale":"2024-04-15T15:31:41.660301+0000","last_undegraded":"2024-04-15T15:31:41.660301+0000","last_fullsized":"2024-04-15T15:31:41.660301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661411+0000","last_change":"2024-04-15T15:31:38.525886+0000","last_active":"2024-04-15T15:31:41.661411+0000","last_peered":"2024-04-15T15:31:41.661411+0000","last_clean":"2024-04-15T15:31:41.661411+0000","last_became_active":"2024-04-15T15:31:38.525493+0000","last_became_peered":"2024-04-15T15:31:38.525493+0000","last_unstale":"2024-04-15T15:31:41.661411+0000","last_undegraded":"2024-04-15T15:31:41.661411+0000","last_fullsized":"2024-04-15T15:31:41.661411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:20.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496343+0000","last_change":"2024-04-15T15:31:34.458960+0000","last_active":"2024-04-15T15:31:39.496343+0000","last_peered":"2024-04-15T15:31:39.496343+0000","last_clean":"2024-04-15T15:31:39.496343+0000","last_became_active":"2024-04-15T15:31:34.457972+0000","last_became_peered":"2024-04-15T15:31:34.457972+0000","last_unstale":"2024-04-15T15:31:39.496343+0000","last_undegraded":"2024-04-15T15:31:39.496343+0000","last_fullsized":"2024-04-15T15:31:39.496343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:34.951963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494692+0000","last_change":"2024-04-15T15:31:33.461302+0000","last_active":"2024-04-15T15:31:39.494692+0000","last_peered":"2024-04-15T15:31:39.494692+0000","last_clean":"2024-04-15T15:31:39.494692+0000","last_became_active":"2024-04-15T15:31:33.458813+0000","last_became_peered":"2024-04-15T15:31:33.458813+0000","last_unstale":"2024-04-15T15:31:39.494692+0000","last_undegraded":"2024-04-15T15:31:39.494692+0000","last_fullsized":"2024-04-15T15:31:39.494692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495913+0000","last_change":"2024-04-15T15:31:38.514622+0000","last_active":"2024-04-15T15:31:39.495913+0000","last_peered":"2024-04-15T15:31:39.495913+0000","last_clean":"2024-04-15T15:31:39.495913+0000","last_became_active":"2024-04-15T15:31:38.513418+0000","last_became_peered":"2024-04-15T15:31:38.513418+0000","last_unstale":"2024-04-15T15:31:39.495913+0000","last_undegraded":"2024-04-15T15:31:39.495913+0000","last_fullsized":"2024-04-15T15:31:39.495913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750568+0000","last_change":"2024-04-15T15:31:34.468186+0000","last_active":"2024-04-15T15:31:41.750568+0000","last_peered":"2024-04-15T15:31:41.750568+0000","last_clean":"2024-04-15T15:31:41.750568+0000","last_became_active":"2024-04-15T15:31:34.467908+0000","last_became_peered":"2024-04-15T15:31:34.467908+0000","last_unstale":"2024-04-15T15:31:41.750568+0000","last_undegraded":"2024-04-15T15:31:41.750568+0000","last_fullsized":"2024-04-15T15:31:41.750568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044539+0000","last_change":"2024-04-15T15:31:33.467227+0000","last_active":"2024-04-15T15:31:41.044539+0000","last_peered":"2024-04-15T15:31:41.044539+0000","last_clean":"2024-04-15T15:31:41.044539+0000","last_became_active":"2024-04-15T15:31:33.466947+0000","last_became_peered":"2024-04-15T15:31:33.466947+0000","last_unstale":"2024-04-15T15:31:41.044539+0000","last_undegraded":"2024-04-15T15:31:41.044539+0000","last_fullsized":"2024-04-15T15:31:41.044539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496140+0000","last_change":"2024-04-15T15:31:38.508721+0000","last_active":"2024-04-15T15:31:39.496140+0000","last_peered":"2024-04-15T15:31:39.496140+0000","last_clean":"2024-04-15T15:31:39.496140+0000","last_became_active":"2024-04-15T15:31:38.508183+0000","last_became_peered":"2024-04-15T15:31:38.508183+0000","last_unstale":"2024-04-15T15:31:39.496140+0000","last_undegraded":"2024-04-15T15:31:39.496140+0000","last_fullsized":"2024-04-15T15:31:39.496140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495271+0000","last_change":"2024-04-15T15:31:34.479989+0000","last_active":"2024-04-15T15:31:39.495271+0000","last_peered":"2024-04-15T15:31:39.495271+0000","last_clean":"2024-04-15T15:31:39.495271+0000","last_became_active":"2024-04-15T15:31:34.479662+0000","last_became_peered":"2024-04-15T15:31:34.479662+0000","last_unstale":"2024-04-15T15:31:39.495271+0000","last_undegraded":"2024-04-15T15:31:39.495271+0000","last_fullsized":"2024-04-15T15:31:39.495271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660411+0000","last_change":"2024-04-15T15:31:33.470912+0000","last_active":"2024-04-15T15:31:41.660411+0000","last_peered":"2024-04-15T15:31:41.660411+0000","last_clean":"2024-04-15T15:31:41.660411+0000","last_became_active":"2024-04-15T15:31:33.470665+0000","last_became_peered":"2024-04-15T15:31:33.470665+0000","last_unstale":"2024-04-15T15:31:41.660411+0000","last_undegraded":"2024-04-15T15:31:41.660411+0000","last_fullsized":"2024-04-15T15:31:41.660411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494323+0000","last_change":"2024-04-15T15:31:38.530139+0000","last_active":"2024-04-15T15:31:39.494323+0000","last_peered":"2024-04-15T15:31:39.494323+0000","last_clean":"2024-04-15T15:31:39.494323+0000","last_became_active":"2024-04-15T15:31:38.529420+0000","last_became_peered":"2024-04-15T15:31:38.529420+0000","last_unstale":"2024-04-15T15:31:39.494323+0000","last_undegraded":"2024-04-15T15:31:39.494323+0000","last_fullsized":"2024-04-15T15:31:39.494323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:25:04.752470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661111+0000","last_change":"2024-04-15T15:31:34.458302+0000","last_active":"2024-04-15T15:31:41.661111+0000","last_peered":"2024-04-15T15:31:41.661111+0000","last_clean":"2024-04-15T15:31:41.661111+0000","last_became_active":"2024-04-15T15:31:34.455963+0000","last_became_peered":"2024-04-15T15:31:34.455963+0000","last_unstale":"2024-04-15T15:31:41.661111+0000","last_undegraded":"2024-04-15T15:31:41.661111+0000","last_fullsized":"2024-04-15T15:31:41.661111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496735+0000","last_change":"2024-04-15T15:31:33.465392+0000","last_active":"2024-04-15T15:31:39.496735+0000","last_peered":"2024-04-15T15:31:39.496735+0000","last_clean":"2024-04-15T15:31:39.496735+0000","last_became_active":"2024-04-15T15:31:33.462727+0000","last_became_peered":"2024-04-15T15:31:33.462727+0000","last_unstale":"2024-04-15T15:31:39.496735+0000","last_undegraded":"2024-04-15T15:31:39.496735+0000","last_fullsized":"2024-04-15T15:31:39.496735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:31:42.645531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750004+0000","last_change":"2024-04-15T15:31:38.529068+0000","last_active":"2024-04-15T15:31:41.750004+0000","last_peered":"2024-04-15T15:31:41.750004+0000","last_clean":"2024-04-15T15:31:41.750004+0000","last_became_active":"2024-04-15T15:31:38.521736+0000","last_became_peered":"2024-04-15T15:31:38.521736+0000","last_unstale":"2024-04-15T15:31:41.750004+0000","last_undegraded":"2024-04-15T15:31:41.750004+0000","last_fullsized":"2024-04-15T15:31:41.750004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398049+0000","last_change":"2024-04-15T15:31:34.483798+0000","last_active":"2024-04-15T15:31:41.398049+0000","last_peered":"2024-04-15T15:31:41.398049+0000","last_clean":"2024-04-15T15:31:41.398049+0000","last_became_active":"2024-04-15T15:31:34.483476+0000","last_became_peered":"2024-04-15T15:31:34.483476+0000","last_unstale":"2024-04-15T15:31:41.398049+0000","last_undegraded":"2024-04-15T15:31:41.398049+0000","last_fullsized":"2024-04-15T15:31:41.398049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:43.459915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661205+0000","last_change":"2024-04-15T15:31:33.455617+0000","last_active":"2024-04-15T15:31:41.661205+0000","last_peered":"2024-04-15T15:31:41.661205+0000","last_clean":"2024-04-15T15:31:41.661205+0000","last_became_active":"2024-04-15T15:31:33.453330+0000","last_became_peered":"2024-04-15T15:31:33.453330+0000","last_unstale":"2024-04-15T15:31:41.661205+0000","last_undegraded":"2024-04-15T15:31:41.661205+0000","last_fullsized":"2024-04-15T15:31:41.661205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660834+0000","last_change":"2024-04-15T15:31:38.523416+0000","last_active":"2024-04-15T15:31:41.660834+0000","last_peered":"2024-04-15T15:31:41.660834+0000","last_clean":"2024-04-15T15:31:41.660834+0000","last_became_active":"2024-04-15T15:31:38.522902+0000","last_became_peered":"2024-04-15T15:31:38.522902+0000","last_unstale":"2024-04-15T15:31:41.660834+0000","last_undegraded":"2024-04-15T15:31:41.660834+0000","last_fullsized":"2024-04-15T15:31:41.660834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495419+0000","last_change":"2024-04-15T15:31:34.477054+0000","last_active":"2024-04-15T15:31:39.495419+0000","last_peered":"2024-04-15T15:31:39.495419+0000","last_clean":"2024-04-15T15:31:39.495419+0000","last_became_active":"2024-04-15T15:31:34.476543+0000","last_became_peered":"2024-04-15T15:31:34.476543+0000","last_unstale":"2024-04-15T15:31:39.495419+0000","last_undegraded":"2024-04-15T15:31:39.495419+0000","last_fullsized":"2024-04-15T15:31:39.495419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:31.194810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397846+0000","last_change":"2024-04-15T15:31:33.463222+0000","last_active":"2024-04-15T15:31:41.397846+0000","last_peered":"2024-04-15T15:31:41.397846+0000","last_clean":"2024-04-15T15:31:41.397846+0000","last_became_active":"2024-04-15T15:31:33.462885+0000","last_became_peered":"2024-04-15T15:31:33.462885+0000","last_unstale":"2024-04-15T15:31:41.397846+0000","last_undegraded":"2024-04-15T15:31:41.397846+0000","last_fullsized":"2024-04-15T15:31:41.397846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661135+0000","last_change":"2024-04-15T15:31:38.530546+0000","last_active":"2024-04-15T15:31:41.661135+0000","last_peered":"2024-04-15T15:31:41.661135+0000","last_clean":"2024-04-15T15:31:41.661135+0000","last_became_active":"2024-04-15T15:31:38.523847+0000","last_became_peered":"2024-04-15T15:31:38.523847+0000","last_unstale":"2024-04-15T15:31:41.661135+0000","last_undegraded":"2024-04-15T15:31:41.661135+0000","last_fullsized":"2024-04-15T15:31:41.661135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660785+0000","last_change":"2024-04-15T15:31:34.466367+0000","last_active":"2024-04-15T15:31:41.660785+0000","last_peered":"2024-04-15T15:31:41.660785+0000","last_clean":"2024-04-15T15:31:41.660785+0000","last_became_active":"2024-04-15T15:31:34.465456+0000","last_became_peered":"2024-04-15T15:31:34.465456+0000","last_unstale":"2024-04-15T15:31:41.660785+0000","last_undegraded":"2024-04-15T15:31:41.660785+0000","last_fullsized":"2024-04-15T15:31:41.660785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930895+0000","last_change":"2024-04-15T15:31:33.459428+0000","last_active":"2024-04-15T15:31:39.930895+0000","last_peered":"2024-04-15T15:31:39.930895+0000","last_clean":"2024-04-15T15:31:39.930895+0000","last_became_active":"2024-04-15T15:31:33.459061+0000","last_became_peered":"2024-04-15T15:31:33.459061+0000","last_unstale":"2024-04-15T15:31:39.930895+0000","last_undegraded":"2024-04-15T15:31:39.930895+0000","last_fullsized":"2024-04-15T15:31:39.930895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661442+0000","last_change":"2024-04-15T15:31:38.526730+0000","last_active":"2024-04-15T15:31:41.661442+0000","last_peered":"2024-04-15T15:31:41.661442+0000","last_clean":"2024-04-15T15:31:41.661442+0000","last_became_active":"2024-04-15T15:31:38.526377+0000","last_became_peered":"2024-04-15T15:31:38.526377+0000","last_unstale":"2024-04-15T15:31:41.661442+0000","last_undegraded":"2024-04-15T15:31:41.661442+0000","last_fullsized":"2024-04-15T15:31:41.661442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:32.616780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749771+0000","last_change":"2024-04-15T15:31:34.467685+0000","last_active":"2024-04-15T15:31:41.749771+0000","last_peered":"2024-04-15T15:31:41.749771+0000","last_clean":"2024-04-15T15:31:41.749771+0000","last_became_active":"2024-04-15T15:31:34.467225+0000","last_became_peered":"2024-04-15T15:31:34.467225+0000","last_unstale":"2024-04-15T15:31:41.749771+0000","last_undegraded":"2024-04-15T15:31:41.749771+0000","last_fullsized":"2024-04-15T15:31:41.749771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:59:25.080403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494797+0000","last_change":"2024-04-15T15:31:33.468019+0000","last_active":"2024-04-15T15:31:39.494797+0000","last_peered":"2024-04-15T15:31:39.494797+0000","last_clean":"2024-04-15T15:31:39.494797+0000","last_became_active":"2024-04-15T15:31:33.465568+0000","last_became_peered":"2024-04-15T15:31:33.465568+0000","last_unstale":"2024-04-15T15:31:39.494797+0000","last_undegraded":"2024-04-15T15:31:39.494797+0000","last_fullsized":"2024-04-15T15:31:39.494797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750596+0000","last_change":"2024-04-15T15:31:38.510659+0000","last_active":"2024-04-15T15:31:41.750596+0000","last_peered":"2024-04-15T15:31:41.750596+0000","last_clean":"2024-04-15T15:31:41.750596+0000","last_became_active":"2024-04-15T15:31:38.510130+0000","last_became_peered":"2024-04-15T15:31:38.510130+0000","last_unstale":"2024-04-15T15:31:41.750596+0000","last_undegraded":"2024-04-15T15:31:41.750596+0000","last_fullsized":"2024-04-15T15:31:41.750596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:11:14.235709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494622+0000","last_change":"2024-04-15T15:31:34.475942+0000","last_active":"2024-04-15T15:31:39.494622+0000","last_peered":"2024-04-15T15:31:39.494622+0000","last_clean":"2024-04-15T15:31:39.494622+0000","last_became_active":"2024-04-15T15:31:34.475645+0000","last_became_peered":"2024-04-15T15:31:34.475645+0000","last_unstale":"2024-04-15T15:31:39.494622+0000","last_undegraded":"2024-04-15T15:31:39.494622+0000","last_fullsized":"2024-04-15T15:31:39.494622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397687+0000","last_change":"2024-04-15T15:31:33.460934+0000","last_active":"2024-04-15T15:31:41.397687+0000","last_peered":"2024-04-15T15:31:41.397687+0000","last_clean":"2024-04-15T15:31:41.397687+0000","last_became_active":"2024-04-15T15:31:33.460488+0000","last_became_peered":"2024-04-15T15:31:33.460488+0000","last_unstale":"2024-04-15T15:31:41.397687+0000","last_undegraded":"2024-04-15T15:31:41.397687+0000","last_fullsized":"2024-04-15T15:31:41.397687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494896+0000","last_change":"2024-04-15T15:31:23.443687+0000","last_active":"2024-04-15T15:31:39.494896+0000","last_peered":"2024-04-15T15:31:39.494896+0000","last_clean":"2024-04-15T15:31:39.494896+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:31:39.494896+0000","last_undegraded":"2024-04-15T15:31:39.494896+0000","last_fullsized":"2024-04-15T15:31:39.494896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_clean_scrub_stamp":"2024-04-15T15:31:22.092427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:28:43.096549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044263+0000","last_change":"2024-04-15T15:31:38.509517+0000","last_active":"2024-04-15T15:31:41.044263+0000","last_peered":"2024-04-15T15:31:41.044263+0000","last_clean":"2024-04-15T15:31:41.044263+0000","last_became_active":"2024-04-15T15:31:38.509241+0000","last_became_peered":"2024-04-15T15:31:38.509241+0000","last_unstale":"2024-04-15T15:31:41.044263+0000","last_undegraded":"2024-04-15T15:31:41.044263+0000","last_fullsized":"2024-04-15T15:31:41.044263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496472+0000","last_change":"2024-04-15T15:31:34.482434+0000","last_active":"2024-04-15T15:31:39.496472+0000","last_peered":"2024-04-15T15:31:39.496472+0000","last_clean":"2024-04-15T15:31:39.496472+0000","last_became_active":"2024-04-15T15:31:34.481970+0000","last_became_peered":"2024-04-15T15:31:34.481970+0000","last_unstale":"2024-04-15T15:31:39.496472+0000","last_undegraded":"2024-04-15T15:31:39.496472+0000","last_fullsized":"2024-04-15T15:31:39.496472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:55.879743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931168+0000","last_change":"2024-04-15T15:31:33.463661+0000","last_active":"2024-04-15T15:31:39.931168+0000","last_peered":"2024-04-15T15:31:39.931168+0000","last_clean":"2024-04-15T15:31:39.931168+0000","last_became_active":"2024-04-15T15:31:33.463363+0000","last_became_peered":"2024-04-15T15:31:33.463363+0000","last_unstale":"2024-04-15T15:31:39.931168+0000","last_undegraded":"2024-04-15T15:31:39.931168+0000","last_fullsized":"2024-04-15T15:31:39.931168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044102+0000","last_change":"2024-04-15T15:31:38.508644+0000","last_active":"2024-04-15T15:31:41.044102+0000","last_peered":"2024-04-15T15:31:41.044102+0000","last_clean":"2024-04-15T15:31:41.044102+0000","last_became_active":"2024-04-15T15:31:38.508203+0000","last_became_peered":"2024-04-15T15:31:38.508203+0000","last_unstale":"2024-04-15T15:31:41.044102+0000","last_undegraded":"2024-04-15T15:31:41.044102+0000","last_fullsized":"2024-04-15T15:31:41.044102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397921+0000","last_change":"2024-04-15T15:31:34.484117+0000","last_active":"2024-04-15T15:31:41.397921+0000","last_peered":"2024-04-15T15:31:41.397921+0000","last_clean":"2024-04-15T15:31:41.397921+0000","last_became_active":"2024-04-15T15:31:34.483764+0000","last_became_peered":"2024-04-15T15:31:34.483764+0000","last_unstale":"2024-04-15T15:31:41.397921+0000","last_undegraded":"2024-04-15T15:31:41.397921+0000","last_fullsized":"2024-04-15T15:31:41.397921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:55.879743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660358+0000","last_change":"2024-04-15T15:31:33.462350+0000","last_active":"2024-04-15T15:31:41.660358+0000","last_peered":"2024-04-15T15:31:41.660358+0000","last_clean":"2024-04-15T15:31:41.660358+0000","last_became_active":"2024-04-15T15:31:33.462003+0000","last_became_peered":"2024-04-15T15:31:33.462003+0000","last_unstale":"2024-04-15T15:31:41.660358+0000","last_undegraded":"2024-04-15T15:31:41.660358+0000","last_fullsized":"2024-04-15T15:31:41.660358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750132+0000","last_change":"2024-04-15T15:31:38.518872+0000","last_active":"2024-04-15T15:31:41.750132+0000","last_peered":"2024-04-15T15:31:41.750132+0000","last_clean":"2024-04-15T15:31:41.750132+0000","last_became_active":"2024-04-15T15:31:38.517803+0000","last_became_peered":"2024-04-15T15:31:38.517803+0000","last_unstale":"2024-04-15T15:31:41.750132+0000","last_undegraded":"2024-04-15T15:31:41.750132+0000","last_fullsized":"2024-04-15T15:31:41.750132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:20.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.497118+0000","last_change":"2024-04-15T15:31:34.455266+0000","last_active":"2024-04-15T15:31:39.497118+0000","last_peered":"2024-04-15T15:31:39.497118+0000","last_clean":"2024-04-15T15:31:39.497118+0000","last_became_active":"2024-04-15T15:31:34.454909+0000","last_became_peered":"2024-04-15T15:31:34.454909+0000","last_unstale":"2024-04-15T15:31:39.497118+0000","last_undegraded":"2024-04-15T15:31:39.497118+0000","last_fullsized":"2024-04-15T15:31:39.497118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:11:10.192304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931330+0000","last_change":"2024-04-15T15:31:33.459513+0000","last_active":"2024-04-15T15:31:39.931330+0000","last_peered":"2024-04-15T15:31:39.931330+0000","last_clean":"2024-04-15T15:31:39.931330+0000","last_became_active":"2024-04-15T15:31:33.458815+0000","last_became_peered":"2024-04-15T15:31:33.458815+0000","last_unstale":"2024-04-15T15:31:39.931330+0000","last_undegraded":"2024-04-15T15:31:39.931330+0000","last_fullsized":"2024-04-15T15:31:39.931330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397253+0000","last_change":"2024-04-15T15:31:38.502775+0000","last_active":"2024-04-15T15:31:41.397253+0000","last_peered":"2024-04-15T15:31:41.397253+0000","last_clean":"2024-04-15T15:31:41.397253+0000","last_became_active":"2024-04-15T15:31:38.502352+0000","last_became_peered":"2024-04-15T15:31:38.502352+0000","last_unstale":"2024-04-15T15:31:41.397253+0000","last_undegraded":"2024-04-15T15:31:41.397253+0000","last_fullsized":"2024-04-15T15:31:41.397253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:19.820153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496741+0000","last_change":"2024-04-15T15:31:34.460915+0000","last_active":"2024-04-15T15:31:39.496741+0000","last_peered":"2024-04-15T15:31:39.496741+0000","last_clean":"2024-04-15T15:31:39.496741+0000","last_became_active":"2024-04-15T15:31:34.460597+0000","last_became_peered":"2024-04-15T15:31:34.460597+0000","last_unstale":"2024-04-15T15:31:39.496741+0000","last_undegraded":"2024-04-15T15:31:39.496741+0000","last_fullsized":"2024-04-15T15:31:39.496741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:47.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495992+0000","last_change":"2024-04-15T15:31:33.454373+0000","last_active":"2024-04-15T15:31:39.495992+0000","last_peered":"2024-04-15T15:31:39.495992+0000","last_clean":"2024-04-15T15:31:39.495992+0000","last_became_active":"2024-04-15T15:31:33.454125+0000","last_became_peered":"2024-04-15T15:31:33.454125+0000","last_unstale":"2024-04-15T15:31:39.495992+0000","last_undegraded":"2024-04-15T15:31:39.495992+0000","last_fullsized":"2024-04-15T15:31:39.495992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:37:53.773475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496068+0000","last_change":"2024-04-15T15:31:38.511943+0000","last_active":"2024-04-15T15:31:39.496068+0000","last_peered":"2024-04-15T15:31:39.496068+0000","last_clean":"2024-04-15T15:31:39.496068+0000","last_became_active":"2024-04-15T15:31:38.511494+0000","last_became_peered":"2024-04-15T15:31:38.511494+0000","last_unstale":"2024-04-15T15:31:39.496068+0000","last_undegraded":"2024-04-15T15:31:39.496068+0000","last_fullsized":"2024-04-15T15:31:39.496068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495491+0000","last_change":"2024-04-15T15:31:34.446971+0000","last_active":"2024-04-15T15:31:39.495491+0000","last_peered":"2024-04-15T15:31:39.495491+0000","last_clean":"2024-04-15T15:31:39.495491+0000","last_became_active":"2024-04-15T15:31:34.446687+0000","last_became_peered":"2024-04-15T15:31:34.446687+0000","last_unstale":"2024-04-15T15:31:39.495491+0000","last_undegraded":"2024-04-15T15:31:39.495491+0000","last_fullsized":"2024-04-15T15:31:39.495491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930804+0000","last_change":"2024-04-15T15:31:33.450642+0000","last_active":"2024-04-15T15:31:39.930804+0000","last_peered":"2024-04-15T15:31:39.930804+0000","last_clean":"2024-04-15T15:31:39.930804+0000","last_became_active":"2024-04-15T15:31:33.450034+0000","last_became_peered":"2024-04-15T15:31:33.450034+0000","last_unstale":"2024-04-15T15:31:39.930804+0000","last_undegraded":"2024-04-15T15:31:39.930804+0000","last_fullsized":"2024-04-15T15:31:39.930804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:34:26.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750433+0000","last_change":"2024-04-15T15:31:38.516804+0000","last_active":"2024-04-15T15:31:41.750433+0000","last_peered":"2024-04-15T15:31:41.750433+0000","last_clean":"2024-04-15T15:31:41.750433+0000","last_became_active":"2024-04-15T15:31:38.516244+0000","last_became_peered":"2024-04-15T15:31:38.516244+0000","last_unstale":"2024-04-15T15:31:41.750433+0000","last_undegraded":"2024-04-15T15:31:41.750433+0000","last_fullsized":"2024-04-15T15:31:41.750433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:47.503321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043900+0000","last_change":"2024-04-15T15:31:34.473243+0000","last_active":"2024-04-15T15:31:41.043900+0000","last_peered":"2024-04-15T15:31:41.043900+0000","last_clean":"2024-04-15T15:31:41.043900+0000","last_became_active":"2024-04-15T15:31:34.472907+0000","last_became_peered":"2024-04-15T15:31:34.472907+0000","last_unstale":"2024-04-15T15:31:41.043900+0000","last_undegraded":"2024-04-15T15:31:41.043900+0000","last_fullsized":"2024-04-15T15:31:41.043900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043921+0000","last_change":"2024-04-15T15:31:33.455306+0000","last_active":"2024-04-15T15:31:41.043921+0000","last_peered":"2024-04-15T15:31:41.043921+0000","last_clean":"2024-04-15T15:31:41.043921+0000","last_became_active":"2024-04-15T15:31:33.454939+0000","last_became_peered":"2024-04-15T15:31:33.454939+0000","last_unstale":"2024-04-15T15:31:41.043921+0000","last_undegraded":"2024-04-15T15:31:41.043921+0000","last_fullsized":"2024-04-15T15:31:41.043921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495222+0000","last_change":"2024-04-15T15:31:38.530485+0000","last_active":"2024-04-15T15:31:39.495222+0000","last_peered":"2024-04-15T15:31:39.495222+0000","last_clean":"2024-04-15T15:31:39.495222+0000","last_became_active":"2024-04-15T15:31:38.529528+0000","last_became_peered":"2024-04-15T15:31:38.529528+0000","last_unstale":"2024-04-15T15:31:39.495222+0000","last_undegraded":"2024-04-15T15:31:39.495222+0000","last_fullsized":"2024-04-15T15:31:39.495222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:34:18.616473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495712+0000","last_change":"2024-04-15T15:31:34.477711+0000","last_active":"2024-04-15T15:31:39.495712+0000","last_peered":"2024-04-15T15:31:39.495712+0000","last_clean":"2024-04-15T15:31:39.495712+0000","last_became_active":"2024-04-15T15:31:34.477444+0000","last_became_peered":"2024-04-15T15:31:34.477444+0000","last_unstale":"2024-04-15T15:31:39.495712+0000","last_undegraded":"2024-04-15T15:31:39.495712+0000","last_fullsized":"2024-04-15T15:31:39.495712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397755+0000","last_change":"2024-04-15T15:31:33.467098+0000","last_active":"2024-04-15T15:31:41.397755+0000","last_peered":"2024-04-15T15:31:41.397755+0000","last_clean":"2024-04-15T15:31:41.397755+0000","last_became_active":"2024-04-15T15:31:33.466808+0000","last_became_peered":"2024-04-15T15:31:33.466808+0000","last_unstale":"2024-04-15T15:31:41.397755+0000","last_undegraded":"2024-04-15T15:31:41.397755+0000","last_fullsized":"2024-04-15T15:31:41.397755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495267+0000","last_change":"2024-04-15T15:31:38.523143+0000","last_active":"2024-04-15T15:31:39.495267+0000","last_peered":"2024-04-15T15:31:39.495267+0000","last_clean":"2024-04-15T15:31:39.495267+0000","last_became_active":"2024-04-15T15:31:38.522583+0000","last_became_peered":"2024-04-15T15:31:38.522583+0000","last_unstale":"2024-04-15T15:31:39.495267+0000","last_undegraded":"2024-04-15T15:31:39.495267+0000","last_fullsized":"2024-04-15T15:31:39.495267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:55:17.165005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749967+0000","last_change":"2024-04-15T15:31:34.457507+0000","last_active":"2024-04-15T15:31:41.749967+0000","last_peered":"2024-04-15T15:31:41.749967+0000","last_clean":"2024-04-15T15:31:41.749967+0000","last_became_active":"2024-04-15T15:31:34.457210+0000","last_became_peered":"2024-04-15T15:31:34.457210+0000","last_unstale":"2024-04-15T15:31:41.749967+0000","last_undegraded":"2024-04-15T15:31:41.749967+0000","last_fullsized":"2024-04-15T15:31:41.749967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749354+0000","last_change":"2024-04-15T15:31:33.457018+0000","last_active":"2024-04-15T15:31:41.749354+0000","last_peered":"2024-04-15T15:31:41.749354+0000","last_clean":"2024-04-15T15:31:41.749354+0000","last_became_active":"2024-04-15T15:31:33.456421+0000","last_became_peered":"2024-04-15T15:31:33.456421+0000","last_unstale":"2024-04-15T15:31:41.749354+0000","last_undegraded":"2024-04-15T15:31:41.749354+0000","last_fullsized":"2024-04-15T15:31:41.749354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:05.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397989+0000","last_change":"2024-04-15T15:31:38.508761+0000","last_active":"2024-04-15T15:31:41.397989+0000","last_peered":"2024-04-15T15:31:41.397989+0000","last_clean":"2024-04-15T15:31:41.397989+0000","last_became_active":"2024-04-15T15:31:38.508347+0000","last_became_peered":"2024-04-15T15:31:38.508347+0000","last_unstale":"2024-04-15T15:31:41.397989+0000","last_undegraded":"2024-04-15T15:31:41.397989+0000","last_fullsized":"2024-04-15T15:31:41.397989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:55:06.941769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495673+0000","last_change":"2024-04-15T15:31:34.456767+0000","last_active":"2024-04-15T15:31:39.495673+0000","last_peered":"2024-04-15T15:31:39.495673+0000","last_clean":"2024-04-15T15:31:39.495673+0000","last_became_active":"2024-04-15T15:31:34.456363+0000","last_became_peered":"2024-04-15T15:31:34.456363+0000","last_unstale":"2024-04-15T15:31:39.495673+0000","last_undegraded":"2024-04-15T15:31:39.495673+0000","last_fullsized":"2024-04-15T15:31:39.495673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:44.684112+0000","last_change":"2024-04-15T15:31:33.461422+0000","last_active":"2024-04-15T15:31:44.684112+0000","last_peered":"2024-04-15T15:31:44.684112+0000","last_clean":"2024-04-15T15:31:44.684112+0000","last_became_active":"2024-04-15T15:31:33.459911+0000","last_became_peered":"2024-04-15T15:31:33.459911+0000","last_unstale":"2024-04-15T15:31:44.684112+0000","last_undegraded":"2024-04-15T15:31:44.684112+0000","last_fullsized":"2024-04-15T15:31:44.684112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660990+0000","last_change":"2024-04-15T15:31:38.510570+0000","last_active":"2024-04-15T15:31:41.660990+0000","last_peered":"2024-04-15T15:31:41.660990+0000","last_clean":"2024-04-15T15:31:41.660990+0000","last_became_active":"2024-04-15T15:31:38.510025+0000","last_became_peered":"2024-04-15T15:31:38.510025+0000","last_unstale":"2024-04-15T15:31:41.660990+0000","last_undegraded":"2024-04-15T15:31:41.660990+0000","last_fullsized":"2024-04-15T15:31:41.660990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495834+0000","last_change":"2024-04-15T15:31:34.446494+0000","last_active":"2024-04-15T15:31:39.495834+0000","last_peered":"2024-04-15T15:31:39.495834+0000","last_clean":"2024-04-15T15:31:39.495834+0000","last_became_active":"2024-04-15T15:31:34.446162+0000","last_became_peered":"2024-04-15T15:31:34.446162+0000","last_unstale":"2024-04-15T15:31:39.495834+0000","last_undegraded":"2024-04-15T15:31:39.495834+0000","last_fullsized":"2024-04-15T15:31:39.495834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:31:43.652130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660356+0000","last_change":"2024-04-15T15:31:33.464177+0000","last_active":"2024-04-15T15:31:41.660356+0000","last_peered":"2024-04-15T15:31:41.660356+0000","last_clean":"2024-04-15T15:31:41.660356+0000","last_became_active":"2024-04-15T15:31:33.463834+0000","last_became_peered":"2024-04-15T15:31:33.463834+0000","last_unstale":"2024-04-15T15:31:41.660356+0000","last_undegraded":"2024-04-15T15:31:41.660356+0000","last_fullsized":"2024-04-15T15:31:41.660356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494954+0000","last_change":"2024-04-15T15:31:38.513560+0000","last_active":"2024-04-15T15:31:39.494954+0000","last_peered":"2024-04-15T15:31:39.494954+0000","last_clean":"2024-04-15T15:31:39.494954+0000","last_became_active":"2024-04-15T15:31:38.512922+0000","last_became_peered":"2024-04-15T15:31:38.512922+0000","last_unstale":"2024-04-15T15:31:39.494954+0000","last_undegraded":"2024-04-15T15:31:39.494954+0000","last_fullsized":"2024-04-15T15:31:39.494954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:53.510244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750535+0000","last_change":"2024-04-15T15:31:34.486802+0000","last_active":"2024-04-15T15:31:41.750535+0000","last_peered":"2024-04-15T15:31:41.750535+0000","last_clean":"2024-04-15T15:31:41.750535+0000","last_became_active":"2024-04-15T15:31:34.481349+0000","last_became_peered":"2024-04-15T15:31:34.481349+0000","last_unstale":"2024-04-15T15:31:41.750535+0000","last_undegraded":"2024-04-15T15:31:41.750535+0000","last_fullsized":"2024-04-15T15:31:41.750535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398116+0000","last_change":"2024-04-15T15:31:33.470322+0000","last_active":"2024-04-15T15:31:41.398116+0000","last_peered":"2024-04-15T15:31:41.398116+0000","last_clean":"2024-04-15T15:31:41.398116+0000","last_became_active":"2024-04-15T15:31:33.470042+0000","last_became_peered":"2024-04-15T15:31:33.470042+0000","last_unstale":"2024-04-15T15:31:41.398116+0000","last_undegraded":"2024-04-15T15:31:41.398116+0000","last_fullsized":"2024-04-15T15:31:41.398116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494537+0000","last_change":"2024-04-15T15:31:38.515979+0000","last_active":"2024-04-15T15:31:39.494537+0000","last_peered":"2024-04-15T15:31:39.494537+0000","last_clean":"2024-04-15T15:31:39.494537+0000","last_became_active":"2024-04-15T15:31:38.510943+0000","last_became_peered":"2024-04-15T15:31:38.510943+0000","last_unstale":"2024-04-15T15:31:39.494537+0000","last_undegraded":"2024-04-15T15:31:39.494537+0000","last_fullsized":"2024-04-15T15:31:39.494537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:02:06.275540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398007+0000","last_change":"2024-04-15T15:31:34.468743+0000","last_active":"2024-04-15T15:31:41.398007+0000","last_peered":"2024-04-15T15:31:41.398007+0000","last_clean":"2024-04-15T15:31:41.398007+0000","last_became_active":"2024-04-15T15:31:34.468018+0000","last_became_peered":"2024-04-15T15:31:34.468018+0000","last_unstale":"2024-04-15T15:31:41.398007+0000","last_undegraded":"2024-04-15T15:31:41.398007+0000","last_fullsized":"2024-04-15T15:31:41.398007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:47.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044426+0000","last_change":"2024-04-15T15:31:33.473593+0000","last_active":"2024-04-15T15:31:41.044426+0000","last_peered":"2024-04-15T15:31:41.044426+0000","last_clean":"2024-04-15T15:31:41.044426+0000","last_became_active":"2024-04-15T15:31:33.473287+0000","last_became_peered":"2024-04-15T15:31:33.473287+0000","last_unstale":"2024-04-15T15:31:41.044426+0000","last_undegraded":"2024-04-15T15:31:41.044426+0000","last_fullsized":"2024-04-15T15:31:41.044426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494451+0000","last_change":"2024-04-15T15:31:38.507657+0000","last_active":"2024-04-15T15:31:39.494451+0000","last_peered":"2024-04-15T15:31:39.494451+0000","last_clean":"2024-04-15T15:31:39.494451+0000","last_became_active":"2024-04-15T15:31:38.507217+0000","last_became_peered":"2024-04-15T15:31:38.507217+0000","last_unstale":"2024-04-15T15:31:39.494451+0000","last_undegraded":"2024-04-15T15:31:39.494451+0000","last_fullsized":"2024-04-15T15:31:39.494451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:55:06.941769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750410+0000","last_change":"2024-04-15T15:31:38.521076+0000","last_active":"2024-04-15T15:31:41.750410+0000","last_peered":"2024-04-15T15:31:41.750410+0000","last_clean":"2024-04-15T15:31:41.750410+0000","last_became_active":"2024-04-15T15:31:38.518118+0000","last_became_peered":"2024-04-15T15:31:38.518118+0000","last_unstale":"2024-04-15T15:31:41.750410+0000","last_undegraded":"2024-04-15T15:31:41.750410+0000","last_fullsized":"2024-04-15T15:31:41.750410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:32.616780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660696+0000","last_change":"2024-04-15T15:31:34.460784+0000","last_active":"2024-04-15T15:31:41.660696+0000","last_peered":"2024-04-15T15:31:41.660696+0000","last_clean":"2024-04-15T15:31:41.660696+0000","last_became_active":"2024-04-15T15:31:34.460525+0000","last_became_peered":"2024-04-15T15:31:34.460525+0000","last_unstale":"2024-04-15T15:31:41.660696+0000","last_undegraded":"2024-04-15T15:31:41.660696+0000","last_fullsized":"2024-04-15T15:31:41.660696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397400+0000","last_change":"2024-04-15T15:31:33.462485+0000","last_active":"2024-04-15T15:31:41.397400+0000","last_peered":"2024-04-15T15:31:41.397400+0000","last_clean":"2024-04-15T15:31:41.397400+0000","last_became_active":"2024-04-15T15:31:33.461597+0000","last_became_peered":"2024-04-15T15:31:33.461597+0000","last_unstale":"2024-04-15T15:31:41.397400+0000","last_undegraded":"2024-04-15T15:31:41.397400+0000","last_fullsized":"2024-04-15T15:31:41.397400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044372+0000","last_change":"2024-04-15T15:31:38.513345+0000","last_active":"2024-04-15T15:31:41.044372+0000","last_peered":"2024-04-15T15:31:41.044372+0000","last_clean":"2024-04-15T15:31:41.044372+0000","last_became_active":"2024-04-15T15:31:38.512662+0000","last_became_peered":"2024-04-15T15:31:38.512662+0000","last_unstale":"2024-04-15T15:31:41.044372+0000","last_undegraded":"2024-04-15T15:31:41.044372+0000","last_fullsized":"2024-04-15T15:31:41.044372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494621+0000","last_change":"2024-04-15T15:31:34.483839+0000","last_active":"2024-04-15T15:31:39.494621+0000","last_peered":"2024-04-15T15:31:39.494621+0000","last_clean":"2024-04-15T15:31:39.494621+0000","last_became_active":"2024-04-15T15:31:34.483548+0000","last_became_peered":"2024-04-15T15:31:34.483548+0000","last_unstale":"2024-04-15T15:31:39.494621+0000","last_undegraded":"2024-04-15T15:31:39.494621+0000","last_fullsized":"2024-04-15T15:31:39.494621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494604+0000","last_change":"2024-04-15T15:31:33.466699+0000","last_active":"2024-04-15T15:31:39.494604+0000","last_peered":"2024-04-15T15:31:39.494604+0000","last_clean":"2024-04-15T15:31:39.494604+0000","last_became_active":"2024-04-15T15:31:33.466439+0000","last_became_peered":"2024-04-15T15:31:33.466439+0000","last_unstale":"2024-04-15T15:31:39.494604+0000","last_undegraded":"2024-04-15T15:31:39.494604+0000","last_fullsized":"2024-04-15T15:31:39.494604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044029+0000","last_change":"2024-04-15T15:31:33.464633+0000","last_active":"2024-04-15T15:31:41.044029+0000","last_peered":"2024-04-15T15:31:41.044029+0000","last_clean":"2024-04-15T15:31:41.044029+0000","last_became_active":"2024-04-15T15:31:33.463248+0000","last_became_peered":"2024-04-15T15:31:33.463248+0000","last_unstale":"2024-04-15T15:31:41.044029+0000","last_undegraded":"2024-04-15T15:31:41.044029+0000","last_fullsized":"2024-04-15T15:31:41.044029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750204+0000","last_change":"2024-04-15T15:31:34.483410+0000","last_active":"2024-04-15T15:31:41.750204+0000","last_peered":"2024-04-15T15:31:41.750204+0000","last_clean":"2024-04-15T15:31:41.750204+0000","last_became_active":"2024-04-15T15:31:34.482918+0000","last_became_peered":"2024-04-15T15:31:34.482918+0000","last_unstale":"2024-04-15T15:31:41.750204+0000","last_undegraded":"2024-04-15T15:31:41.750204+0000","last_fullsized":"2024-04-15T15:31:41.750204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931146+0000","last_change":"2024-04-15T15:31:38.511098+0000","last_active":"2024-04-15T15:31:39.931146+0000","last_peered":"2024-04-15T15:31:39.931146+0000","last_clean":"2024-04-15T15:31:39.931146+0000","last_became_active":"2024-04-15T15:31:38.510675+0000","last_became_peered":"2024-04-15T15:31:38.510675+0000","last_unstale":"2024-04-15T15:31:39.931146+0000","last_undegraded":"2024-04-15T15:31:39.931146+0000","last_fullsized":"2024-04-15T15:31:39.931146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:30:57.364887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494713+0000","last_change":"2024-04-15T15:31:33.460701+0000","last_active":"2024-04-15T15:31:39.494713+0000","last_peered":"2024-04-15T15:31:39.494713+0000","last_clean":"2024-04-15T15:31:39.494713+0000","last_became_active":"2024-04-15T15:31:33.460470+0000","last_became_peered":"2024-04-15T15:31:33.460470+0000","last_unstale":"2024-04-15T15:31:39.494713+0000","last_undegraded":"2024-04-15T15:31:39.494713+0000","last_fullsized":"2024-04-15T15:31:39.494713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:34:26.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495245+0000","last_change":"2024-04-15T15:31:34.448451+0000","last_active":"2024-04-15T15:31:39.495245+0000","last_peered":"2024-04-15T15:31:39.495245+0000","last_clean":"2024-04-15T15:31:39.495245+0000","last_became_active":"2024-04-15T15:31:34.448097+0000","last_became_peered":"2024-04-15T15:31:34.448097+0000","last_unstale":"2024-04-15T15:31:39.495245+0000","last_undegraded":"2024-04-15T15:31:39.495245+0000","last_fullsized":"2024-04-15T15:31:39.495245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:33.531988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495355+0000","last_change":"2024-04-15T15:31:38.531110+0000","last_active":"2024-04-15T15:31:39.495355+0000","last_peered":"2024-04-15T15:31:39.495355+0000","last_clean":"2024-04-15T15:31:39.495355+0000","last_became_active":"2024-04-15T15:31:38.530696+0000","last_became_peered":"2024-04-15T15:31:38.530696+0000","last_unstale":"2024-04-15T15:31:39.495355+0000","last_undegraded":"2024-04-15T15:31:39.495355+0000","last_fullsized":"2024-04-15T15:31:39.495355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:26:32.017433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043703+0000","last_change":"2024-04-15T15:31:34.473155+0000","last_active":"2024-04-15T15:31:41.043703+0000","last_peered":"2024-04-15T15:31:41.043703+0000","last_clean":"2024-04-15T15:31:41.043703+0000","last_became_active":"2024-04-15T15:31:34.472849+0000","last_became_peered":"2024-04-15T15:31:34.472849+0000","last_unstale":"2024-04-15T15:31:41.043703+0000","last_undegraded":"2024-04-15T15:31:41.043703+0000","last_fullsized":"2024-04-15T15:31:41.043703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930891+0000","last_change":"2024-04-15T15:31:34.477349+0000","last_active":"2024-04-15T15:31:39.930891+0000","last_peered":"2024-04-15T15:31:39.930891+0000","last_clean":"2024-04-15T15:31:39.930891+0000","last_became_active":"2024-04-15T15:31:34.476656+0000","last_became_peered":"2024-04-15T15:31:34.476656+0000","last_unstale":"2024-04-15T15:31:39.930891+0000","last_undegraded":"2024-04-15T15:31:39.930891+0000","last_fullsized":"2024-04-15T15:31:39.930891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:31.194810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397685+0000","last_change":"2024-04-15T15:31:34.483891+0000","last_active":"2024-04-15T15:31:41.397685+0000","last_peered":"2024-04-15T15:31:41.397685+0000","last_clean":"2024-04-15T15:31:41.397685+0000","last_became_active":"2024-04-15T15:31:34.483555+0000","last_became_peered":"2024-04-15T15:31:34.483555+0000","last_unstale":"2024-04-15T15:31:41.397685+0000","last_undegraded":"2024-04-15T15:31:41.397685+0000","last_fullsized":"2024-04-15T15:31:41.397685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750122+0000","last_change":"2024-04-15T15:31:34.483847+0000","last_active":"2024-04-15T15:31:41.750122+0000","last_peered":"2024-04-15T15:31:41.750122+0000","last_clean":"2024-04-15T15:31:41.750122+0000","last_became_active":"2024-04-15T15:31:34.483415+0000","last_became_peered":"2024-04-15T15:31:34.483415+0000","last_unstale":"2024-04-15T15:31:41.750122+0000","last_undegraded":"2024-04-15T15:31:41.750122+0000","last_fullsized":"2024-04-15T15:31:41.750122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495343+0000","last_change":"2024-04-15T15:31:34.483771+0000","last_active":"2024-04-15T15:31:39.495343+0000","last_peered":"2024-04-15T15:31:39.495343+0000","last_clean":"2024-04-15T15:31:39.495343+0000","last_became_active":"2024-04-15T15:31:34.483472+0000","last_became_peered":"2024-04-15T15:31:34.483472+0000","last_unstale":"2024-04-15T15:31:39.495343+0000","last_undegraded":"2024-04-15T15:31:39.495343+0000","last_fullsized":"2024-04-15T15:31:39.495343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661067+0000","last_change":"2024-04-15T15:31:34.460695+0000","last_active":"2024-04-15T15:31:41.661067+0000","last_peered":"2024-04-15T15:31:41.661067+0000","last_clean":"2024-04-15T15:31:41.661067+0000","last_became_active":"2024-04-15T15:31:34.460352+0000","last_became_peered":"2024-04-15T15:31:34.460352+0000","last_unstale":"2024-04-15T15:31:41.661067+0000","last_undegraded":"2024-04-15T15:31:41.661067+0000","last_fullsized":"2024-04-15T15:31:41.661067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044449+0000","last_change":"2024-04-15T15:31:34.463653+0000","last_active":"2024-04-15T15:31:41.044449+0000","last_peered":"2024-04-15T15:31:41.044449+0000","last_clean":"2024-04-15T15:31:41.044449+0000","last_became_active":"2024-04-15T15:31:34.463359+0000","last_became_peered":"2024-04-15T15:31:34.463359+0000","last_unstale":"2024-04-15T15:31:41.044449+0000","last_undegraded":"2024-04-15T15:31:41.044449+0000","last_fullsized":"2024-04-15T15:31:41.044449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495133+0000","last_change":"2024-04-15T15:31:34.479994+0000","last_active":"2024-04-15T15:31:39.495133+0000","last_peered":"2024-04-15T15:31:39.495133+0000","last_clean":"2024-04-15T15:31:39.495133+0000","last_became_active":"2024-04-15T15:31:34.479723+0000","last_became_peered":"2024-04-15T15:31:34.479723+0000","last_unstale":"2024-04-15T15:31:39.495133+0000","last_undegraded":"2024-04-15T15:31:39.495133+0000","last_fullsized":"2024-04-15T15:31:39.495133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397390+0000","last_change":"2024-04-15T15:31:34.479946+0000","last_active":"2024-04-15T15:31:41.397390+0000","last_peered":"2024-04-15T15:31:41.397390+0000","last_clean":"2024-04-15T15:31:41.397390+0000","last_became_active":"2024-04-15T15:31:34.479601+0000","last_became_peered":"2024-04-15T15:31:34.479601+0000","last_unstale":"2024-04-15T15:31:41.397390+0000","last_undegraded":"2024-04-15T15:31:41.397390+0000","last_fullsized":"2024-04-15T15:31:41.397390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494489+0000","last_change":"2024-04-15T15:31:34.475999+0000","last_active":"2024-04-15T15:31:39.494489+0000","last_peered":"2024-04-15T15:31:39.494489+0000","last_clean":"2024-04-15T15:31:39.494489+0000","last_became_active":"2024-04-15T15:31:34.475713+0000","last_became_peered":"2024-04-15T15:31:34.475713+0000","last_unstale":"2024-04-15T15:31:39.494489+0000","last_undegraded":"2024-04-15T15:31:39.494489+0000","last_fullsized":"2024-04-15T15:31:39.494489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397629+0000","last_change":"2024-04-15T15:31:34.466771+0000","last_active":"2024-04-15T15:31:41.397629+0000","last_peered":"2024-04-15T15:31:41.397629+0000","last_clean":"2024-04-15T15:31:41.397629+0000","last_became_active":"2024-04-15T15:31:34.465716+0000","last_became_peered":"2024-04-15T15:31:34.465716+0000","last_unstale":"2024-04-15T15:31:41.397629+0000","last_undegraded":"2024-04-15T15:31:41.397629+0000","last_fullsized":"2024-04-15T15:31:41.397629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749975+0000","last_change":"2024-04-15T15:31:34.468936+0000","last_active":"2024-04-15T15:31:41.749975+0000","last_peered":"2024-04-15T15:31:41.749975+0000","last_clean":"2024-04-15T15:31:41.749975+0000","last_became_active":"2024-04-15T15:31:34.467355+0000","last_became_peered":"2024-04-15T15:31:34.467355+0000","last_unstale":"2024-04-15T15:31:41.749975+0000","last_undegraded":"2024-04-15T15:31:41.749975+0000","last_fullsized":"2024-04-15T15:31:41.749975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044624+0000","last_change":"2024-04-15T15:31:34.469868+0000","last_active":"2024-04-15T15:31:41.044624+0000","last_peered":"2024-04-15T15:31:41.044624+0000","last_clean":"2024-04-15T15:31:41.044624+0000","last_became_active":"2024-04-15T15:31:34.469606+0000","last_became_peered":"2024-04-15T15:31:34.469606+0000","last_unstale":"2024-04-15T15:31:41.044624+0000","last_undegraded":"2024-04-15T15:31:41.044624+0000","last_fullsized":"2024-04-15T15:31:41.044624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496599+0000","last_change":"2024-04-15T15:31:34.456774+0000","last_active":"2024-04-15T15:31:39.496599+0000","last_peered":"2024-04-15T15:31:39.496599+0000","last_clean":"2024-04-15T15:31:39.496599+0000","last_became_active":"2024-04-15T15:31:34.456377+0000","last_became_peered":"2024-04-15T15:31:34.456377+0000","last_unstale":"2024-04-15T15:31:39.496599+0000","last_undegraded":"2024-04-15T15:31:39.496599+0000","last_fullsized":"2024-04-15T15:31:39.496599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:43.459915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931279+0000","last_change":"2024-04-15T15:31:34.459078+0000","last_active":"2024-04-15T15:31:39.931279+0000","last_peered":"2024-04-15T15:31:39.931279+0000","last_clean":"2024-04-15T15:31:39.931279+0000","last_became_active":"2024-04-15T15:31:34.458498+0000","last_became_peered":"2024-04-15T15:31:34.458498+0000","last_unstale":"2024-04-15T15:31:39.931279+0000","last_undegraded":"2024-04-15T15:31:39.931279+0000","last_fullsized":"2024-04-15T15:31:39.931279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:34.951963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398285+0000","last_change":"2024-04-15T15:31:34.472749+0000","last_active":"2024-04-15T15:31:41.398285+0000","last_peered":"2024-04-15T15:31:41.398285+0000","last_clean":"2024-04-15T15:31:41.398285+0000","last_became_active":"2024-04-15T15:31:34.472465+0000","last_became_peered":"2024-04-15T15:31:34.472465+0000","last_unstale":"2024-04-15T15:31:41.398285+0000","last_undegraded":"2024-04-15T15:31:41.398285+0000","last_fullsized":"2024-04-15T15:31:41.398285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:16.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397279+0000","last_change":"2024-04-15T15:31:34.472038+0000","last_active":"2024-04-15T15:31:41.397279+0000","last_peered":"2024-04-15T15:31:41.397279+0000","last_clean":"2024-04-15T15:31:41.397279+0000","last_became_active":"2024-04-15T15:31:34.471764+0000","last_became_peered":"2024-04-15T15:31:34.471764+0000","last_unstale":"2024-04-15T15:31:41.397279+0000","last_undegraded":"2024-04-15T15:31:41.397279+0000","last_fullsized":"2024-04-15T15:31:41.397279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660748+0000","last_change":"2024-04-15T15:31:34.458770+0000","last_active":"2024-04-15T15:31:41.660748+0000","last_peered":"2024-04-15T15:31:41.660748+0000","last_clean":"2024-04-15T15:31:41.660748+0000","last_became_active":"2024-04-15T15:31:34.457006+0000","last_became_peered":"2024-04-15T15:31:34.457006+0000","last_unstale":"2024-04-15T15:31:41.660748+0000","last_undegraded":"2024-04-15T15:31:41.660748+0000","last_fullsized":"2024-04-15T15:31:41.660748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749969+0000","last_change":"2024-04-15T15:31:34.461367+0000","last_active":"2024-04-15T15:31:41.749969+0000","last_peered":"2024-04-15T15:31:41.749969+0000","last_clean":"2024-04-15T15:31:41.749969+0000","last_became_active":"2024-04-15T15:31:34.461047+0000","last_became_peered":"2024-04-15T15:31:34.461047+0000","last_unstale":"2024-04-15T15:31:41.749969+0000","last_undegraded":"2024-04-15T15:31:41.749969+0000","last_fullsized":"2024-04-15T15:31:41.749969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:23.572024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494956+0000","last_change":"2024-04-15T15:31:34.469034+0000","last_active":"2024-04-15T15:31:39.494956+0000","last_peered":"2024-04-15T15:31:39.494956+0000","last_clean":"2024-04-15T15:31:39.494956+0000","last_became_active":"2024-04-15T15:31:34.468672+0000","last_became_peered":"2024-04-15T15:31:34.468672+0000","last_unstale":"2024-04-15T15:31:39.494956+0000","last_undegraded":"2024-04-15T15:31:39.494956+0000","last_fullsized":"2024-04-15T15:31:39.494956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495762+0000","last_change":"2024-04-15T15:31:34.468002+0000","last_active":"2024-04-15T15:31:39.495762+0000","last_peered":"2024-04-15T15:31:39.495762+0000","last_clean":"2024-04-15T15:31:39.495762+0000","last_became_active":"2024-04-15T15:31:34.467722+0000","last_became_peered":"2024-04-15T15:31:34.467722+0000","last_unstale":"2024-04-15T15:31:39.495762+0000","last_undegraded":"2024-04-15T15:31:39.495762+0000","last_fullsized":"2024-04-15T15:31:39.495762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:32.225234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044380+0000","last_change":"2024-04-15T15:31:34.480518+0000","last_active":"2024-04-15T15:31:41.044380+0000","last_peered":"2024-04-15T15:31:41.044380+0000","last_clean":"2024-04-15T15:31:41.044380+0000","last_became_active":"2024-04-15T15:31:34.480217+0000","last_became_peered":"2024-04-15T15:31:34.480217+0000","last_unstale":"2024-04-15T15:31:41.044380+0000","last_undegraded":"2024-04-15T15:31:41.044380+0000","last_fullsized":"2024-04-15T15:31:41.044380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044414+0000","last_change":"2024-04-15T15:31:34.476865+0000","last_active":"2024-04-15T15:31:41.044414+0000","last_peered":"2024-04-15T15:31:41.044414+0000","last_clean":"2024-04-15T15:31:41.044414+0000","last_became_active":"2024-04-15T15:31:34.476592+0000","last_became_peered":"2024-04-15T15:31:34.476592+0000","last_unstale":"2024-04-15T15:31:41.044414+0000","last_undegraded":"2024-04-15T15:31:41.044414+0000","last_fullsized":"2024-04-15T15:31:41.044414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.497050+0000","last_change":"2024-04-15T15:31:34.470331+0000","last_active":"2024-04-15T15:31:39.497050+0000","last_peered":"2024-04-15T15:31:39.497050+0000","last_clean":"2024-04-15T15:31:39.497050+0000","last_became_active":"2024-04-15T15:31:34.469766+0000","last_became_peered":"2024-04-15T15:31:34.469766+0000","last_unstale":"2024-04-15T15:31:39.497050+0000","last_undegraded":"2024-04-15T15:31:39.497050+0000","last_fullsized":"2024-04-15T15:31:39.497050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:28.573374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494297+0000","last_change":"2024-04-15T15:31:34.477666+0000","last_active":"2024-04-15T15:31:39.494297+0000","last_peered":"2024-04-15T15:31:39.494297+0000","last_clean":"2024-04-15T15:31:39.494297+0000","last_became_active":"2024-04-15T15:31:34.477474+0000","last_became_peered":"2024-04-15T15:31:34.477474+0000","last_unstale":"2024-04-15T15:31:39.494297+0000","last_undegraded":"2024-04-15T15:31:39.494297+0000","last_fullsized":"2024-04-15T15:31:39.494297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495353+0000","last_change":"2024-04-15T15:31:34.464289+0000","last_active":"2024-04-15T15:31:39.495353+0000","last_peered":"2024-04-15T15:31:39.495353+0000","last_clean":"2024-04-15T15:31:39.495353+0000","last_became_active":"2024-04-15T15:31:34.463192+0000","last_became_peered":"2024-04-15T15:31:34.463192+0000","last_unstale":"2024-04-15T15:31:39.495353+0000","last_undegraded":"2024-04-15T15:31:39.495353+0000","last_fullsized":"2024-04-15T15:31:39.495353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397536+0000","last_change":"2024-04-15T15:31:34.468251+0000","last_active":"2024-04-15T15:31:41.397536+0000","last_peered":"2024-04-15T15:31:41.397536+0000","last_clean":"2024-04-15T15:31:41.397536+0000","last_became_active":"2024-04-15T15:31:34.466070+0000","last_became_peered":"2024-04-15T15:31:34.466070+0000","last_unstale":"2024-04-15T15:31:41.397536+0000","last_undegraded":"2024-04-15T15:31:41.397536+0000","last_fullsized":"2024-04-15T15:31:41.397536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495574+0000","last_change":"2024-04-15T15:31:34.455934+0000","last_active":"2024-04-15T15:31:39.495574+0000","last_peered":"2024-04-15T15:31:39.495574+0000","last_clean":"2024-04-15T15:31:39.495574+0000","last_became_active":"2024-04-15T15:31:34.455599+0000","last_became_peered":"2024-04-15T15:31:34.455599+0000","last_unstale":"2024-04-15T15:31:39.495574+0000","last_undegraded":"2024-04-15T15:31:39.495574+0000","last_fullsized":"2024-04-15T15:31:39.495574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397749+0000","last_change":"2024-04-15T15:31:34.484026+0000","last_active":"2024-04-15T15:31:41.397749+0000","last_peered":"2024-04-15T15:31:41.397749+0000","last_clean":"2024-04-15T15:31:41.397749+0000","last_became_active":"2024-04-15T15:31:34.483383+0000","last_became_peered":"2024-04-15T15:31:34.483383+0000","last_unstale":"2024-04-15T15:31:41.397749+0000","last_undegraded":"2024-04-15T15:31:41.397749+0000","last_fullsized":"2024-04-15T15:31:41.397749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750318+0000","last_change":"2024-04-15T15:31:34.470556+0000","last_active":"2024-04-15T15:31:41.750318+0000","last_peered":"2024-04-15T15:31:41.750318+0000","last_clean":"2024-04-15T15:31:41.750318+0000","last_became_active":"2024-04-15T15:31:34.467292+0000","last_became_peered":"2024-04-15T15:31:34.467292+0000","last_unstale":"2024-04-15T15:31:41.750318+0000","last_undegraded":"2024-04-15T15:31:41.750318+0000","last_fullsized":"2024-04-15T15:31:41.750318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661305+0000","last_change":"2024-04-15T15:31:34.470522+0000","last_active":"2024-04-15T15:31:41.661305+0000","last_peered":"2024-04-15T15:31:41.661305+0000","last_clean":"2024-04-15T15:31:41.661305+0000","last_became_active":"2024-04-15T15:31:34.470091+0000","last_became_peered":"2024-04-15T15:31:34.470091+0000","last_unstale":"2024-04-15T15:31:41.661305+0000","last_undegraded":"2024-04-15T15:31:41.661305+0000","last_fullsized":"2024-04-15T15:31:41.661305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496926+0000","last_change":"2024-04-15T15:31:34.460838+0000","last_active":"2024-04-15T15:31:39.496926+0000","last_peered":"2024-04-15T15:31:39.496926+0000","last_clean":"2024-04-15T15:31:39.496926+0000","last_became_active":"2024-04-15T15:31:34.460557+0000","last_became_peered":"2024-04-15T15:31:34.460557+0000","last_unstale":"2024-04-15T15:31:39.496926+0000","last_undegraded":"2024-04-15T15:31:39.496926+0000","last_fullsized":"2024-04-15T15:31:39.496926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:16.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:31:53.981 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:31:54.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.149+0000 7f538cc00640 1 Processor -- start 2024-04-15T15:31:54.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.149+0000 7f538cc00640 1 -- start start 2024-04-15T15:31:54.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.149+0000 7f538cc00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f538815b5d0 0x7f538815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.149+0000 7f538cc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53880b27c0 0x7f53880b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.149+0000 7f538cc00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5388070160 con 0x7f53880b3e30 2024-04-15T15:31:54.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.149+0000 7f538cc00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f538815b9b0 con 0x7f538815b5d0 2024-04-15T15:31:54.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.149+0000 7f538cc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f538815f1f0 con 0x7f53880b27c0 2024-04-15T15:31:54.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.149+0000 7f5385e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f538815b5d0 0x7f538815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.149+0000 7f537d400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f53880b3e30 0x7f53880b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37534/0 (socket says 172.21.15.73:37534) 2024-04-15T15:31:54.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.149+0000 7f537d400640 1 -- 172.21.15.73:0/3817086209 learned_addr learned my addr 172.21.15.73:0/3817086209 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:54.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f5386800640 1 --2- 172.21.15.73:0/3817086209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53880b27c0 0x7f53880b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f5385e00640 1 -- 172.21.15.73:0/3817086209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53880b27c0 msgr2=0x7f53880b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:54.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f5385e00640 1 --2- 172.21.15.73:0/3817086209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53880b27c0 0x7f53880b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f5385e00640 1 -- 172.21.15.73:0/3817086209 >> v1:172.21.15.73:6789/0 conn(0x7f53880b3e30 legacy=0x7f53880b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f5385e00640 1 -- 172.21.15.73:0/3817086209 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538806fe80 con 0x7f538815b5d0 2024-04-15T15:31:54.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f5385e00640 1 --2- 172.21.15.73:0/3817086209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 0x7f538815fc90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f53780097f0 tx=0x7f537801e560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c82021d64dd6f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:54.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f5385400640 1 -- 172.21.15.73:0/3817086209 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53780ab430 con 0x7f538815b5d0 2024-04-15T15:31:54.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f5385400640 1 -- 172.21.15.73:0/3817086209 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53780ab5d0 con 0x7f538815b5d0 2024-04-15T15:31:54.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f5385400640 1 -- 172.21.15.73:0/3817086209 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53780ab9a0 con 0x7f538815b5d0 2024-04-15T15:31:54.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f538cc00640 1 -- 172.21.15.73:0/3817086209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 msgr2=0x7f538815fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f538cc00640 1 --2- 172.21.15.73:0/3817086209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 0x7f538815fc90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f53780097f0 tx=0x7f537801e560 comp rx=0 tx=0).stop 2024-04-15T15:31:54.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f538cc00640 1 -- 172.21.15.73:0/3817086209 shutdown_connections 2024-04-15T15:31:54.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f538cc00640 1 --2- 172.21.15.73:0/3817086209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53880b27c0 0x7f53880b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f538cc00640 1 --2- 172.21.15.73:0/3817086209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 0x7f538815fc90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.153+0000 7f538cc00640 1 -- 172.21.15.73:0/3817086209 >> 172.21.15.73:0/3817086209 conn(0x7f5388067dd0 msgr2=0x7f53880d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:54.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 -- 172.21.15.73:0/3817086209 shutdown_connections 2024-04-15T15:31:54.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 -- 172.21.15.73:0/3817086209 wait complete. 2024-04-15T15:31:54.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 Processor -- start 2024-04-15T15:31:54.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 -- start start 2024-04-15T15:31:54.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53880b27c0 0x7f538814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53880b3e30 0x7f538814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 0x7f5388160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f538806faa0 con 0x7f538815b5d0 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f53880b4240 con 0x7f53880b27c0 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f538806fc20 con 0x7f53880b3e30 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5386800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 0x7f5388160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5386800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 0x7f5388160b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45306/0 (socket says 172.21.15.73:45306) 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5386800640 1 -- 172.21.15.73:0/3143020795 learned_addr learned my addr 172.21.15.73:0/3143020795 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f537d400640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53880b3e30 0x7f538814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5385e00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53880b27c0 0x7f538814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5386800640 1 -- 172.21.15.73:0/3143020795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53880b3e30 msgr2=0x7f538814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5386800640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53880b3e30 0x7f538814ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5386800640 1 -- 172.21.15.73:0/3143020795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53880b27c0 msgr2=0x7f538814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5386800640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53880b27c0 0x7f538814ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5386800640 1 -- 172.21.15.73:0/3143020795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538814d110 con 0x7f538815b5d0 2024-04-15T15:31:54.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5385e00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53880b27c0 0x7f538814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:54.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f5386800640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 0x7f5388160b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5380007d40 tx=0x7f538000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:54.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f537ea00640 1 -- 172.21.15.73:0/3143020795 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380014420 con 0x7f538815b5d0 2024-04-15T15:31:54.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f537ea00640 1 -- 172.21.15.73:0/3143020795 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5380019070 con 0x7f538815b5d0 2024-04-15T15:31:54.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f537ea00640 1 -- 172.21.15.73:0/3143020795 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380014820 con 0x7f538815b5d0 2024-04-15T15:31:54.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 -- 172.21.15.73:0/3143020795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538814d3f0 con 0x7f538815b5d0 2024-04-15T15:31:54.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.157+0000 7f538cc00640 1 -- 172.21.15.73:0/3143020795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538814d9b0 con 0x7f538815b5d0 2024-04-15T15:31:54.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.161+0000 7f538cc00640 1 -- 172.21.15.73:0/3143020795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5388068ab0 con 0x7f538815b5d0 2024-04-15T15:31:54.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.161+0000 7f537ea00640 1 -- 172.21.15.73:0/3143020795 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53800149c0 con 0x7f538815b5d0 2024-04-15T15:31:54.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.161+0000 7f537ea00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f53640683b0 0x7f536406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.161+0000 7f537ea00640 1 -- 172.21.15.73:0/3143020795 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5380087510 con 0x7f538815b5d0 2024-04-15T15:31:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.161+0000 7f5385e00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f53640683b0 0x7f536406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.161+0000 7f5385e00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f53640683b0 0x7f536406a870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53780b0000 tx=0x7f53780b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:54.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.165+0000 7f537ea00640 1 -- 172.21.15.73:0/3143020795 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5380057780 con 0x7f538815b5d0 2024-04-15T15:31:54.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.317+0000 7f538cc00640 1 -- 172.21.15.73:0/3143020795 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f538806f370 con 0x7f53640683b0 2024-04-15T15:31:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.325+0000 7f537ea00640 1 -- 172.21.15.73:0/3143020795 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7f538806f370 con 0x7f53640683b0 2024-04-15T15:31:54.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:54.335 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:31:54.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.329+0000 7f538cc00640 1 -- 172.21.15.73:0/3143020795 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f53640683b0 msgr2=0x7f536406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.329+0000 7f538cc00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f53640683b0 0x7f536406a870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53780b0000 tx=0x7f53780b5040 comp rx=0 tx=0).stop 2024-04-15T15:31:54.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.329+0000 7f538cc00640 1 -- 172.21.15.73:0/3143020795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 msgr2=0x7f5388160b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.329+0000 7f538cc00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 0x7f5388160b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5380007d40 tx=0x7f538000e4b0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.329+0000 7f538cc00640 1 -- 172.21.15.73:0/3143020795 shutdown_connections 2024-04-15T15:31:54.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.329+0000 7f538cc00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f538815b5d0 0x7f5388160b50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.329+0000 7f538cc00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f53640683b0 0x7f536406a870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.329+0000 7f538cc00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53880b3e30 0x7f538814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.329+0000 7f538cc00640 1 --2- 172.21.15.73:0/3143020795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53880b27c0 0x7f538814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.329+0000 7f538cc00640 1 -- 172.21.15.73:0/3143020795 >> 172.21.15.73:0/3143020795 conn(0x7f5388067dd0 msgr2=0x7f5388152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.333+0000 7f538cc00640 1 -- 172.21.15.73:0/3143020795 shutdown_connections 2024-04-15T15:31:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.333+0000 7f538cc00640 1 -- 172.21.15.73:0/3143020795 wait complete. 2024-04-15T15:31:54.352 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-15T15:31:53.360080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223632,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751088,"statfs":{"total":773094113280,"available":772865114112,"internally_reserved":0,"allocated":3383296,"data_stored":2029150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002675"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749471+0000","last_change":"2024-04-15T15:31:33.445529+0000","last_active":"2024-04-15T15:31:41.749471+0000","last_peered":"2024-04-15T15:31:41.749471+0000","last_clean":"2024-04-15T15:31:41.749471+0000","last_became_active":"2024-04-15T15:31:33.444843+0000","last_became_peered":"2024-04-15T15:31:33.444843+0000","last_unstale":"2024-04-15T15:31:41.749471+0000","last_undegraded":"2024-04-15T15:31:41.749471+0000","last_fullsized":"2024-04-15T15:31:41.749471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:55:28.751007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494876+0000","last_change":"2024-04-15T15:31:34.469462+0000","last_active":"2024-04-15T15:31:39.494876+0000","last_peered":"2024-04-15T15:31:39.494876+0000","last_clean":"2024-04-15T15:31:39.494876+0000","last_became_active":"2024-04-15T15:31:34.468636+0000","last_became_peered":"2024-04-15T15:31:34.468636+0000","last_unstale":"2024-04-15T15:31:39.494876+0000","last_undegraded":"2024-04-15T15:31:39.494876+0000","last_fullsized":"2024-04-15T15:31:39.494876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494365+0000","last_change":"2024-04-15T15:31:38.508287+0000","last_active":"2024-04-15T15:31:39.494365+0000","last_peered":"2024-04-15T15:31:39.494365+0000","last_clean":"2024-04-15T15:31:39.494365+0000","last_became_active":"2024-04-15T15:31:38.507377+0000","last_became_peered":"2024-04-15T15:31:38.507377+0000","last_unstale":"2024-04-15T15:31:39.494365+0000","last_undegraded":"2024-04-15T15:31:39.494365+0000","last_fullsized":"2024-04-15T15:31:39.494365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:19.820153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495019+0000","last_change":"2024-04-15T15:31:33.461774+0000","last_active":"2024-04-15T15:31:39.495019+0000","last_peered":"2024-04-15T15:31:39.495019+0000","last_clean":"2024-04-15T15:31:39.495019+0000","last_became_active":"2024-04-15T15:31:33.461439+0000","last_became_peered":"2024-04-15T15:31:33.461439+0000","last_unstale":"2024-04-15T15:31:39.495019+0000","last_undegraded":"2024-04-15T15:31:39.495019+0000","last_fullsized":"2024-04-15T15:31:39.495019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750446+0000","last_change":"2024-04-15T15:31:34.482829+0000","last_active":"2024-04-15T15:31:41.750446+0000","last_peered":"2024-04-15T15:31:41.750446+0000","last_clean":"2024-04-15T15:31:41.750446+0000","last_became_active":"2024-04-15T15:31:34.481691+0000","last_became_peered":"2024-04-15T15:31:34.481691+0000","last_unstale":"2024-04-15T15:31:41.750446+0000","last_undegraded":"2024-04-15T15:31:41.750446+0000","last_fullsized":"2024-04-15T15:31:41.750446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494732+0000","last_change":"2024-04-15T15:31:38.509783+0000","last_active":"2024-04-15T15:31:39.494732+0000","last_peered":"2024-04-15T15:31:39.494732+0000","last_clean":"2024-04-15T15:31:39.494732+0000","last_became_active":"2024-04-15T15:31:38.509318+0000","last_became_peered":"2024-04-15T15:31:38.509318+0000","last_unstale":"2024-04-15T15:31:39.494732+0000","last_undegraded":"2024-04-15T15:31:39.494732+0000","last_fullsized":"2024-04-15T15:31:39.494732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:41.291523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496578+0000","last_change":"2024-04-15T15:31:33.469801+0000","last_active":"2024-04-15T15:31:39.496578+0000","last_peered":"2024-04-15T15:31:39.496578+0000","last_clean":"2024-04-15T15:31:39.496578+0000","last_became_active":"2024-04-15T15:31:33.469406+0000","last_became_peered":"2024-04-15T15:31:33.469406+0000","last_unstale":"2024-04-15T15:31:39.496578+0000","last_undegraded":"2024-04-15T15:31:39.496578+0000","last_fullsized":"2024-04-15T15:31:39.496578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397887+0000","last_change":"2024-04-15T15:31:34.480152+0000","last_active":"2024-04-15T15:31:41.397887+0000","last_peered":"2024-04-15T15:31:41.397887+0000","last_clean":"2024-04-15T15:31:41.397887+0000","last_became_active":"2024-04-15T15:31:34.479857+0000","last_became_peered":"2024-04-15T15:31:34.479857+0000","last_unstale":"2024-04-15T15:31:41.397887+0000","last_undegraded":"2024-04-15T15:31:41.397887+0000","last_fullsized":"2024-04-15T15:31:41.397887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495216+0000","last_change":"2024-04-15T15:31:38.513301+0000","last_active":"2024-04-15T15:31:39.495216+0000","last_peered":"2024-04-15T15:31:39.495216+0000","last_clean":"2024-04-15T15:31:39.495216+0000","last_became_active":"2024-04-15T15:31:38.512294+0000","last_became_peered":"2024-04-15T15:31:38.512294+0000","last_unstale":"2024-04-15T15:31:39.495216+0000","last_undegraded":"2024-04-15T15:31:39.495216+0000","last_fullsized":"2024-04-15T15:31:39.495216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:58.375388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495343+0000","last_change":"2024-04-15T15:31:33.468436+0000","last_active":"2024-04-15T15:31:39.495343+0000","last_peered":"2024-04-15T15:31:39.495343+0000","last_clean":"2024-04-15T15:31:39.495343+0000","last_became_active":"2024-04-15T15:31:33.468066+0000","last_became_peered":"2024-04-15T15:31:33.468066+0000","last_unstale":"2024-04-15T15:31:39.495343+0000","last_undegraded":"2024-04-15T15:31:39.495343+0000","last_fullsized":"2024-04-15T15:31:39.495343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397924+0000","last_change":"2024-04-15T15:31:34.478455+0000","last_active":"2024-04-15T15:31:41.397924+0000","last_peered":"2024-04-15T15:31:41.397924+0000","last_clean":"2024-04-15T15:31:41.397924+0000","last_became_active":"2024-04-15T15:31:34.477083+0000","last_became_peered":"2024-04-15T15:31:34.477083+0000","last_unstale":"2024-04-15T15:31:41.397924+0000","last_undegraded":"2024-04-15T15:31:41.397924+0000","last_fullsized":"2024-04-15T15:31:41.397924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:28.573374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495022+0000","last_change":"2024-04-15T15:31:38.513693+0000","last_active":"2024-04-15T15:31:39.495022+0000","last_peered":"2024-04-15T15:31:39.495022+0000","last_clean":"2024-04-15T15:31:39.495022+0000","last_became_active":"2024-04-15T15:31:38.508340+0000","last_became_peered":"2024-04-15T15:31:38.508340+0000","last_unstale":"2024-04-15T15:31:39.495022+0000","last_undegraded":"2024-04-15T15:31:39.495022+0000","last_fullsized":"2024-04-15T15:31:39.495022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:40:02.295646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043775+0000","last_change":"2024-04-15T15:31:34.470639+0000","last_active":"2024-04-15T15:31:41.043775+0000","last_peered":"2024-04-15T15:31:41.043775+0000","last_clean":"2024-04-15T15:31:41.043775+0000","last_became_active":"2024-04-15T15:31:34.470352+0000","last_became_peered":"2024-04-15T15:31:34.470352+0000","last_unstale":"2024-04-15T15:31:41.043775+0000","last_undegraded":"2024-04-15T15:31:41.043775+0000","last_fullsized":"2024-04-15T15:31:41.043775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495785+0000","last_change":"2024-04-15T15:31:33.468093+0000","last_active":"2024-04-15T15:31:39.495785+0000","last_peered":"2024-04-15T15:31:39.495785+0000","last_clean":"2024-04-15T15:31:39.495785+0000","last_became_active":"2024-04-15T15:31:33.464597+0000","last_became_peered":"2024-04-15T15:31:33.464597+0000","last_unstale":"2024-04-15T15:31:39.495785+0000","last_undegraded":"2024-04-15T15:31:39.495785+0000","last_fullsized":"2024-04-15T15:31:39.495785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:31.218635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495353+0000","last_change":"2024-04-15T15:31:38.508916+0000","last_active":"2024-04-15T15:31:39.495353+0000","last_peered":"2024-04-15T15:31:39.495353+0000","last_clean":"2024-04-15T15:31:39.495353+0000","last_became_active":"2024-04-15T15:31:38.507396+0000","last_became_peered":"2024-04-15T15:31:38.507396+0000","last_unstale":"2024-04-15T15:31:39.495353+0000","last_undegraded":"2024-04-15T15:31:39.495353+0000","last_fullsized":"2024-04-15T15:31:39.495353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:16.026259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494597+0000","last_change":"2024-04-15T15:31:34.478907+0000","last_active":"2024-04-15T15:31:39.494597+0000","last_peered":"2024-04-15T15:31:39.494597+0000","last_clean":"2024-04-15T15:31:39.494597+0000","last_became_active":"2024-04-15T15:31:34.478612+0000","last_became_peered":"2024-04-15T15:31:34.478612+0000","last_unstale":"2024-04-15T15:31:39.494597+0000","last_undegraded":"2024-04-15T15:31:39.494597+0000","last_fullsized":"2024-04-15T15:31:39.494597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660317+0000","last_change":"2024-04-15T15:31:33.464608+0000","last_active":"2024-04-15T15:31:41.660317+0000","last_peered":"2024-04-15T15:31:41.660317+0000","last_clean":"2024-04-15T15:31:41.660317+0000","last_became_active":"2024-04-15T15:31:33.463697+0000","last_became_peered":"2024-04-15T15:31:33.463697+0000","last_unstale":"2024-04-15T15:31:41.660317+0000","last_undegraded":"2024-04-15T15:31:41.660317+0000","last_fullsized":"2024-04-15T15:31:41.660317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495009+0000","last_change":"2024-04-15T15:31:38.512929+0000","last_active":"2024-04-15T15:31:39.495009+0000","last_peered":"2024-04-15T15:31:39.495009+0000","last_clean":"2024-04-15T15:31:39.495009+0000","last_became_active":"2024-04-15T15:31:38.512502+0000","last_became_peered":"2024-04-15T15:31:38.512502+0000","last_unstale":"2024-04-15T15:31:39.495009+0000","last_undegraded":"2024-04-15T15:31:39.495009+0000","last_fullsized":"2024-04-15T15:31:39.495009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:07.300884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494687+0000","last_change":"2024-04-15T15:31:34.475733+0000","last_active":"2024-04-15T15:31:39.494687+0000","last_peered":"2024-04-15T15:31:39.494687+0000","last_clean":"2024-04-15T15:31:39.494687+0000","last_became_active":"2024-04-15T15:31:34.475366+0000","last_became_peered":"2024-04-15T15:31:34.475366+0000","last_unstale":"2024-04-15T15:31:39.494687+0000","last_undegraded":"2024-04-15T15:31:39.494687+0000","last_fullsized":"2024-04-15T15:31:39.494687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660301+0000","last_change":"2024-04-15T15:31:33.471618+0000","last_active":"2024-04-15T15:31:41.660301+0000","last_peered":"2024-04-15T15:31:41.660301+0000","last_clean":"2024-04-15T15:31:41.660301+0000","last_became_active":"2024-04-15T15:31:33.471405+0000","last_became_peered":"2024-04-15T15:31:33.471405+0000","last_unstale":"2024-04-15T15:31:41.660301+0000","last_undegraded":"2024-04-15T15:31:41.660301+0000","last_fullsized":"2024-04-15T15:31:41.660301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661411+0000","last_change":"2024-04-15T15:31:38.525886+0000","last_active":"2024-04-15T15:31:41.661411+0000","last_peered":"2024-04-15T15:31:41.661411+0000","last_clean":"2024-04-15T15:31:41.661411+0000","last_became_active":"2024-04-15T15:31:38.525493+0000","last_became_peered":"2024-04-15T15:31:38.525493+0000","last_unstale":"2024-04-15T15:31:41.661411+0000","last_undegraded":"2024-04-15T15:31:41.661411+0000","last_fullsized":"2024-04-15T15:31:41.661411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:20.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496343+0000","last_change":"2024-04-15T15:31:34.458960+0000","last_active":"2024-04-15T15:31:39.496343+0000","last_peered":"2024-04-15T15:31:39.496343+0000","last_clean":"2024-04-15T15:31:39.496343+0000","last_became_active":"2024-04-15T15:31:34.457972+0000","last_became_peered":"2024-04-15T15:31:34.457972+0000","last_unstale":"2024-04-15T15:31:39.496343+0000","last_undegraded":"2024-04-15T15:31:39.496343+0000","last_fullsized":"2024-04-15T15:31:39.496343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:34.951963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494692+0000","last_change":"2024-04-15T15:31:33.461302+0000","last_active":"2024-04-15T15:31:39.494692+0000","last_peered":"2024-04-15T15:31:39.494692+0000","last_clean":"2024-04-15T15:31:39.494692+0000","last_became_active":"2024-04-15T15:31:33.458813+0000","last_became_peered":"2024-04-15T15:31:33.458813+0000","last_unstale":"2024-04-15T15:31:39.494692+0000","last_undegraded":"2024-04-15T15:31:39.494692+0000","last_fullsized":"2024-04-15T15:31:39.494692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495913+0000","last_change":"2024-04-15T15:31:38.514622+0000","last_active":"2024-04-15T15:31:39.495913+0000","last_peered":"2024-04-15T15:31:39.495913+0000","last_clean":"2024-04-15T15:31:39.495913+0000","last_became_active":"2024-04-15T15:31:38.513418+0000","last_became_peered":"2024-04-15T15:31:38.513418+0000","last_unstale":"2024-04-15T15:31:39.495913+0000","last_undegraded":"2024-04-15T15:31:39.495913+0000","last_fullsized":"2024-04-15T15:31:39.495913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750568+0000","last_change":"2024-04-15T15:31:34.468186+0000","last_active":"2024-04-15T15:31:41.750568+0000","last_peered":"2024-04-15T15:31:41.750568+0000","last_clean":"2024-04-15T15:31:41.750568+0000","last_became_active":"2024-04-15T15:31:34.467908+0000","last_became_peered":"2024-04-15T15:31:34.467908+0000","last_unstale":"2024-04-15T15:31:41.750568+0000","last_undegraded":"2024-04-15T15:31:41.750568+0000","last_fullsized":"2024-04-15T15:31:41.750568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044539+0000","last_change":"2024-04-15T15:31:33.467227+0000","last_active":"2024-04-15T15:31:41.044539+0000","last_peered":"2024-04-15T15:31:41.044539+0000","last_clean":"2024-04-15T15:31:41.044539+0000","last_became_active":"2024-04-15T15:31:33.466947+0000","last_became_peered":"2024-04-15T15:31:33.466947+0000","last_unstale":"2024-04-15T15:31:41.044539+0000","last_undegraded":"2024-04-15T15:31:41.044539+0000","last_fullsized":"2024-04-15T15:31:41.044539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496140+0000","last_change":"2024-04-15T15:31:38.508721+0000","last_active":"2024-04-15T15:31:39.496140+0000","last_peered":"2024-04-15T15:31:39.496140+0000","last_clean":"2024-04-15T15:31:39.496140+0000","last_became_active":"2024-04-15T15:31:38.508183+0000","last_became_peered":"2024-04-15T15:31:38.508183+0000","last_unstale":"2024-04-15T15:31:39.496140+0000","last_undegraded":"2024-04-15T15:31:39.496140+0000","last_fullsized":"2024-04-15T15:31:39.496140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495271+0000","last_change":"2024-04-15T15:31:34.479989+0000","last_active":"2024-04-15T15:31:39.495271+0000","last_peered":"2024-04-15T15:31:39.495271+0000","last_clean":"2024-04-15T15:31:39.495271+0000","last_became_active":"2024-04-15T15:31:34.479662+0000","last_became_peered":"2024-04-15T15:31:34.479662+0000","last_unstale":"2024-04-15T15:31:39.495271+0000","last_undegraded":"2024-04-15T15:31:39.495271+0000","last_fullsized":"2024-04-15T15:31:39.495271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660411+0000","last_change":"2024-04-15T15:31:33.470912+0000","last_active":"2024-04-15T15:31:41.660411+0000","last_peered":"2024-04-15T15:31:41.660411+0000","last_clean":"2024-04-15T15:31:41.660411+0000","last_became_active":"2024-04-15T15:31:33.470665+0000","last_became_peered":"2024-04-15T15:31:33.470665+0000","last_unstale":"2024-04-15T15:31:41.660411+0000","last_undegraded":"2024-04-15T15:31:41.660411+0000","last_fullsized":"2024-04-15T15:31:41.660411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494323+0000","last_change":"2024-04-15T15:31:38.530139+0000","last_active":"2024-04-15T15:31:39.494323+0000","last_peered":"2024-04-15T15:31:39.494323+0000","last_clean":"2024-04-15T15:31:39.494323+0000","last_became_active":"2024-04-15T15:31:38.529420+0000","last_became_peered":"2024-04-15T15:31:38.529420+0000","last_unstale":"2024-04-15T15:31:39.494323+0000","last_undegraded":"2024-04-15T15:31:39.494323+0000","last_fullsized":"2024-04-15T15:31:39.494323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:25:04.752470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661111+0000","last_change":"2024-04-15T15:31:34.458302+0000","last_active":"2024-04-15T15:31:41.661111+0000","last_peered":"2024-04-15T15:31:41.661111+0000","last_clean":"2024-04-15T15:31:41.661111+0000","last_became_active":"2024-04-15T15:31:34.455963+0000","last_became_peered":"2024-04-15T15:31:34.455963+0000","last_unstale":"2024-04-15T15:31:41.661111+0000","last_undegraded":"2024-04-15T15:31:41.661111+0000","last_fullsized":"2024-04-15T15:31:41.661111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496735+0000","last_change":"2024-04-15T15:31:33.465392+0000","last_active":"2024-04-15T15:31:39.496735+0000","last_peered":"2024-04-15T15:31:39.496735+0000","last_clean":"2024-04-15T15:31:39.496735+0000","last_became_active":"2024-04-15T15:31:33.462727+0000","last_became_peered":"2024-04-15T15:31:33.462727+0000","last_unstale":"2024-04-15T15:31:39.496735+0000","last_undegraded":"2024-04-15T15:31:39.496735+0000","last_fullsized":"2024-04-15T15:31:39.496735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:31:42.645531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750004+0000","last_change":"2024-04-15T15:31:38.529068+0000","last_active":"2024-04-15T15:31:41.750004+0000","last_peered":"2024-04-15T15:31:41.750004+0000","last_clean":"2024-04-15T15:31:41.750004+0000","last_became_active":"2024-04-15T15:31:38.521736+0000","last_became_peered":"2024-04-15T15:31:38.521736+0000","last_unstale":"2024-04-15T15:31:41.750004+0000","last_undegraded":"2024-04-15T15:31:41.750004+0000","last_fullsized":"2024-04-15T15:31:41.750004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398049+0000","last_change":"2024-04-15T15:31:34.483798+0000","last_active":"2024-04-15T15:31:41.398049+0000","last_peered":"2024-04-15T15:31:41.398049+0000","last_clean":"2024-04-15T15:31:41.398049+0000","last_became_active":"2024-04-15T15:31:34.483476+0000","last_became_peered":"2024-04-15T15:31:34.483476+0000","last_unstale":"2024-04-15T15:31:41.398049+0000","last_undegraded":"2024-04-15T15:31:41.398049+0000","last_fullsized":"2024-04-15T15:31:41.398049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:43.459915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661205+0000","last_change":"2024-04-15T15:31:33.455617+0000","last_active":"2024-04-15T15:31:41.661205+0000","last_peered":"2024-04-15T15:31:41.661205+0000","last_clean":"2024-04-15T15:31:41.661205+0000","last_became_active":"2024-04-15T15:31:33.453330+0000","last_became_peered":"2024-04-15T15:31:33.453330+0000","last_unstale":"2024-04-15T15:31:41.661205+0000","last_undegraded":"2024-04-15T15:31:41.661205+0000","last_fullsized":"2024-04-15T15:31:41.661205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660834+0000","last_change":"2024-04-15T15:31:38.523416+0000","last_active":"2024-04-15T15:31:41.660834+0000","last_peered":"2024-04-15T15:31:41.660834+0000","last_clean":"2024-04-15T15:31:41.660834+0000","last_became_active":"2024-04-15T15:31:38.522902+0000","last_became_peered":"2024-04-15T15:31:38.522902+0000","last_unstale":"2024-04-15T15:31:41.660834+0000","last_undegraded":"2024-04-15T15:31:41.660834+0000","last_fullsized":"2024-04-15T15:31:41.660834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495419+0000","last_change":"2024-04-15T15:31:34.477054+0000","last_active":"2024-04-15T15:31:39.495419+0000","last_peered":"2024-04-15T15:31:39.495419+0000","last_clean":"2024-04-15T15:31:39.495419+0000","last_became_active":"2024-04-15T15:31:34.476543+0000","last_became_peered":"2024-04-15T15:31:34.476543+0000","last_unstale":"2024-04-15T15:31:39.495419+0000","last_undegraded":"2024-04-15T15:31:39.495419+0000","last_fullsized":"2024-04-15T15:31:39.495419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:31.194810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397846+0000","last_change":"2024-04-15T15:31:33.463222+0000","last_active":"2024-04-15T15:31:41.397846+0000","last_peered":"2024-04-15T15:31:41.397846+0000","last_clean":"2024-04-15T15:31:41.397846+0000","last_became_active":"2024-04-15T15:31:33.462885+0000","last_became_peered":"2024-04-15T15:31:33.462885+0000","last_unstale":"2024-04-15T15:31:41.397846+0000","last_undegraded":"2024-04-15T15:31:41.397846+0000","last_fullsized":"2024-04-15T15:31:41.397846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661135+0000","last_change":"2024-04-15T15:31:38.530546+0000","last_active":"2024-04-15T15:31:41.661135+0000","last_peered":"2024-04-15T15:31:41.661135+0000","last_clean":"2024-04-15T15:31:41.661135+0000","last_became_active":"2024-04-15T15:31:38.523847+0000","last_became_peered":"2024-04-15T15:31:38.523847+0000","last_unstale":"2024-04-15T15:31:41.661135+0000","last_undegraded":"2024-04-15T15:31:41.661135+0000","last_fullsized":"2024-04-15T15:31:41.661135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660785+0000","last_change":"2024-04-15T15:31:34.466367+0000","last_active":"2024-04-15T15:31:41.660785+0000","last_peered":"2024-04-15T15:31:41.660785+0000","last_clean":"2024-04-15T15:31:41.660785+0000","last_became_active":"2024-04-15T15:31:34.465456+0000","last_became_peered":"2024-04-15T15:31:34.465456+0000","last_unstale":"2024-04-15T15:31:41.660785+0000","last_undegraded":"2024-04-15T15:31:41.660785+0000","last_fullsized":"2024-04-15T15:31:41.660785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930895+0000","last_change":"2024-04-15T15:31:33.459428+0000","last_active":"2024-04-15T15:31:39.930895+0000","last_peered":"2024-04-15T15:31:39.930895+0000","last_clean":"2024-04-15T15:31:39.930895+0000","last_became_active":"2024-04-15T15:31:33.459061+0000","last_became_peered":"2024-04-15T15:31:33.459061+0000","last_unstale":"2024-04-15T15:31:39.930895+0000","last_undegraded":"2024-04-15T15:31:39.930895+0000","last_fullsized":"2024-04-15T15:31:39.930895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661442+0000","last_change":"2024-04-15T15:31:38.526730+0000","last_active":"2024-04-15T15:31:41.661442+0000","last_peered":"2024-04-15T15:31:41.661442+0000","last_clean":"2024-04-15T15:31:41.661442+0000","last_became_active":"2024-04-15T15:31:38.526377+0000","last_became_peered":"2024-04-15T15:31:38.526377+0000","last_unstale":"2024-04-15T15:31:41.661442+0000","last_undegraded":"2024-04-15T15:31:41.661442+0000","last_fullsized":"2024-04-15T15:31:41.661442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:32.616780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749771+0000","last_change":"2024-04-15T15:31:34.467685+0000","last_active":"2024-04-15T15:31:41.749771+0000","last_peered":"2024-04-15T15:31:41.749771+0000","last_clean":"2024-04-15T15:31:41.749771+0000","last_became_active":"2024-04-15T15:31:34.467225+0000","last_became_peered":"2024-04-15T15:31:34.467225+0000","last_unstale":"2024-04-15T15:31:41.749771+0000","last_undegraded":"2024-04-15T15:31:41.749771+0000","last_fullsized":"2024-04-15T15:31:41.749771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:59:25.080403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494797+0000","last_change":"2024-04-15T15:31:33.468019+0000","last_active":"2024-04-15T15:31:39.494797+0000","last_peered":"2024-04-15T15:31:39.494797+0000","last_clean":"2024-04-15T15:31:39.494797+0000","last_became_active":"2024-04-15T15:31:33.465568+0000","last_became_peered":"2024-04-15T15:31:33.465568+0000","last_unstale":"2024-04-15T15:31:39.494797+0000","last_undegraded":"2024-04-15T15:31:39.494797+0000","last_fullsized":"2024-04-15T15:31:39.494797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750596+0000","last_change":"2024-04-15T15:31:38.510659+0000","last_active":"2024-04-15T15:31:41.750596+0000","last_peered":"2024-04-15T15:31:41.750596+0000","last_clean":"2024-04-15T15:31:41.750596+0000","last_became_active":"2024-04-15T15:31:38.510130+0000","last_became_peered":"2024-04-15T15:31:38.510130+0000","last_unstale":"2024-04-15T15:31:41.750596+0000","last_undegraded":"2024-04-15T15:31:41.750596+0000","last_fullsized":"2024-04-15T15:31:41.750596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:11:14.235709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494622+0000","last_change":"2024-04-15T15:31:34.475942+0000","last_active":"2024-04-15T15:31:39.494622+0000","last_peered":"2024-04-15T15:31:39.494622+0000","last_clean":"2024-04-15T15:31:39.494622+0000","last_became_active":"2024-04-15T15:31:34.475645+0000","last_became_peered":"2024-04-15T15:31:34.475645+0000","last_unstale":"2024-04-15T15:31:39.494622+0000","last_undegraded":"2024-04-15T15:31:39.494622+0000","last_fullsized":"2024-04-15T15:31:39.494622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397687+0000","last_change":"2024-04-15T15:31:33.460934+0000","last_active":"2024-04-15T15:31:41.397687+0000","last_peered":"2024-04-15T15:31:41.397687+0000","last_clean":"2024-04-15T15:31:41.397687+0000","last_became_active":"2024-04-15T15:31:33.460488+0000","last_became_peered":"2024-04-15T15:31:33.460488+0000","last_unstale":"2024-04-15T15:31:41.397687+0000","last_undegraded":"2024-04-15T15:31:41.397687+0000","last_fullsized":"2024-04-15T15:31:41.397687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494896+0000","last_change":"2024-04-15T15:31:23.443687+0000","last_active":"2024-04-15T15:31:39.494896+0000","last_peered":"2024-04-15T15:31:39.494896+0000","last_clean":"2024-04-15T15:31:39.494896+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:31:39.494896+0000","last_undegraded":"2024-04-15T15:31:39.494896+0000","last_fullsized":"2024-04-15T15:31:39.494896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_clean_scrub_stamp":"2024-04-15T15:31:22.092427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:28:43.096549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044263+0000","last_change":"2024-04-15T15:31:38.509517+0000","last_active":"2024-04-15T15:31:41.044263+0000","last_peered":"2024-04-15T15:31:41.044263+0000","last_clean":"2024-04-15T15:31:41.044263+0000","last_became_active":"2024-04-15T15:31:38.509241+0000","last_became_peered":"2024-04-15T15:31:38.509241+0000","last_unstale":"2024-04-15T15:31:41.044263+0000","last_undegraded":"2024-04-15T15:31:41.044263+0000","last_fullsized":"2024-04-15T15:31:41.044263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496472+0000","last_change":"2024-04-15T15:31:34.482434+0000","last_active":"2024-04-15T15:31:39.496472+0000","last_peered":"2024-04-15T15:31:39.496472+0000","last_clean":"2024-04-15T15:31:39.496472+0000","last_became_active":"2024-04-15T15:31:34.481970+0000","last_became_peered":"2024-04-15T15:31:34.481970+0000","last_unstale":"2024-04-15T15:31:39.496472+0000","last_undegraded":"2024-04-15T15:31:39.496472+0000","last_fullsized":"2024-04-15T15:31:39.496472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:55.879743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931168+0000","last_change":"2024-04-15T15:31:33.463661+0000","last_active":"2024-04-15T15:31:39.931168+0000","last_peered":"2024-04-15T15:31:39.931168+0000","last_clean":"2024-04-15T15:31:39.931168+0000","last_became_active":"2024-04-15T15:31:33.463363+0000","last_became_peered":"2024-04-15T15:31:33.463363+0000","last_unstale":"2024-04-15T15:31:39.931168+0000","last_undegraded":"2024-04-15T15:31:39.931168+0000","last_fullsized":"2024-04-15T15:31:39.931168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044102+0000","last_change":"2024-04-15T15:31:38.508644+0000","last_active":"2024-04-15T15:31:41.044102+0000","last_peered":"2024-04-15T15:31:41.044102+0000","last_clean":"2024-04-15T15:31:41.044102+0000","last_became_active":"2024-04-15T15:31:38.508203+0000","last_became_peered":"2024-04-15T15:31:38.508203+0000","last_unstale":"2024-04-15T15:31:41.044102+0000","last_undegraded":"2024-04-15T15:31:41.044102+0000","last_fullsized":"2024-04-15T15:31:41.044102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397921+0000","last_change":"2024-04-15T15:31:34.484117+0000","last_active":"2024-04-15T15:31:41.397921+0000","last_peered":"2024-04-15T15:31:41.397921+0000","last_clean":"2024-04-15T15:31:41.397921+0000","last_became_active":"2024-04-15T15:31:34.483764+0000","last_became_peered":"2024-04-15T15:31:34.483764+0000","last_unstale":"2024-04-15T15:31:41.397921+0000","last_undegraded":"2024-04-15T15:31:41.397921+0000","last_fullsized":"2024-04-15T15:31:41.397921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:55.879743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660358+0000","last_change":"2024-04-15T15:31:33.462350+0000","last_active":"2024-04-15T15:31:41.660358+0000","last_peered":"2024-04-15T15:31:41.660358+0000","last_clean":"2024-04-15T15:31:41.660358+0000","last_became_active":"2024-04-15T15:31:33.462003+0000","last_became_peered":"2024-04-15T15:31:33.462003+0000","last_unstale":"2024-04-15T15:31:41.660358+0000","last_undegraded":"2024-04-15T15:31:41.660358+0000","last_fullsized":"2024-04-15T15:31:41.660358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750132+0000","last_change":"2024-04-15T15:31:38.518872+0000","last_active":"2024-04-15T15:31:41.750132+0000","last_peered":"2024-04-15T15:31:41.750132+0000","last_clean":"2024-04-15T15:31:41.750132+0000","last_became_active":"2024-04-15T15:31:38.517803+0000","last_became_peered":"2024-04-15T15:31:38.517803+0000","last_unstale":"2024-04-15T15:31:41.750132+0000","last_undegraded":"2024-04-15T15:31:41.750132+0000","last_fullsized":"2024-04-15T15:31:41.750132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:20.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.497118+0000","last_change":"2024-04-15T15:31:34.455266+0000","last_active":"2024-04-15T15:31:39.497118+0000","last_peered":"2024-04-15T15:31:39.497118+0000","last_clean":"2024-04-15T15:31:39.497118+0000","last_became_active":"2024-04-15T15:31:34.454909+0000","last_became_peered":"2024-04-15T15:31:34.454909+0000","last_unstale":"2024-04-15T15:31:39.497118+0000","last_undegraded":"2024-04-15T15:31:39.497118+0000","last_fullsized":"2024-04-15T15:31:39.497118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:11:10.192304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931330+0000","last_change":"2024-04-15T15:31:33.459513+0000","last_active":"2024-04-15T15:31:39.931330+0000","last_peered":"2024-04-15T15:31:39.931330+0000","last_clean":"2024-04-15T15:31:39.931330+0000","last_became_active":"2024-04-15T15:31:33.458815+0000","last_became_peered":"2024-04-15T15:31:33.458815+0000","last_unstale":"2024-04-15T15:31:39.931330+0000","last_undegraded":"2024-04-15T15:31:39.931330+0000","last_fullsized":"2024-04-15T15:31:39.931330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397253+0000","last_change":"2024-04-15T15:31:38.502775+0000","last_active":"2024-04-15T15:31:41.397253+0000","last_peered":"2024-04-15T15:31:41.397253+0000","last_clean":"2024-04-15T15:31:41.397253+0000","last_became_active":"2024-04-15T15:31:38.502352+0000","last_became_peered":"2024-04-15T15:31:38.502352+0000","last_unstale":"2024-04-15T15:31:41.397253+0000","last_undegraded":"2024-04-15T15:31:41.397253+0000","last_fullsized":"2024-04-15T15:31:41.397253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:19.820153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496741+0000","last_change":"2024-04-15T15:31:34.460915+0000","last_active":"2024-04-15T15:31:39.496741+0000","last_peered":"2024-04-15T15:31:39.496741+0000","last_clean":"2024-04-15T15:31:39.496741+0000","last_became_active":"2024-04-15T15:31:34.460597+0000","last_became_peered":"2024-04-15T15:31:34.460597+0000","last_unstale":"2024-04-15T15:31:39.496741+0000","last_undegraded":"2024-04-15T15:31:39.496741+0000","last_fullsized":"2024-04-15T15:31:39.496741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:47.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495992+0000","last_change":"2024-04-15T15:31:33.454373+0000","last_active":"2024-04-15T15:31:39.495992+0000","last_peered":"2024-04-15T15:31:39.495992+0000","last_clean":"2024-04-15T15:31:39.495992+0000","last_became_active":"2024-04-15T15:31:33.454125+0000","last_became_peered":"2024-04-15T15:31:33.454125+0000","last_unstale":"2024-04-15T15:31:39.495992+0000","last_undegraded":"2024-04-15T15:31:39.495992+0000","last_fullsized":"2024-04-15T15:31:39.495992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:37:53.773475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496068+0000","last_change":"2024-04-15T15:31:38.511943+0000","last_active":"2024-04-15T15:31:39.496068+0000","last_peered":"2024-04-15T15:31:39.496068+0000","last_clean":"2024-04-15T15:31:39.496068+0000","last_became_active":"2024-04-15T15:31:38.511494+0000","last_became_peered":"2024-04-15T15:31:38.511494+0000","last_unstale":"2024-04-15T15:31:39.496068+0000","last_undegraded":"2024-04-15T15:31:39.496068+0000","last_fullsized":"2024-04-15T15:31:39.496068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495491+0000","last_change":"2024-04-15T15:31:34.446971+0000","last_active":"2024-04-15T15:31:39.495491+0000","last_peered":"2024-04-15T15:31:39.495491+0000","last_clean":"2024-04-15T15:31:39.495491+0000","last_became_active":"2024-04-15T15:31:34.446687+0000","last_became_peered":"2024-04-15T15:31:34.446687+0000","last_unstale":"2024-04-15T15:31:39.495491+0000","last_undegraded":"2024-04-15T15:31:39.495491+0000","last_fullsized":"2024-04-15T15:31:39.495491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930804+0000","last_change":"2024-04-15T15:31:33.450642+0000","last_active":"2024-04-15T15:31:39.930804+0000","last_peered":"2024-04-15T15:31:39.930804+0000","last_clean":"2024-04-15T15:31:39.930804+0000","last_became_active":"2024-04-15T15:31:33.450034+0000","last_became_peered":"2024-04-15T15:31:33.450034+0000","last_unstale":"2024-04-15T15:31:39.930804+0000","last_undegraded":"2024-04-15T15:31:39.930804+0000","last_fullsized":"2024-04-15T15:31:39.930804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:34:26.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750433+0000","last_change":"2024-04-15T15:31:38.516804+0000","last_active":"2024-04-15T15:31:41.750433+0000","last_peered":"2024-04-15T15:31:41.750433+0000","last_clean":"2024-04-15T15:31:41.750433+0000","last_became_active":"2024-04-15T15:31:38.516244+0000","last_became_peered":"2024-04-15T15:31:38.516244+0000","last_unstale":"2024-04-15T15:31:41.750433+0000","last_undegraded":"2024-04-15T15:31:41.750433+0000","last_fullsized":"2024-04-15T15:31:41.750433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:47.503321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043900+0000","last_change":"2024-04-15T15:31:34.473243+0000","last_active":"2024-04-15T15:31:41.043900+0000","last_peered":"2024-04-15T15:31:41.043900+0000","last_clean":"2024-04-15T15:31:41.043900+0000","last_became_active":"2024-04-15T15:31:34.472907+0000","last_became_peered":"2024-04-15T15:31:34.472907+0000","last_unstale":"2024-04-15T15:31:41.043900+0000","last_undegraded":"2024-04-15T15:31:41.043900+0000","last_fullsized":"2024-04-15T15:31:41.043900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043921+0000","last_change":"2024-04-15T15:31:33.455306+0000","last_active":"2024-04-15T15:31:41.043921+0000","last_peered":"2024-04-15T15:31:41.043921+0000","last_clean":"2024-04-15T15:31:41.043921+0000","last_became_active":"2024-04-15T15:31:33.454939+0000","last_became_peered":"2024-04-15T15:31:33.454939+0000","last_unstale":"2024-04-15T15:31:41.043921+0000","last_undegraded":"2024-04-15T15:31:41.043921+0000","last_fullsized":"2024-04-15T15:31:41.043921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495222+0000","last_change":"2024-04-15T15:31:38.530485+0000","last_active":"2024-04-15T15:31:39.495222+0000","last_peered":"2024-04-15T15:31:39.495222+0000","last_clean":"2024-04-15T15:31:39.495222+0000","last_became_active":"2024-04-15T15:31:38.529528+0000","last_became_peered":"2024-04-15T15:31:38.529528+0000","last_unstale":"2024-04-15T15:31:39.495222+0000","last_undegraded":"2024-04-15T15:31:39.495222+0000","last_fullsized":"2024-04-15T15:31:39.495222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:34:18.616473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495712+0000","last_change":"2024-04-15T15:31:34.477711+0000","last_active":"2024-04-15T15:31:39.495712+0000","last_peered":"2024-04-15T15:31:39.495712+0000","last_clean":"2024-04-15T15:31:39.495712+0000","last_became_active":"2024-04-15T15:31:34.477444+0000","last_became_peered":"2024-04-15T15:31:34.477444+0000","last_unstale":"2024-04-15T15:31:39.495712+0000","last_undegraded":"2024-04-15T15:31:39.495712+0000","last_fullsized":"2024-04-15T15:31:39.495712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397755+0000","last_change":"2024-04-15T15:31:33.467098+0000","last_active":"2024-04-15T15:31:41.397755+0000","last_peered":"2024-04-15T15:31:41.397755+0000","last_clean":"2024-04-15T15:31:41.397755+0000","last_became_active":"2024-04-15T15:31:33.466808+0000","last_became_peered":"2024-04-15T15:31:33.466808+0000","last_unstale":"2024-04-15T15:31:41.397755+0000","last_undegraded":"2024-04-15T15:31:41.397755+0000","last_fullsized":"2024-04-15T15:31:41.397755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495267+0000","last_change":"2024-04-15T15:31:38.523143+0000","last_active":"2024-04-15T15:31:39.495267+0000","last_peered":"2024-04-15T15:31:39.495267+0000","last_clean":"2024-04-15T15:31:39.495267+0000","last_became_active":"2024-04-15T15:31:38.522583+0000","last_became_peered":"2024-04-15T15:31:38.522583+0000","last_unstale":"2024-04-15T15:31:39.495267+0000","last_undegraded":"2024-04-15T15:31:39.495267+0000","last_fullsized":"2024-04-15T15:31:39.495267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:55:17.165005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749967+0000","last_change":"2024-04-15T15:31:34.457507+0000","last_active":"2024-04-15T15:31:41.749967+0000","last_peered":"2024-04-15T15:31:41.749967+0000","last_clean":"2024-04-15T15:31:41.749967+0000","last_became_active":"2024-04-15T15:31:34.457210+0000","last_became_peered":"2024-04-15T15:31:34.457210+0000","last_unstale":"2024-04-15T15:31:41.749967+0000","last_undegraded":"2024-04-15T15:31:41.749967+0000","last_fullsized":"2024-04-15T15:31:41.749967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749354+0000","last_change":"2024-04-15T15:31:33.457018+0000","last_active":"2024-04-15T15:31:41.749354+0000","last_peered":"2024-04-15T15:31:41.749354+0000","last_clean":"2024-04-15T15:31:41.749354+0000","last_became_active":"2024-04-15T15:31:33.456421+0000","last_became_peered":"2024-04-15T15:31:33.456421+0000","last_unstale":"2024-04-15T15:31:41.749354+0000","last_undegraded":"2024-04-15T15:31:41.749354+0000","last_fullsized":"2024-04-15T15:31:41.749354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:05.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397989+0000","last_change":"2024-04-15T15:31:38.508761+0000","last_active":"2024-04-15T15:31:41.397989+0000","last_peered":"2024-04-15T15:31:41.397989+0000","last_clean":"2024-04-15T15:31:41.397989+0000","last_became_active":"2024-04-15T15:31:38.508347+0000","last_became_peered":"2024-04-15T15:31:38.508347+0000","last_unstale":"2024-04-15T15:31:41.397989+0000","last_undegraded":"2024-04-15T15:31:41.397989+0000","last_fullsized":"2024-04-15T15:31:41.397989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:55:06.941769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495673+0000","last_change":"2024-04-15T15:31:34.456767+0000","last_active":"2024-04-15T15:31:39.495673+0000","last_peered":"2024-04-15T15:31:39.495673+0000","last_clean":"2024-04-15T15:31:39.495673+0000","last_became_active":"2024-04-15T15:31:34.456363+0000","last_became_peered":"2024-04-15T15:31:34.456363+0000","last_unstale":"2024-04-15T15:31:39.495673+0000","last_undegraded":"2024-04-15T15:31:39.495673+0000","last_fullsized":"2024-04-15T15:31:39.495673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:44.684112+0000","last_change":"2024-04-15T15:31:33.461422+0000","last_active":"2024-04-15T15:31:44.684112+0000","last_peered":"2024-04-15T15:31:44.684112+0000","last_clean":"2024-04-15T15:31:44.684112+0000","last_became_active":"2024-04-15T15:31:33.459911+0000","last_became_peered":"2024-04-15T15:31:33.459911+0000","last_unstale":"2024-04-15T15:31:44.684112+0000","last_undegraded":"2024-04-15T15:31:44.684112+0000","last_fullsized":"2024-04-15T15:31:44.684112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660990+0000","last_change":"2024-04-15T15:31:38.510570+0000","last_active":"2024-04-15T15:31:41.660990+0000","last_peered":"2024-04-15T15:31:41.660990+0000","last_clean":"2024-04-15T15:31:41.660990+0000","last_became_active":"2024-04-15T15:31:38.510025+0000","last_became_peered":"2024-04-15T15:31:38.510025+0000","last_unstale":"2024-04-15T15:31:41.660990+0000","last_undegraded":"2024-04-15T15:31:41.660990+0000","last_fullsized":"2024-04-15T15:31:41.660990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495834+0000","last_change":"2024-04-15T15:31:34.446494+0000","last_active":"2024-04-15T15:31:39.495834+0000","last_peered":"2024-04-15T15:31:39.495834+0000","last_clean":"2024-04-15T15:31:39.495834+0000","last_became_active":"2024-04-15T15:31:34.446162+0000","last_became_peered":"2024-04-15T15:31:34.446162+0000","last_unstale":"2024-04-15T15:31:39.495834+0000","last_undegraded":"2024-04-15T15:31:39.495834+0000","last_fullsized":"2024-04-15T15:31:39.495834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:31:43.652130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660356+0000","last_change":"2024-04-15T15:31:33.464177+0000","last_active":"2024-04-15T15:31:41.660356+0000","last_peered":"2024-04-15T15:31:41.660356+0000","last_clean":"2024-04-15T15:31:41.660356+0000","last_became_active":"2024-04-15T15:31:33.463834+0000","last_became_peered":"2024-04-15T15:31:33.463834+0000","last_unstale":"2024-04-15T15:31:41.660356+0000","last_undegraded":"2024-04-15T15:31:41.660356+0000","last_fullsized":"2024-04-15T15:31:41.660356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494954+0000","last_change":"2024-04-15T15:31:38.513560+0000","last_active":"2024-04-15T15:31:39.494954+0000","last_peered":"2024-04-15T15:31:39.494954+0000","last_clean":"2024-04-15T15:31:39.494954+0000","last_became_active":"2024-04-15T15:31:38.512922+0000","last_became_peered":"2024-04-15T15:31:38.512922+0000","last_unstale":"2024-04-15T15:31:39.494954+0000","last_undegraded":"2024-04-15T15:31:39.494954+0000","last_fullsized":"2024-04-15T15:31:39.494954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:53.510244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750535+0000","last_change":"2024-04-15T15:31:34.486802+0000","last_active":"2024-04-15T15:31:41.750535+0000","last_peered":"2024-04-15T15:31:41.750535+0000","last_clean":"2024-04-15T15:31:41.750535+0000","last_became_active":"2024-04-15T15:31:34.481349+0000","last_became_peered":"2024-04-15T15:31:34.481349+0000","last_unstale":"2024-04-15T15:31:41.750535+0000","last_undegraded":"2024-04-15T15:31:41.750535+0000","last_fullsized":"2024-04-15T15:31:41.750535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398116+0000","last_change":"2024-04-15T15:31:33.470322+0000","last_active":"2024-04-15T15:31:41.398116+0000","last_peered":"2024-04-15T15:31:41.398116+0000","last_clean":"2024-04-15T15:31:41.398116+0000","last_became_active":"2024-04-15T15:31:33.470042+0000","last_became_peered":"2024-04-15T15:31:33.470042+0000","last_unstale":"2024-04-15T15:31:41.398116+0000","last_undegraded":"2024-04-15T15:31:41.398116+0000","last_fullsized":"2024-04-15T15:31:41.398116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494537+0000","last_change":"2024-04-15T15:31:38.515979+0000","last_active":"2024-04-15T15:31:39.494537+0000","last_peered":"2024-04-15T15:31:39.494537+0000","last_clean":"2024-04-15T15:31:39.494537+0000","last_became_active":"2024-04-15T15:31:38.510943+0000","last_became_peered":"2024-04-15T15:31:38.510943+0000","last_unstale":"2024-04-15T15:31:39.494537+0000","last_undegraded":"2024-04-15T15:31:39.494537+0000","last_fullsized":"2024-04-15T15:31:39.494537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:02:06.275540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398007+0000","last_change":"2024-04-15T15:31:34.468743+0000","last_active":"2024-04-15T15:31:41.398007+0000","last_peered":"2024-04-15T15:31:41.398007+0000","last_clean":"2024-04-15T15:31:41.398007+0000","last_became_active":"2024-04-15T15:31:34.468018+0000","last_became_peered":"2024-04-15T15:31:34.468018+0000","last_unstale":"2024-04-15T15:31:41.398007+0000","last_undegraded":"2024-04-15T15:31:41.398007+0000","last_fullsized":"2024-04-15T15:31:41.398007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:47.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044426+0000","last_change":"2024-04-15T15:31:33.473593+0000","last_active":"2024-04-15T15:31:41.044426+0000","last_peered":"2024-04-15T15:31:41.044426+0000","last_clean":"2024-04-15T15:31:41.044426+0000","last_became_active":"2024-04-15T15:31:33.473287+0000","last_became_peered":"2024-04-15T15:31:33.473287+0000","last_unstale":"2024-04-15T15:31:41.044426+0000","last_undegraded":"2024-04-15T15:31:41.044426+0000","last_fullsized":"2024-04-15T15:31:41.044426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494451+0000","last_change":"2024-04-15T15:31:38.507657+0000","last_active":"2024-04-15T15:31:39.494451+0000","last_peered":"2024-04-15T15:31:39.494451+0000","last_clean":"2024-04-15T15:31:39.494451+0000","last_became_active":"2024-04-15T15:31:38.507217+0000","last_became_peered":"2024-04-15T15:31:38.507217+0000","last_unstale":"2024-04-15T15:31:39.494451+0000","last_undegraded":"2024-04-15T15:31:39.494451+0000","last_fullsized":"2024-04-15T15:31:39.494451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:55:06.941769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750410+0000","last_change":"2024-04-15T15:31:38.521076+0000","last_active":"2024-04-15T15:31:41.750410+0000","last_peered":"2024-04-15T15:31:41.750410+0000","last_clean":"2024-04-15T15:31:41.750410+0000","last_became_active":"2024-04-15T15:31:38.518118+0000","last_became_peered":"2024-04-15T15:31:38.518118+0000","last_unstale":"2024-04-15T15:31:41.750410+0000","last_undegraded":"2024-04-15T15:31:41.750410+0000","last_fullsized":"2024-04-15T15:31:41.750410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:32.616780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660696+0000","last_change":"2024-04-15T15:31:34.460784+0000","last_active":"2024-04-15T15:31:41.660696+0000","last_peered":"2024-04-15T15:31:41.660696+0000","last_clean":"2024-04-15T15:31:41.660696+0000","last_became_active":"2024-04-15T15:31:34.460525+0000","last_became_peered":"2024-04-15T15:31:34.460525+0000","last_unstale":"2024-04-15T15:31:41.660696+0000","last_undegraded":"2024-04-15T15:31:41.660696+0000","last_fullsized":"2024-04-15T15:31:41.660696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397400+0000","last_change":"2024-04-15T15:31:33.462485+0000","last_active":"2024-04-15T15:31:41.397400+0000","last_peered":"2024-04-15T15:31:41.397400+0000","last_clean":"2024-04-15T15:31:41.397400+0000","last_became_active":"2024-04-15T15:31:33.461597+0000","last_became_peered":"2024-04-15T15:31:33.461597+0000","last_unstale":"2024-04-15T15:31:41.397400+0000","last_undegraded":"2024-04-15T15:31:41.397400+0000","last_fullsized":"2024-04-15T15:31:41.397400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044372+0000","last_change":"2024-04-15T15:31:38.513345+0000","last_active":"2024-04-15T15:31:41.044372+0000","last_peered":"2024-04-15T15:31:41.044372+0000","last_clean":"2024-04-15T15:31:41.044372+0000","last_became_active":"2024-04-15T15:31:38.512662+0000","last_became_peered":"2024-04-15T15:31:38.512662+0000","last_unstale":"2024-04-15T15:31:41.044372+0000","last_undegraded":"2024-04-15T15:31:41.044372+0000","last_fullsized":"2024-04-15T15:31:41.044372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494621+0000","last_change":"2024-04-15T15:31:34.483839+0000","last_active":"2024-04-15T15:31:39.494621+0000","last_peered":"2024-04-15T15:31:39.494621+0000","last_clean":"2024-04-15T15:31:39.494621+0000","last_became_active":"2024-04-15T15:31:34.483548+0000","last_became_peered":"2024-04-15T15:31:34.483548+0000","last_unstale":"2024-04-15T15:31:39.494621+0000","last_undegraded":"2024-04-15T15:31:39.494621+0000","last_fullsized":"2024-04-15T15:31:39.494621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494604+0000","last_change":"2024-04-15T15:31:33.466699+0000","last_active":"2024-04-15T15:31:39.494604+0000","last_peered":"2024-04-15T15:31:39.494604+0000","last_clean":"2024-04-15T15:31:39.494604+0000","last_became_active":"2024-04-15T15:31:33.466439+0000","last_became_peered":"2024-04-15T15:31:33.466439+0000","last_unstale":"2024-04-15T15:31:39.494604+0000","last_undegraded":"2024-04-15T15:31:39.494604+0000","last_fullsized":"2024-04-15T15:31:39.494604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044029+0000","last_change":"2024-04-15T15:31:33.464633+0000","last_active":"2024-04-15T15:31:41.044029+0000","last_peered":"2024-04-15T15:31:41.044029+0000","last_clean":"2024-04-15T15:31:41.044029+0000","last_became_active":"2024-04-15T15:31:33.463248+0000","last_became_peered":"2024-04-15T15:31:33.463248+0000","last_unstale":"2024-04-15T15:31:41.044029+0000","last_undegraded":"2024-04-15T15:31:41.044029+0000","last_fullsized":"2024-04-15T15:31:41.044029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750204+0000","last_change":"2024-04-15T15:31:34.483410+0000","last_active":"2024-04-15T15:31:41.750204+0000","last_peered":"2024-04-15T15:31:41.750204+0000","last_clean":"2024-04-15T15:31:41.750204+0000","last_became_active":"2024-04-15T15:31:34.482918+0000","last_became_peered":"2024-04-15T15:31:34.482918+0000","last_unstale":"2024-04-15T15:31:41.750204+0000","last_undegraded":"2024-04-15T15:31:41.750204+0000","last_fullsized":"2024-04-15T15:31:41.750204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931146+0000","last_change":"2024-04-15T15:31:38.511098+0000","last_active":"2024-04-15T15:31:39.931146+0000","last_peered":"2024-04-15T15:31:39.931146+0000","last_clean":"2024-04-15T15:31:39.931146+0000","last_became_active":"2024-04-15T15:31:38.510675+0000","last_became_peered":"2024-04-15T15:31:38.510675+0000","last_unstale":"2024-04-15T15:31:39.931146+0000","last_undegraded":"2024-04-15T15:31:39.931146+0000","last_fullsized":"2024-04-15T15:31:39.931146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:30:57.364887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494713+0000","last_change":"2024-04-15T15:31:33.460701+0000","last_active":"2024-04-15T15:31:39.494713+0000","last_peered":"2024-04-15T15:31:39.494713+0000","last_clean":"2024-04-15T15:31:39.494713+0000","last_became_active":"2024-04-15T15:31:33.460470+0000","last_became_peered":"2024-04-15T15:31:33.460470+0000","last_unstale":"2024-04-15T15:31:39.494713+0000","last_undegraded":"2024-04-15T15:31:39.494713+0000","last_fullsized":"2024-04-15T15:31:39.494713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:34:26.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495245+0000","last_change":"2024-04-15T15:31:34.448451+0000","last_active":"2024-04-15T15:31:39.495245+0000","last_peered":"2024-04-15T15:31:39.495245+0000","last_clean":"2024-04-15T15:31:39.495245+0000","last_became_active":"2024-04-15T15:31:34.448097+0000","last_became_peered":"2024-04-15T15:31:34.448097+0000","last_unstale":"2024-04-15T15:31:39.495245+0000","last_undegraded":"2024-04-15T15:31:39.495245+0000","last_fullsized":"2024-04-15T15:31:39.495245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:33.531988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495355+0000","last_change":"2024-04-15T15:31:38.531110+0000","last_active":"2024-04-15T15:31:39.495355+0000","last_peered":"2024-04-15T15:31:39.495355+0000","last_clean":"2024-04-15T15:31:39.495355+0000","last_became_active":"2024-04-15T15:31:38.530696+0000","last_became_peered":"2024-04-15T15:31:38.530696+0000","last_unstale":"2024-04-15T15:31:39.495355+0000","last_undegraded":"2024-04-15T15:31:39.495355+0000","last_fullsized":"2024-04-15T15:31:39.495355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:26:32.017433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043703+0000","last_change":"2024-04-15T15:31:34.473155+0000","last_active":"2024-04-15T15:31:41.043703+0000","last_peered":"2024-04-15T15:31:41.043703+0000","last_clean":"2024-04-15T15:31:41.043703+0000","last_became_active":"2024-04-15T15:31:34.472849+0000","last_became_peered":"2024-04-15T15:31:34.472849+0000","last_unstale":"2024-04-15T15:31:41.043703+0000","last_undegraded":"2024-04-15T15:31:41.043703+0000","last_fullsized":"2024-04-15T15:31:41.043703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930891+0000","last_change":"2024-04-15T15:31:34.477349+0000","last_active":"2024-04-15T15:31:39.930891+0000","last_peered":"2024-04-15T15:31:39.930891+0000","last_clean":"2024-04-15T15:31:39.930891+0000","last_became_active":"2024-04-15T15:31:34.476656+0000","last_became_peered":"2024-04-15T15:31:34.476656+0000","last_unstale":"2024-04-15T15:31:39.930891+0000","last_undegraded":"2024-04-15T15:31:39.930891+0000","last_fullsized":"2024-04-15T15:31:39.930891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:31.194810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397685+0000","last_change":"2024-04-15T15:31:34.483891+0000","last_active":"2024-04-15T15:31:41.397685+0000","last_peered":"2024-04-15T15:31:41.397685+0000","last_clean":"2024-04-15T15:31:41.397685+0000","last_became_active":"2024-04-15T15:31:34.483555+0000","last_became_peered":"2024-04-15T15:31:34.483555+0000","last_unstale":"2024-04-15T15:31:41.397685+0000","last_undegraded":"2024-04-15T15:31:41.397685+0000","last_fullsized":"2024-04-15T15:31:41.397685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750122+0000","last_change":"2024-04-15T15:31:34.483847+0000","last_active":"2024-04-15T15:31:41.750122+0000","last_peered":"2024-04-15T15:31:41.750122+0000","last_clean":"2024-04-15T15:31:41.750122+0000","last_became_active":"2024-04-15T15:31:34.483415+0000","last_became_peered":"2024-04-15T15:31:34.483415+0000","last_unstale":"2024-04-15T15:31:41.750122+0000","last_undegraded":"2024-04-15T15:31:41.750122+0000","last_fullsized":"2024-04-15T15:31:41.750122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495343+0000","last_change":"2024-04-15T15:31:34.483771+0000","last_active":"2024-04-15T15:31:39.495343+0000","last_peered":"2024-04-15T15:31:39.495343+0000","last_clean":"2024-04-15T15:31:39.495343+0000","last_became_active":"2024-04-15T15:31:34.483472+0000","last_became_peered":"2024-04-15T15:31:34.483472+0000","last_unstale":"2024-04-15T15:31:39.495343+0000","last_undegraded":"2024-04-15T15:31:39.495343+0000","last_fullsized":"2024-04-15T15:31:39.495343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661067+0000","last_change":"2024-04-15T15:31:34.460695+0000","last_active":"2024-04-15T15:31:41.661067+0000","last_peered":"2024-04-15T15:31:41.661067+0000","last_clean":"2024-04-15T15:31:41.661067+0000","last_became_active":"2024-04-15T15:31:34.460352+0000","last_became_peered":"2024-04-15T15:31:34.460352+0000","last_unstale":"2024-04-15T15:31:41.661067+0000","last_undegraded":"2024-04-15T15:31:41.661067+0000","last_fullsized":"2024-04-15T15:31:41.661067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044449+0000","last_change":"2024-04-15T15:31:34.463653+0000","last_active":"2024-04-15T15:31:41.044449+0000","last_peered":"2024-04-15T15:31:41.044449+0000","last_clean":"2024-04-15T15:31:41.044449+0000","last_became_active":"2024-04-15T15:31:34.463359+0000","last_became_peered":"2024-04-15T15:31:34.463359+0000","last_unstale":"2024-04-15T15:31:41.044449+0000","last_undegraded":"2024-04-15T15:31:41.044449+0000","last_fullsized":"2024-04-15T15:31:41.044449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495133+0000","last_change":"2024-04-15T15:31:34.479994+0000","last_active":"2024-04-15T15:31:39.495133+0000","last_peered":"2024-04-15T15:31:39.495133+0000","last_clean":"2024-04-15T15:31:39.495133+0000","last_became_active":"2024-04-15T15:31:34.479723+0000","last_became_peered":"2024-04-15T15:31:34.479723+0000","last_unstale":"2024-04-15T15:31:39.495133+0000","last_undegraded":"2024-04-15T15:31:39.495133+0000","last_fullsized":"2024-04-15T15:31:39.495133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397390+0000","last_change":"2024-04-15T15:31:34.479946+0000","last_active":"2024-04-15T15:31:41.397390+0000","last_peered":"2024-04-15T15:31:41.397390+0000","last_clean":"2024-04-15T15:31:41.397390+0000","last_became_active":"2024-04-15T15:31:34.479601+0000","last_became_peered":"2024-04-15T15:31:34.479601+0000","last_unstale":"2024-04-15T15:31:41.397390+0000","last_undegraded":"2024-04-15T15:31:41.397390+0000","last_fullsized":"2024-04-15T15:31:41.397390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494489+0000","last_change":"2024-04-15T15:31:34.475999+0000","last_active":"2024-04-15T15:31:39.494489+0000","last_peered":"2024-04-15T15:31:39.494489+0000","last_clean":"2024-04-15T15:31:39.494489+0000","last_became_active":"2024-04-15T15:31:34.475713+0000","last_became_peered":"2024-04-15T15:31:34.475713+0000","last_unstale":"2024-04-15T15:31:39.494489+0000","last_undegraded":"2024-04-15T15:31:39.494489+0000","last_fullsized":"2024-04-15T15:31:39.494489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397629+0000","last_change":"2024-04-15T15:31:34.466771+0000","last_active":"2024-04-15T15:31:41.397629+0000","last_peered":"2024-04-15T15:31:41.397629+0000","last_clean":"2024-04-15T15:31:41.397629+0000","last_became_active":"2024-04-15T15:31:34.465716+0000","last_became_peered":"2024-04-15T15:31:34.465716+0000","last_unstale":"2024-04-15T15:31:41.397629+0000","last_undegraded":"2024-04-15T15:31:41.397629+0000","last_fullsized":"2024-04-15T15:31:41.397629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749975+0000","last_change":"2024-04-15T15:31:34.468936+0000","last_active":"2024-04-15T15:31:41.749975+0000","last_peered":"2024-04-15T15:31:41.749975+0000","last_clean":"2024-04-15T15:31:41.749975+0000","last_became_active":"2024-04-15T15:31:34.467355+0000","last_became_peered":"2024-04-15T15:31:34.467355+0000","last_unstale":"2024-04-15T15:31:41.749975+0000","last_undegraded":"2024-04-15T15:31:41.749975+0000","last_fullsized":"2024-04-15T15:31:41.749975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044624+0000","last_change":"2024-04-15T15:31:34.469868+0000","last_active":"2024-04-15T15:31:41.044624+0000","last_peered":"2024-04-15T15:31:41.044624+0000","last_clean":"2024-04-15T15:31:41.044624+0000","last_became_active":"2024-04-15T15:31:34.469606+0000","last_became_peered":"2024-04-15T15:31:34.469606+0000","last_unstale":"2024-04-15T15:31:41.044624+0000","last_undegraded":"2024-04-15T15:31:41.044624+0000","last_fullsized":"2024-04-15T15:31:41.044624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496599+0000","last_change":"2024-04-15T15:31:34.456774+0000","last_active":"2024-04-15T15:31:39.496599+0000","last_peered":"2024-04-15T15:31:39.496599+0000","last_clean":"2024-04-15T15:31:39.496599+0000","last_became_active":"2024-04-15T15:31:34.456377+0000","last_became_peered":"2024-04-15T15:31:34.456377+0000","last_unstale":"2024-04-15T15:31:39.496599+0000","last_undegraded":"2024-04-15T15:31:39.496599+0000","last_fullsized":"2024-04-15T15:31:39.496599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:43.459915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931279+0000","last_change":"2024-04-15T15:31:34.459078+0000","last_active":"2024-04-15T15:31:39.931279+0000","last_peered":"2024-04-15T15:31:39.931279+0000","last_clean":"2024-04-15T15:31:39.931279+0000","last_became_active":"2024-04-15T15:31:34.458498+0000","last_became_peered":"2024-04-15T15:31:34.458498+0000","last_unstale":"2024-04-15T15:31:39.931279+0000","last_undegraded":"2024-04-15T15:31:39.931279+0000","last_fullsized":"2024-04-15T15:31:39.931279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:34.951963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398285+0000","last_change":"2024-04-15T15:31:34.472749+0000","last_active":"2024-04-15T15:31:41.398285+0000","last_peered":"2024-04-15T15:31:41.398285+0000","last_clean":"2024-04-15T15:31:41.398285+0000","last_became_active":"2024-04-15T15:31:34.472465+0000","last_became_peered":"2024-04-15T15:31:34.472465+0000","last_unstale":"2024-04-15T15:31:41.398285+0000","last_undegraded":"2024-04-15T15:31:41.398285+0000","last_fullsized":"2024-04-15T15:31:41.398285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:16.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397279+0000","last_change":"2024-04-15T15:31:34.472038+0000","last_active":"2024-04-15T15:31:41.397279+0000","last_peered":"2024-04-15T15:31:41.397279+0000","last_clean":"2024-04-15T15:31:41.397279+0000","last_became_active":"2024-04-15T15:31:34.471764+0000","last_became_peered":"2024-04-15T15:31:34.471764+0000","last_unstale":"2024-04-15T15:31:41.397279+0000","last_undegraded":"2024-04-15T15:31:41.397279+0000","last_fullsized":"2024-04-15T15:31:41.397279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660748+0000","last_change":"2024-04-15T15:31:34.458770+0000","last_active":"2024-04-15T15:31:41.660748+0000","last_peered":"2024-04-15T15:31:41.660748+0000","last_clean":"2024-04-15T15:31:41.660748+0000","last_became_active":"2024-04-15T15:31:34.457006+0000","last_became_peered":"2024-04-15T15:31:34.457006+0000","last_unstale":"2024-04-15T15:31:41.660748+0000","last_undegraded":"2024-04-15T15:31:41.660748+0000","last_fullsized":"2024-04-15T15:31:41.660748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749969+0000","last_change":"2024-04-15T15:31:34.461367+0000","last_active":"2024-04-15T15:31:41.749969+0000","last_peered":"2024-04-15T15:31:41.749969+0000","last_clean":"2024-04-15T15:31:41.749969+0000","last_became_active":"2024-04-15T15:31:34.461047+0000","last_became_peered":"2024-04-15T15:31:34.461047+0000","last_unstale":"2024-04-15T15:31:41.749969+0000","last_undegraded":"2024-04-15T15:31:41.749969+0000","last_fullsized":"2024-04-15T15:31:41.749969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:23.572024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494956+0000","last_change":"2024-04-15T15:31:34.469034+0000","last_active":"2024-04-15T15:31:39.494956+0000","last_peered":"2024-04-15T15:31:39.494956+0000","last_clean":"2024-04-15T15:31:39.494956+0000","last_became_active":"2024-04-15T15:31:34.468672+0000","last_became_peered":"2024-04-15T15:31:34.468672+0000","last_unstale":"2024-04-15T15:31:39.494956+0000","last_undegraded":"2024-04-15T15:31:39.494956+0000","last_fullsized":"2024-04-15T15:31:39.494956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495762+0000","last_change":"2024-04-15T15:31:34.468002+0000","last_active":"2024-04-15T15:31:39.495762+0000","last_peered":"2024-04-15T15:31:39.495762+0000","last_clean":"2024-04-15T15:31:39.495762+0000","last_became_active":"2024-04-15T15:31:34.467722+0000","last_became_peered":"2024-04-15T15:31:34.467722+0000","last_unstale":"2024-04-15T15:31:39.495762+0000","last_undegraded":"2024-04-15T15:31:39.495762+0000","last_fullsized":"2024-04-15T15:31:39.495762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:32.225234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044380+0000","last_change":"2024-04-15T15:31:34.480518+0000","last_active":"2024-04-15T15:31:41.044380+0000","last_peered":"2024-04-15T15:31:41.044380+0000","last_clean":"2024-04-15T15:31:41.044380+0000","last_became_active":"2024-04-15T15:31:34.480217+0000","last_became_peered":"2024-04-15T15:31:34.480217+0000","last_unstale":"2024-04-15T15:31:41.044380+0000","last_undegraded":"2024-04-15T15:31:41.044380+0000","last_fullsized":"2024-04-15T15:31:41.044380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044414+0000","last_change":"2024-04-15T15:31:34.476865+0000","last_active":"2024-04-15T15:31:41.044414+0000","last_peered":"2024-04-15T15:31:41.044414+0000","last_clean":"2024-04-15T15:31:41.044414+0000","last_became_active":"2024-04-15T15:31:34.476592+0000","last_became_peered":"2024-04-15T15:31:34.476592+0000","last_unstale":"2024-04-15T15:31:41.044414+0000","last_undegraded":"2024-04-15T15:31:41.044414+0000","last_fullsized":"2024-04-15T15:31:41.044414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.497050+0000","last_change":"2024-04-15T15:31:34.470331+0000","last_active":"2024-04-15T15:31:39.497050+0000","last_peered":"2024-04-15T15:31:39.497050+0000","last_clean":"2024-04-15T15:31:39.497050+0000","last_became_active":"2024-04-15T15:31:34.469766+0000","last_became_peered":"2024-04-15T15:31:34.469766+0000","last_unstale":"2024-04-15T15:31:39.497050+0000","last_undegraded":"2024-04-15T15:31:39.497050+0000","last_fullsized":"2024-04-15T15:31:39.497050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:28.573374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494297+0000","last_change":"2024-04-15T15:31:34.477666+0000","last_active":"2024-04-15T15:31:39.494297+0000","last_peered":"2024-04-15T15:31:39.494297+0000","last_clean":"2024-04-15T15:31:39.494297+0000","last_became_active":"2024-04-15T15:31:34.477474+0000","last_became_peered":"2024-04-15T15:31:34.477474+0000","last_unstale":"2024-04-15T15:31:39.494297+0000","last_undegraded":"2024-04-15T15:31:39.494297+0000","last_fullsized":"2024-04-15T15:31:39.494297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495353+0000","last_change":"2024-04-15T15:31:34.464289+0000","last_active":"2024-04-15T15:31:39.495353+0000","last_peered":"2024-04-15T15:31:39.495353+0000","last_clean":"2024-04-15T15:31:39.495353+0000","last_became_active":"2024-04-15T15:31:34.463192+0000","last_became_peered":"2024-04-15T15:31:34.463192+0000","last_unstale":"2024-04-15T15:31:39.495353+0000","last_undegraded":"2024-04-15T15:31:39.495353+0000","last_fullsized":"2024-04-15T15:31:39.495353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397536+0000","last_change":"2024-04-15T15:31:34.468251+0000","last_active":"2024-04-15T15:31:41.397536+0000","last_peered":"2024-04-15T15:31:41.397536+0000","last_clean":"2024-04-15T15:31:41.397536+0000","last_became_active":"2024-04-15T15:31:34.466070+0000","last_became_peered":"2024-04-15T15:31:34.466070+0000","last_unstale":"2024-04-15T15:31:41.397536+0000","last_undegraded":"2024-04-15T15:31:41.397536+0000","last_fullsized":"2024-04-15T15:31:41.397536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495574+0000","last_change":"2024-04-15T15:31:34.455934+0000","last_active":"2024-04-15T15:31:39.495574+0000","last_peered":"2024-04-15T15:31:39.495574+0000","last_clean":"2024-04-15T15:31:39.495574+0000","last_became_active":"2024-04-15T15:31:34.455599+0000","last_became_peered":"2024-04-15T15:31:34.455599+0000","last_unstale":"2024-04-15T15:31:39.495574+0000","last_undegraded":"2024-04-15T15:31:39.495574+0000","last_fullsized":"2024-04-15T15:31:39.495574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397749+0000","last_change":"2024-04-15T15:31:34.484026+0000","last_active":"2024-04-15T15:31:41.397749+0000","last_peered":"2024-04-15T15:31:41.397749+0000","last_clean":"2024-04-15T15:31:41.397749+0000","last_became_active":"2024-04-15T15:31:34.483383+0000","last_became_peered":"2024-04-15T15:31:34.483383+0000","last_unstale":"2024-04-15T15:31:41.397749+0000","last_undegraded":"2024-04-15T15:31:41.397749+0000","last_fullsized":"2024-04-15T15:31:41.397749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750318+0000","last_change":"2024-04-15T15:31:34.470556+0000","last_active":"2024-04-15T15:31:41.750318+0000","last_peered":"2024-04-15T15:31:41.750318+0000","last_clean":"2024-04-15T15:31:41.750318+0000","last_became_active":"2024-04-15T15:31:34.467292+0000","last_became_peered":"2024-04-15T15:31:34.467292+0000","last_unstale":"2024-04-15T15:31:41.750318+0000","last_undegraded":"2024-04-15T15:31:41.750318+0000","last_fullsized":"2024-04-15T15:31:41.750318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661305+0000","last_change":"2024-04-15T15:31:34.470522+0000","last_active":"2024-04-15T15:31:41.661305+0000","last_peered":"2024-04-15T15:31:41.661305+0000","last_clean":"2024-04-15T15:31:41.661305+0000","last_became_active":"2024-04-15T15:31:34.470091+0000","last_became_peered":"2024-04-15T15:31:34.470091+0000","last_unstale":"2024-04-15T15:31:41.661305+0000","last_undegraded":"2024-04-15T15:31:41.661305+0000","last_fullsized":"2024-04-15T15:31:41.661305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496926+0000","last_change":"2024-04-15T15:31:34.460838+0000","last_active":"2024-04-15T15:31:39.496926+0000","last_peered":"2024-04-15T15:31:39.496926+0000","last_clean":"2024-04-15T15:31:39.496926+0000","last_became_active":"2024-04-15T15:31:34.460557+0000","last_became_peered":"2024-04-15T15:31:34.460557+0000","last_unstale":"2024-04-15T15:31:39.496926+0000","last_undegraded":"2024-04-15T15:31:39.496926+0000","last_fullsized":"2024-04-15T15:31:39.496926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:16.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:31:54.357 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-15T15:31:54.358 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-15T15:31:54.358 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-15T15:31:54.358 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-15T15:31:54.358 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-15T15:31:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe468200640 1 Processor -- start 2024-04-15T15:31:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe468200640 1 -- start start 2024-04-15T15:31:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe468200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe4600b17a0 0x7fe4600d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe468200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4600d1000 con 0x7fe46009b170 2024-04-15T15:31:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe468200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4600d12e0 con 0x7fe46006dad0 2024-04-15T15:31:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe468200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fe4600d15c0 con 0x7fe4600b17a0 2024-04-15T15:31:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe466200640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe46009b170 0x7fe46015e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37542/0 (socket says 172.21.15.73:37542) 2024-04-15T15:31:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe466200640 1 -- 172.21.15.73:0/2812654247 learned_addr learned my addr 172.21.15.73:0/2812654247 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe465800640 1 --2- 172.21.15.73:0/2812654247 >> v2:172.21.15.118:3300/0 conn(0x7fe4600b17a0 0x7fe4600d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe45fe00640 1 -- 172.21.15.73:0/2812654247 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515263225 0 0) 0x7fe4600d1000 con 0x7fe46009b170 2024-04-15T15:31:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe45fe00640 1 -- 172.21.15.73:0/2812654247 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe448003530 con 0x7fe46009b170 2024-04-15T15:31:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe45fe00640 1 -- 172.21.15.73:0/2812654247 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14574631 0 0) 0x7fe4600d12e0 con 0x7fe46006dad0 2024-04-15T15:31:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe45fe00640 1 -- 172.21.15.73:0/2812654247 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4600d1000 con 0x7fe46006dad0 2024-04-15T15:31:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe465800640 1 -- 172.21.15.73:0/2812654247 >> v1:172.21.15.118:6789/0 conn(0x7fe46006dad0 legacy=0x7fe46009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe45fe00640 1 -- 172.21.15.73:0/2812654247 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4013513932 0 0) 0x7fe448003530 con 0x7fe46009b170 2024-04-15T15:31:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe465800640 1 -- 172.21.15.73:0/2812654247 >> v1:172.21.15.73:6789/0 conn(0x7fe46009b170 legacy=0x7fe46015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.529+0000 7fe465800640 1 -- 172.21.15.73:0/2812654247 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4600d18a0 con 0x7fe4600b17a0 2024-04-15T15:31:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe465800640 1 --2- 172.21.15.73:0/2812654247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4600b17a0 0x7fe4600d08b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4540097a0 tx=0x7fe45401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f1e8f436225b80e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe45fe00640 1 -- 172.21.15.73:0/2812654247 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4540b0070 con 0x7fe4600b17a0 2024-04-15T15:31:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe45fe00640 1 -- 172.21.15.73:0/2812654247 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4540ab400 con 0x7fe4600b17a0 2024-04-15T15:31:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe45fe00640 1 -- 172.21.15.73:0/2812654247 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458001a00 con 0x7fe4600b17a0 2024-04-15T15:31:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe468200640 1 -- 172.21.15.73:0/2812654247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4600b17a0 msgr2=0x7fe4600d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe468200640 1 --2- 172.21.15.73:0/2812654247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4600b17a0 0x7fe4600d08b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4540097a0 tx=0x7fe45401c3a0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe468200640 1 -- 172.21.15.73:0/2812654247 shutdown_connections 2024-04-15T15:31:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe468200640 1 --2- 172.21.15.73:0/2812654247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4600b17a0 0x7fe4600d08b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe468200640 1 -- 172.21.15.73:0/2812654247 >> 172.21.15.73:0/2812654247 conn(0x7fe4600b3fe0 msgr2=0x7fe4600b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe468200640 1 -- 172.21.15.73:0/2812654247 shutdown_connections 2024-04-15T15:31:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.533+0000 7fe468200640 1 -- 172.21.15.73:0/2812654247 wait complete. 2024-04-15T15:31:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe468200640 1 Processor -- start 2024-04-15T15:31:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe468200640 1 -- start start 2024-04-15T15:31:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe468200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe46006dad0 0x7fe4601502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe468200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46009b170 0x7fe4600c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe468200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4600b17a0 0x7fe4600c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe468200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe46006e060 con 0x7fe4600b17a0 2024-04-15T15:31:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe468200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe46006dee0 con 0x7fe46009b170 2024-04-15T15:31:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe468200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe46016d0a0 con 0x7fe46006dad0 2024-04-15T15:31:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe466200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4600b17a0 0x7fe4600c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe466200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4600b17a0 0x7fe4600c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45312/0 (socket says 172.21.15.73:45312) 2024-04-15T15:31:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe466200640 1 -- 172.21.15.73:0/2134666696 learned_addr learned my addr 172.21.15.73:0/2134666696 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe465800640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe46006dad0 0x7fe4601502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe464e00640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46009b170 0x7fe4600c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe466200640 1 -- 172.21.15.73:0/2134666696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe46006dad0 msgr2=0x7fe4601502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe466200640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe46006dad0 0x7fe4601502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe466200640 1 -- 172.21.15.73:0/2134666696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46009b170 msgr2=0x7fe4600c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe466200640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46009b170 0x7fe4600c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe466200640 1 -- 172.21.15.73:0/2134666696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe460152ff0 con 0x7fe4600b17a0 2024-04-15T15:31:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe466200640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4600b17a0 0x7fe4600c8020 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe458001470 tx=0x7fe45800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe45d600640 1 -- 172.21.15.73:0/2134666696 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458012400 con 0x7fe4600b17a0 2024-04-15T15:31:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe45d600640 1 -- 172.21.15.73:0/2134666696 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4580125a0 con 0x7fe4600b17a0 2024-04-15T15:31:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe468200640 1 -- 172.21.15.73:0/2134666696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4601532d0 con 0x7fe4600b17a0 2024-04-15T15:31:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe45d600640 1 -- 172.21.15.73:0/2134666696 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458012990 con 0x7fe4600b17a0 2024-04-15T15:31:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.537+0000 7fe468200640 1 -- 172.21.15.73:0/2134666696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe460153890 con 0x7fe4600b17a0 2024-04-15T15:31:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.541+0000 7fe468200640 1 -- 172.21.15.73:0/2134666696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe460068ab0 con 0x7fe4600b17a0 2024-04-15T15:31:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.541+0000 7fe45d600640 1 -- 172.21.15.73:0/2134666696 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe458012b30 con 0x7fe4600b17a0 2024-04-15T15:31:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.541+0000 7fe45d600640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe440068380 0x7fe44006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.541+0000 7fe45d600640 1 -- 172.21.15.73:0/2134666696 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe458087400 con 0x7fe4600b17a0 2024-04-15T15:31:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.541+0000 7fe465800640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe440068380 0x7fe44006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.541+0000 7fe465800640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe440068380 0x7fe44006a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe4540ad000 tx=0x7fe4540a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.545+0000 7fe45d600640 1 -- 172.21.15.73:0/2134666696 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe458012e20 con 0x7fe4600b17a0 2024-04-15T15:31:54.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.737+0000 7fe468200640 1 -- 172.21.15.73:0/2134666696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe4600b4d80 con 0x7fe4600b17a0 2024-04-15T15:31:54.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.741+0000 7fe45d600640 1 -- 172.21.15.73:0/2134666696 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168084 (secure 0 0 0) 0x7fe458056f90 con 0x7fe4600b17a0 2024-04-15T15:31:54.745 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 -- 172.21.15.73:0/2134666696 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe440068380 msgr2=0x7fe44006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe440068380 0x7fe44006a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe4540ad000 tx=0x7fe4540a6000 comp rx=0 tx=0).stop 2024-04-15T15:31:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 -- 172.21.15.73:0/2134666696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4600b17a0 msgr2=0x7fe4600c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4600b17a0 0x7fe4600c8020 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe458001470 tx=0x7fe45800a430 comp rx=0 tx=0).stop 2024-04-15T15:31:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 -- 172.21.15.73:0/2134666696 shutdown_connections 2024-04-15T15:31:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4600b17a0 0x7fe4600c8020 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46009b170 0x7fe4600c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe440068380 0x7fe44006a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 --2- 172.21.15.73:0/2134666696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe46006dad0 0x7fe4601502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 -- 172.21.15.73:0/2134666696 >> 172.21.15.73:0/2134666696 conn(0x7fe4600b3fe0 msgr2=0x7fe4601569d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:54.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 -- 172.21.15.73:0/2134666696 shutdown_connections 2024-04-15T15:31:54.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.745+0000 7fe468200640 1 -- 172.21.15.73:0/2134666696 wait complete. 2024-04-15T15:31:54.765 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1395331382},{"type":"v1","addr":"172.21.15.73:6833","nonce":1395331382}]},"active_addr":"172.21.15.73:6833/1395331382","active_change":"2024-04-15T15:31:13.343483+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3068871124}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1604201853}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":331801287}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1629305674}]}]} 2024-04-15T15:31:54.770 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-15T15:31:54.770 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-15T15:31:54.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:54.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb398200640 1 Processor -- start 2024-04-15T15:31:54.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb398200640 1 -- start start 2024-04-15T15:31:54.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb398200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3900d08b0 0x7fb39009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb398200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb39009afa0 0x7fb39015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb398200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3900d0d40 con 0x7fb3900b17a0 2024-04-15T15:31:54.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb398200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb3900d1000 con 0x7fb3900d08b0 2024-04-15T15:31:54.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb398200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb3900d12e0 con 0x7fb39009afa0 2024-04-15T15:31:54.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb394e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3900d08b0 0x7fb39009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb394e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3900d08b0 0x7fb39009aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45316/0 (socket says 172.21.15.73:45316) 2024-04-15T15:31:54.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb394e00640 1 -- 172.21.15.73:0/1223149905 learned_addr learned my addr 172.21.15.73:0/1223149905 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb396200640 1 --2- 172.21.15.73:0/1223149905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb39009afa0 0x7fb39015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb394e00640 1 -- 172.21.15.73:0/1223149905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb39009afa0 msgr2=0x7fb39015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb394e00640 1 --2- 172.21.15.73:0/1223149905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb39009afa0 0x7fb39015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb394e00640 1 -- 172.21.15.73:0/1223149905 >> v1:172.21.15.118:6789/0 conn(0x7fb3900b17a0 legacy=0x7fb39006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb394e00640 1 -- 172.21.15.73:0/1223149905 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3900d15c0 con 0x7fb3900d08b0 2024-04-15T15:31:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.905+0000 7fb396200640 1 --2- 172.21.15.73:0/1223149905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb39009afa0 0x7fb39015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:54.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.909+0000 7fb394e00640 1 --2- 172.21.15.73:0/1223149905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3900d08b0 0x7fb39009aa60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009870 tx=0x7fb37c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831ab65a910b57af server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb38fe00640 1 -- 172.21.15.73:0/1223149905 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0b1070 con 0x7fb3900d08b0 2024-04-15T15:31:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb38fe00640 1 -- 172.21.15.73:0/1223149905 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37c0ac630 con 0x7fb3900d08b0 2024-04-15T15:31:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb38fe00640 1 -- 172.21.15.73:0/1223149905 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0a8050 con 0x7fb3900d08b0 2024-04-15T15:31:54.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 -- 172.21.15.73:0/1223149905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3900d08b0 msgr2=0x7fb39009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 --2- 172.21.15.73:0/1223149905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3900d08b0 0x7fb39009aa60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009870 tx=0x7fb37c01c520 comp rx=0 tx=0).stop 2024-04-15T15:31:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 -- 172.21.15.73:0/1223149905 shutdown_connections 2024-04-15T15:31:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 --2- 172.21.15.73:0/1223149905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb39009afa0 0x7fb39015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 --2- 172.21.15.73:0/1223149905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3900d08b0 0x7fb39009aa60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 -- 172.21.15.73:0/1223149905 >> 172.21.15.73:0/1223149905 conn(0x7fb3900b3fe0 msgr2=0x7fb3900b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 -- 172.21.15.73:0/1223149905 shutdown_connections 2024-04-15T15:31:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 -- 172.21.15.73:0/1223149905 wait complete. 2024-04-15T15:31:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 Processor -- start 2024-04-15T15:31:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 -- start start 2024-04-15T15:31:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb39009afa0 0x7fb3901565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3900b17a0 0x7fb3901624f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3900d08b0 0x7fb390162a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb390070050 con 0x7fb39009afa0 2024-04-15T15:31:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb39006fed0 con 0x7fb3900b17a0 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.913+0000 7fb398200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb3900701d0 con 0x7fb3900d08b0 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb395800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb39009afa0 0x7fb3901565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb395800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb39009afa0 0x7fb3901565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45320/0 (socket says 172.21.15.73:45320) 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb395800640 1 -- 172.21.15.73:0/1355499861 learned_addr learned my addr 172.21.15.73:0/1355499861 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb394e00640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3900b17a0 0x7fb3901624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb396200640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3900d08b0 0x7fb390162a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb395800640 1 -- 172.21.15.73:0/1355499861 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3900d08b0 msgr2=0x7fb390162a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb395800640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3900d08b0 0x7fb390162a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb395800640 1 -- 172.21.15.73:0/1355499861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3900b17a0 msgr2=0x7fb3901624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb395800640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3900b17a0 0x7fb3901624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb395800640 1 -- 172.21.15.73:0/1355499861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb390157060 con 0x7fb39009afa0 2024-04-15T15:31:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb395800640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb39009afa0 0x7fb3901565a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb38400c430 tx=0x7fb38400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb38d600640 1 -- 172.21.15.73:0/1355499861 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384011790 con 0x7fb39009afa0 2024-04-15T15:31:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb38d600640 1 -- 172.21.15.73:0/1355499861 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb384017070 con 0x7fb39009afa0 2024-04-15T15:31:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb398200640 1 -- 172.21.15.73:0/1355499861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb390157340 con 0x7fb39009afa0 2024-04-15T15:31:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb38d600640 1 -- 172.21.15.73:0/1355499861 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384011bb0 con 0x7fb39009afa0 2024-04-15T15:31:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb398200640 1 -- 172.21.15.73:0/1355499861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb390157900 con 0x7fb39009afa0 2024-04-15T15:31:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb398200640 1 -- 172.21.15.73:0/1355499861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb390068ab0 con 0x7fb39009afa0 2024-04-15T15:31:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.917+0000 7fb38d600640 1 -- 172.21.15.73:0/1355499861 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb384012420 con 0x7fb39009afa0 2024-04-15T15:31:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.921+0000 7fb38d600640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb370068380 0x7fb37006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.921+0000 7fb38d600640 1 -- 172.21.15.73:0/1355499861 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb384086680 con 0x7fb39009afa0 2024-04-15T15:31:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.921+0000 7fb394e00640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb370068380 0x7fb37006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.921+0000 7fb394e00640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb370068380 0x7fb37006a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0ae000 tx=0x7fb37c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:54.921+0000 7fb38d600640 1 -- 172.21.15.73:0/1355499861 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb3840562a0 con 0x7fb39009afa0 2024-04-15T15:31:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.081+0000 7fb398200640 1 -- 172.21.15.73:0/1355499861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3900b4d80 con 0x7fb39009afa0 2024-04-15T15:31:55.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.081+0000 7fb38d600640 1 -- 172.21.15.73:0/1355499861 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fb38405a5a0 con 0x7fb39009afa0 2024-04-15T15:31:55.083 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:55.083 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:55.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 -- 172.21.15.73:0/1355499861 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb370068380 msgr2=0x7fb37006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb370068380 0x7fb37006a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0ae000 tx=0x7fb37c0a7000 comp rx=0 tx=0).stop 2024-04-15T15:31:55.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 -- 172.21.15.73:0/1355499861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb39009afa0 msgr2=0x7fb3901565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb39009afa0 0x7fb3901565a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb38400c430 tx=0x7fb38400c8f0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 -- 172.21.15.73:0/1355499861 shutdown_connections 2024-04-15T15:31:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb370068380 0x7fb37006a840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3900d08b0 0x7fb390162a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3900b17a0 0x7fb3901624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 --2- 172.21.15.73:0/1355499861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb39009afa0 0x7fb3901565a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 -- 172.21.15.73:0/1355499861 >> 172.21.15.73:0/1355499861 conn(0x7fb3900b3fe0 msgr2=0x7fb3900b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 -- 172.21.15.73:0/1355499861 shutdown_connections 2024-04-15T15:31:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.085+0000 7fb398200640 1 -- 172.21.15.73:0/1355499861 wait complete. 2024-04-15T15:31:55.105 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-15T15:31:55.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:55.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.237+0000 7f13d6400640 1 Processor -- start 2024-04-15T15:31:55.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.237+0000 7f13d6400640 1 -- start start 2024-04-15T15:31:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13d6400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 0x7f13d015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13d6400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13d00b3e30 0x7f13d00b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13d6400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d0070160 con 0x7f13d00b25f0 2024-04-15T15:31:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13d6400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f13d015b9b0 con 0x7f13d00b3e30 2024-04-15T15:31:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13d6400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13d015f1f0 con 0x7f13d015b5d0 2024-04-15T15:31:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13c6a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13d00b3e30 0x7f13d00b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13c6a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13d00b3e30 0x7f13d00b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45330/0 (socket says 172.21.15.73:45330) 2024-04-15T15:31:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13c6a00640 1 -- 172.21.15.73:0/783423533 learned_addr learned my addr 172.21.15.73:0/783423533 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13cf400640 1 --2- 172.21.15.73:0/783423533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 0x7f13d015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13c6a00640 1 -- 172.21.15.73:0/783423533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 msgr2=0x7f13d015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13c6a00640 1 --2- 172.21.15.73:0/783423533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 0x7f13d015fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13c6a00640 1 -- 172.21.15.73:0/783423533 >> v1:172.21.15.118:6789/0 conn(0x7f13d00b25f0 legacy=0x7f13d00b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13c6a00640 1 -- 172.21.15.73:0/783423533 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d006fe80 con 0x7f13d00b3e30 2024-04-15T15:31:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.241+0000 7f13cf400640 1 --2- 172.21.15.73:0/783423533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 0x7f13d015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:55.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13c6a00640 1 --2- 172.21.15.73:0/783423533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b3e30 0x7f13d00b20b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f13b800bb10 tx=0x7f13b801eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b59beb25488e1fe server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13cea00640 1 -- 172.21.15.73:0/783423533 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b80b4070 con 0x7f13d00b3e30 2024-04-15T15:31:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13cea00640 1 -- 172.21.15.73:0/783423533 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b80a7aa0 con 0x7f13d00b3e30 2024-04-15T15:31:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13cea00640 1 -- 172.21.15.73:0/783423533 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b80af440 con 0x7f13d00b3e30 2024-04-15T15:31:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 -- 172.21.15.73:0/783423533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b3e30 msgr2=0x7f13d00b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 --2- 172.21.15.73:0/783423533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b3e30 0x7f13d00b20b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f13b800bb10 tx=0x7f13b801eae0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 -- 172.21.15.73:0/783423533 shutdown_connections 2024-04-15T15:31:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 --2- 172.21.15.73:0/783423533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b3e30 0x7f13d00b20b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 --2- 172.21.15.73:0/783423533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 0x7f13d015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 -- 172.21.15.73:0/783423533 >> 172.21.15.73:0/783423533 conn(0x7f13d0067dd0 msgr2=0x7f13d00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 -- 172.21.15.73:0/783423533 shutdown_connections 2024-04-15T15:31:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 -- 172.21.15.73:0/783423533 wait complete. 2024-04-15T15:31:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 Processor -- start 2024-04-15T15:31:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 -- start start 2024-04-15T15:31:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b25f0 0x7f13d01527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d00b3e30 0x7f13d0165890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 0x7f13d014f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13d006faa0 con 0x7f13d00b25f0 2024-04-15T15:31:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13d00cfd00 con 0x7f13d00b3e30 2024-04-15T15:31:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13d6400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13d006fc20 con 0x7f13d015b5d0 2024-04-15T15:31:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13cf400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b25f0 0x7f13d01527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13cf400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b25f0 0x7f13d01527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45340/0 (socket says 172.21.15.73:45340) 2024-04-15T15:31:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.245+0000 7f13cf400640 1 -- 172.21.15.73:0/436987080 learned_addr learned my addr 172.21.15.73:0/436987080 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13c6a00640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d00b3e30 0x7f13d0165890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13cfe00640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 0x7f13d014f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13cf400640 1 -- 172.21.15.73:0/436987080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 msgr2=0x7f13d014f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13cf400640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 0x7f13d014f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13cf400640 1 -- 172.21.15.73:0/436987080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d00b3e30 msgr2=0x7f13d0165890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13cf400640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d00b3e30 0x7f13d0165890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13cf400640 1 -- 172.21.15.73:0/436987080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d0151700 con 0x7f13d00b25f0 2024-04-15T15:31:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13cf400640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b25f0 0x7f13d01527a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f13c000ce00 tx=0x7f13c000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13c7e00640 1 -- 172.21.15.73:0/436987080 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c000f890 con 0x7f13d00b25f0 2024-04-15T15:31:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13c7e00640 1 -- 172.21.15.73:0/436987080 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c000fa30 con 0x7f13d00b25f0 2024-04-15T15:31:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13c7e00640 1 -- 172.21.15.73:0/436987080 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c000fe40 con 0x7f13d00b25f0 2024-04-15T15:31:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13d6400640 1 -- 172.21.15.73:0/436987080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d0151a40 con 0x7f13d00b25f0 2024-04-15T15:31:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13d6400640 1 -- 172.21.15.73:0/436987080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d0152280 con 0x7f13d00b25f0 2024-04-15T15:31:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13d6400640 1 -- 172.21.15.73:0/436987080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d0068ab0 con 0x7f13d00b25f0 2024-04-15T15:31:55.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.249+0000 7f13c7e00640 1 -- 172.21.15.73:0/436987080 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f13c0018400 con 0x7f13d00b25f0 2024-04-15T15:31:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.253+0000 7f13c7e00640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f13ac068380 0x7f13ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.253+0000 7f13c7e00640 1 -- 172.21.15.73:0/436987080 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f13c0087990 con 0x7f13d00b25f0 2024-04-15T15:31:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.253+0000 7f13c6a00640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f13ac068380 0x7f13ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.253+0000 7f13c6a00640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f13ac068380 0x7f13ac06a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13b80b1000 tx=0x7f13b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.257+0000 7f13c7e00640 1 -- 172.21.15.73:0/436987080 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f13d0151a40 con 0x7f13d00b25f0 2024-04-15T15:31:55.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.417+0000 7f13d6400640 1 -- 172.21.15.73:0/436987080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13d006f370 con 0x7f13d00b25f0 2024-04-15T15:31:55.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.417+0000 7f13c7e00640 1 -- 172.21.15.73:0/436987080 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f13c0014030 con 0x7f13d00b25f0 2024-04-15T15:31:55.419 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:55.419 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:55.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 -- 172.21.15.73:0/436987080 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f13ac068380 msgr2=0x7f13ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f13ac068380 0x7f13ac06a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13b80b1000 tx=0x7f13b8008040 comp rx=0 tx=0).stop 2024-04-15T15:31:55.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 -- 172.21.15.73:0/436987080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b25f0 msgr2=0x7f13d01527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b25f0 0x7f13d01527a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f13c000ce00 tx=0x7f13c000a650 comp rx=0 tx=0).stop 2024-04-15T15:31:55.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 -- 172.21.15.73:0/436987080 shutdown_connections 2024-04-15T15:31:55.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f13ac068380 0x7f13ac06a840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13d015b5d0 0x7f13d014f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d00b3e30 0x7f13d0165890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 --2- 172.21.15.73:0/436987080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13d00b25f0 0x7f13d01527a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 -- 172.21.15.73:0/436987080 >> 172.21.15.73:0/436987080 conn(0x7f13d0067dd0 msgr2=0x7f13d00b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 -- 172.21.15.73:0/436987080 shutdown_connections 2024-04-15T15:31:55.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.421+0000 7f13d6400640 1 -- 172.21.15.73:0/436987080 wait complete. 2024-04-15T15:31:55.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-15T15:31:55.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-15T15:31:55.443 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-15T15:31:55.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-15T15:31:55.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-15T15:31:55.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-15T15:31:55.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-15T15:31:55.447 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-15T15:31:55.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.685+0000 7f48e6800640 1 Processor -- start 2024-04-15T15:31:55.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.685+0000 7f48e6800640 1 -- start start 2024-04-15T15:31:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.685+0000 7f3a81600640 1 Processor -- start 2024-04-15T15:31:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a81600640 1 -- start start 2024-04-15T15:31:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48e6800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f48e006ca60 0x7f48e006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48e6800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48e0073960 con 0x7f48e015bea0 2024-04-15T15:31:55.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48e6800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48e015c330 con 0x7f48e0144730 2024-04-15T15:31:55.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48e6800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f48e0067ee0 con 0x7f48e006ca60 2024-04-15T15:31:55.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48e5400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f48e0144730 0x7f48e00677d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:53378/0 (socket says 172.21.15.73:53378) 2024-04-15T15:31:55.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a81600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3a7c15b5d0 0x7f3a7c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a81600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a7c0b27c0 0x7f3a7c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a81600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7c070160 con 0x7f3a7c0b3e30 2024-04-15T15:31:55.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a81600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3a7c15b9b0 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a81600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f3a7c15f1f0 con 0x7f3a7c15b5d0 2024-04-15T15:31:55.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a7aa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3a7c15b5d0 0x7f3a7c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a7b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a7c0b27c0 0x7f3a7c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a7b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a7c0b27c0 0x7f3a7c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45346/0 (socket says 172.21.15.73:45346) 2024-04-15T15:31:55.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a7b400640 1 -- 172.21.15.73:0/1596222962 learned_addr learned my addr 172.21.15.73:0/1596222962 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a7b400640 1 -- 172.21.15.73:0/1596222962 >> v2:172.21.15.118:3300/0 conn(0x7f3a7c15b5d0 msgr2=0x7f3a7c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:55.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a7b400640 1 --2- 172.21.15.73:0/1596222962 >> v2:172.21.15.118:3300/0 conn(0x7f3a7c15b5d0 0x7f3a7c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a7b400640 1 -- 172.21.15.73:0/1596222962 >> v1:172.21.15.73:6789/0 conn(0x7f3a7c0b3e30 legacy=0x7f3a7c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:55.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48e5400640 1 -- 172.21.15.73:0/2951514185 learned_addr learned my addr 172.21.15.73:0/2951514185 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:55.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48e5e00640 1 --2- 172.21.15.73:0/2951514185 >> v2:172.21.15.118:3300/0 conn(0x7f48e006ca60 0x7f48e006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48dfe00640 1 -- 172.21.15.73:0/2951514185 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513500431 0 0) 0x7f48d4001120 con 0x7f48e0144730 2024-04-15T15:31:55.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48dfe00640 1 -- 172.21.15.73:0/2951514185 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c8003530 con 0x7f48e0144730 2024-04-15T15:31:55.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48e5e00640 1 -- 172.21.15.73:0/2951514185 >> v1:172.21.15.118:6789/0 conn(0x7f48e0144730 legacy=0x7f48e00677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f48e5e00640 1 -- 172.21.15.73:0/2951514185 >> v1:172.21.15.73:6789/0 conn(0x7f48e015bea0 legacy=0x7f48e00cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:55.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.689+0000 7f3a7b400640 1 -- 172.21.15.73:0/1596222962 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c06fe80 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.693+0000 7f48e5e00640 1 -- 172.21.15.73:0/2951514185 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e00cbb40 con 0x7f48e006ca60 2024-04-15T15:31:55.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.693+0000 7f5ca7a00640 1 Processor -- start 2024-04-15T15:31:55.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.693+0000 7f5ca7a00640 1 -- start start 2024-04-15T15:31:55.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.693+0000 7f8348400640 1 Processor -- start 2024-04-15T15:31:55.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.693+0000 7f5d37e00640 1 Processor -- start 2024-04-15T15:31:55.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.693+0000 7f8348400640 1 -- start start 2024-04-15T15:31:55.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.693+0000 7f5d37e00640 1 -- start start 2024-04-15T15:31:55.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5d37e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5d3806f6e0 0x7f5d3806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5ca7a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ca015e930 0x7f5ca015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5ca7a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca006e6b0 con 0x7f5ca00b2a00 2024-04-15T15:31:55.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5ca7a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca015f570 con 0x7f5ca00ad8d0 2024-04-15T15:31:55.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5ca7a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca015f850 con 0x7f5ca015e930 2024-04-15T15:31:55.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f3a7b400640 1 --2- 172.21.15.73:0/1596222962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a7c0b27c0 0x7f3a7c0b4740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009e50 tx=0x7f3a74020c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554d688bc4e13a91 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5ca5000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ca015e930 0x7f5ca015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5ca5000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ca015e930 0x7f5ca015ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51104/0 (socket says 172.21.15.73:51104) 2024-04-15T15:31:55.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5ca5000640 1 -- 172.21.15.73:0/2143639953 learned_addr learned my addr 172.21.15.73:0/2143639953 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f7395e00640 1 Processor -- start 2024-04-15T15:31:55.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5d36000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5d3806f6e0 0x7f5d3806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f3a79600640 1 -- 172.21.15.73:0/1596222962 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a740090d0 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f8348400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83400cd4e0 0x7f83400b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f8348400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83400b44c0 con 0x7f834015a850 2024-04-15T15:31:55.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f8348400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f834006deb0 con 0x7f8340072520 2024-04-15T15:31:55.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f8348400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f834006e7e0 con 0x7f83400cd4e0 2024-04-15T15:31:55.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f3a79600640 1 -- 172.21.15.73:0/1596222962 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a740a9b40 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f388b600640 1 Processor -- start 2024-04-15T15:31:55.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f3a79600640 1 -- 172.21.15.73:0/1596222962 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a740090d0 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f8345a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f834015a850 0x7f8340071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37582/0 (socket says 172.21.15.73:37582) 2024-04-15T15:31:55.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5ca5000640 1 -- 172.21.15.73:0/2143639953 >> v1:172.21.15.118:6789/0 conn(0x7f5ca00ad8d0 legacy=0x7f5ca00b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5ca5000640 1 -- 172.21.15.73:0/2143639953 >> v1:172.21.15.73:6789/0 conn(0x7f5ca00b2a00 legacy=0x7f5ca006eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5d36a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5d38162e00 0x7f5d380ce2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:53388/0 (socket says 172.21.15.73:53388) 2024-04-15T15:31:55.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5ca5000640 1 -- 172.21.15.73:0/2143639953 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca015fb30 con 0x7f5ca015e930 2024-04-15T15:31:55.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5d37e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d380c31f0 0x7f5d380c3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5d36a00640 1 -- 172.21.15.73:0/574131468 learned_addr learned my addr 172.21.15.73:0/574131468 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5d37e00640 1 -- 172.21.15.73:0/574131468 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d381631e0 con 0x7f5d38162e00 2024-04-15T15:31:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5d37e00640 1 -- 172.21.15.73:0/574131468 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f5d380b3070 con 0x7f5d3806f6e0 2024-04-15T15:31:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5d37e00640 1 -- 172.21.15.73:0/574131468 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5d380ce9c0 con 0x7f5d380c31f0 2024-04-15T15:31:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f5d37400640 1 --2- 172.21.15.73:0/574131468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d380c31f0 0x7f5d380c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f031b200640 1 Processor -- start 2024-04-15T15:31:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f031b200640 1 -- start start 2024-04-15T15:31:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f5d36000640 1 -- 172.21.15.73:0/574131468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d380c31f0 msgr2=0x7f5d380c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3a81600640 1 -- 172.21.15.73:0/1596222962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a7c0b27c0 msgr2=0x7f3a7c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3a81600640 1 --2- 172.21.15.73:0/1596222962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a7c0b27c0 0x7f3a7c0b4740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009e50 tx=0x7f3a74020c70 comp rx=0 tx=0).stop 2024-04-15T15:31:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f388b600640 1 -- start start 2024-04-15T15:31:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f5d36000640 1 --2- 172.21.15.73:0/574131468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d380c31f0 0x7f5d380c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f5d36000640 1 -- 172.21.15.73:0/574131468 >> v1:172.21.15.118:6789/0 conn(0x7f5d38162e00 legacy=0x7f5d380ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f5d36000640 1 -- 172.21.15.73:0/574131468 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3806eb40 con 0x7f5d3806f6e0 2024-04-15T15:31:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f48e5e00640 1 --2- 172.21.15.73:0/2951514185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48e006ca60 0x7f48e006ce90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009d90 tx=0x7f48d8025180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=953ecc3dc6ad288e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3a81600640 1 -- 172.21.15.73:0/1596222962 shutdown_connections 2024-04-15T15:31:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f8346400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83400cd4e0 0x7f83400b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3a81600640 1 --2- 172.21.15.73:0/1596222962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a7c0b27c0 0x7f3a7c0b4740 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f7395e00640 1 -- start start 2024-04-15T15:31:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3a81600640 1 --2- 172.21.15.73:0/1596222962 >> v2:172.21.15.118:3300/0 conn(0x7f3a7c15b5d0 0x7f3a7c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3a81600640 1 -- 172.21.15.73:0/1596222962 >> 172.21.15.73:0/1596222962 conn(0x7f3a7c067dd0 msgr2=0x7f3a7c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3a81600640 1 -- 172.21.15.73:0/1596222962 shutdown_connections 2024-04-15T15:31:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f833fe00640 1 -- 172.21.15.73:0/829751092 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 75295754 0 0) 0x7f834006deb0 con 0x7f8340072520 2024-04-15T15:31:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f833fe00640 1 -- 172.21.15.73:0/829751092 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8328003530 con 0x7f8340072520 2024-04-15T15:31:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f48dfe00640 1 -- 172.21.15.73:0/2951514185 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d80b9070 con 0x7f48e006ca60 2024-04-15T15:31:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f48dfe00640 1 -- 172.21.15.73:0/2951514185 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d80b4600 con 0x7f48e006ca60 2024-04-15T15:31:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f48dfe00640 1 -- 172.21.15.73:0/2951514185 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d80b49d0 con 0x7f48e006ca60 2024-04-15T15:31:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f8346400640 1 -- 172.21.15.73:0/829751092 >> v1:172.21.15.118:6789/0 conn(0x7f8340072520 legacy=0x7f834006ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f8346400640 1 -- 172.21.15.73:0/829751092 >> v1:172.21.15.73:6789/0 conn(0x7f834015a850 legacy=0x7f8340071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f8346400640 1 -- 172.21.15.73:0/829751092 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834006e190 con 0x7f83400cd4e0 2024-04-15T15:31:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3a81600640 1 -- 172.21.15.73:0/1596222962 wait complete. 2024-04-15T15:31:55.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f388b600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f38840b8c40 0x7f38840d3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f388b600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3884164240 con 0x7f3884167030 2024-04-15T15:31:55.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f031b200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f031c15a8c0 0x7f031c0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f388b600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38840d2490 con 0x7f388409dd00 2024-04-15T15:31:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f388b600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f38840d30a0 con 0x7f38840b8c40 2024-04-15T15:31:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3889600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f38840b8c40 0x7f38840d3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f031b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f031c0d0d60 0x7f031c0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f031b200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f031c0b3ef0 con 0x7f031c0b30e0 2024-04-15T15:31:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f031b200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f031c0b41d0 con 0x7f031c15a8c0 2024-04-15T15:31:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f031b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f031c0b44b0 con 0x7f031c0d0d60 2024-04-15T15:31:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f48e6800640 1 -- 172.21.15.73:0/2951514185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48e006ca60 msgr2=0x7f48e006ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f48e6800640 1 --2- 172.21.15.73:0/2951514185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48e006ca60 0x7f48e006ce90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009d90 tx=0x7f48d8025180 comp rx=0 tx=0).stop 2024-04-15T15:31:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3889600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f38840b8c40 0x7f38840d3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51122/0 (socket says 172.21.15.73:51122) 2024-04-15T15:31:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3889600640 1 -- 172.21.15.73:0/2601914598 learned_addr learned my addr 172.21.15.73:0/2601914598 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f0319e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f031c15a8c0 0x7f031c0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f0319e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f031c15a8c0 0x7f031c0b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51132/0 (socket says 172.21.15.73:51132) 2024-04-15T15:31:55.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f0319e00640 1 -- 172.21.15.73:0/427953143 learned_addr learned my addr 172.21.15.73:0/427953143 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3889600640 1 -- 172.21.15.73:0/2601914598 >> v1:172.21.15.118:6789/0 conn(0x7f388409dd00 legacy=0x7f3884166920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T15:31:55.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3889600640 1 -- 172.21.15.73:0/2601914598 >> v1:172.21.15.73:6789/0 conn(0x7f3884167030 legacy=0x7f38840b8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.697+0000 7f8345a00640 1 -- 172.21.15.73:0/829751092 learned_addr learned my addr 172.21.15.73:0/829751092 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f8345a00640 1 --1- 172.21.15.73:0/829751092 >> v1:172.21.15.73:6789/0 conn(0x7f834015a850 0x7f8340071e10 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-15T15:31:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f031a800640 1 --2- 172.21.15.73:0/427953143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f031c0d0d60 0x7f031c0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f0319400640 1 -- 172.21.15.73:0/427953143 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 405962524 0 0) 0x7f031c0b3ef0 con 0x7f031c0b30e0 2024-04-15T15:31:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f0319400640 1 -- 172.21.15.73:0/427953143 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0300003530 con 0x7f031c0b30e0 2024-04-15T15:31:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f0319e00640 1 -- 172.21.15.73:0/427953143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f031c0d0d60 msgr2=0x7f031c0ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f0319e00640 1 --2- 172.21.15.73:0/427953143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f031c0d0d60 0x7f031c0ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f0319e00640 1 -- 172.21.15.73:0/427953143 >> v1:172.21.15.118:6789/0 conn(0x7f031c0b30e0 legacy=0x7f031c0d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f0319e00640 1 -- 172.21.15.73:0/427953143 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c0b4790 con 0x7f031c15a8c0 2024-04-15T15:31:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.701+0000 7f3889600640 1 -- 172.21.15.73:0/2601914598 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38840d2770 con 0x7f38840b8c40 2024-04-15T15:31:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f48e6800640 1 -- 172.21.15.73:0/2951514185 shutdown_connections 2024-04-15T15:31:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f48e6800640 1 --2- 172.21.15.73:0/2951514185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48e006ca60 0x7f48e006ce90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f48e6800640 1 -- 172.21.15.73:0/2951514185 >> 172.21.15.73:0/2951514185 conn(0x7f48e0072370 msgr2=0x7f48e0072750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f7395e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f739015c940 0x7f739009b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f7395e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73900cdc60 0x7f739006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f7395e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f739009be00 con 0x7f7390070170 2024-04-15T15:31:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f7395e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f739009ab00 con 0x7f739015c940 2024-04-15T15:31:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f7395e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f739009ade0 con 0x7f73900cdc60 2024-04-15T15:31:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5ca5000640 1 --2- 172.21.15.73:0/2143639953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca015e930 0x7f5ca015ed10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009870 tx=0x7f5c9001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd1394922cb3bf94 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f738f400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7390070170 0x7f7390160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:53424/0 (socket says 172.21.15.73:53424) 2024-04-15T15:31:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f738f400640 1 -- 172.21.15.73:0/356190847 learned_addr learned my addr 172.21.15.73:0/356190847 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f48e6800640 1 -- 172.21.15.73:0/2951514185 shutdown_connections 2024-04-15T15:31:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f7386000640 1 --2- 172.21.15.73:0/356190847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73900cdc60 0x7f739006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f738ea00640 1 --2- 172.21.15.73:0/356190847 >> v2:172.21.15.73:3300/0 conn(0x7f739015c940 0x7f739009b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f3a81600640 1 Processor -- start 2024-04-15T15:31:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5c9f400640 1 -- 172.21.15.73:0/2143639953 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c900a9640 con 0x7f5ca015e930 2024-04-15T15:31:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5c9f400640 1 -- 172.21.15.73:0/2143639953 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c900a97e0 con 0x7f5ca015e930 2024-04-15T15:31:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f3a81600640 1 -- start start 2024-04-15T15:31:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5c9f400640 1 -- 172.21.15.73:0/2143639953 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c900a9bb0 con 0x7f5ca015e930 2024-04-15T15:31:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f8346400640 1 --2- 172.21.15.73:0/829751092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83400cd4e0 0x7f83400b3e30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8338009b10 tx=0x7f833801dd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=988984dbf6bf639a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5d36000640 1 --2- 172.21.15.73:0/574131468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d3806f6e0 0x7f5d3806db70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d240097c0 tx=0x7f5d2401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24095e5335fa6541 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f738e000640 1 -- 172.21.15.73:0/356190847 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788007940 0 0) 0x7f739009be00 con 0x7f7390070170 2024-04-15T15:31:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f7386000640 1 -- 172.21.15.73:0/356190847 >> v2:172.21.15.73:3300/0 conn(0x7f739015c940 msgr2=0x7f739009b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f7386000640 1 --2- 172.21.15.73:0/356190847 >> v2:172.21.15.73:3300/0 conn(0x7f739015c940 0x7f739009b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f7386000640 1 -- 172.21.15.73:0/356190847 >> v1:172.21.15.118:6789/0 conn(0x7f7390070170 legacy=0x7f7390160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f7386000640 1 -- 172.21.15.73:0/356190847 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739009b0c0 con 0x7f73900cdc60 2024-04-15T15:31:55.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f833fe00640 1 -- 172.21.15.73:0/829751092 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83380b3070 con 0x7f83400cd4e0 2024-04-15T15:31:55.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f833fe00640 1 -- 172.21.15.73:0/829751092 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83380a6de0 con 0x7f83400cd4e0 2024-04-15T15:31:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5ca7a00640 1 -- 172.21.15.73:0/2143639953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca015e930 msgr2=0x7f5ca015ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5ca7a00640 1 --2- 172.21.15.73:0/2143639953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca015e930 0x7f5ca015ed10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009870 tx=0x7f5c9001c560 comp rx=0 tx=0).stop 2024-04-15T15:31:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5ca7a00640 1 -- 172.21.15.73:0/2143639953 shutdown_connections 2024-04-15T15:31:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f833fe00640 1 -- 172.21.15.73:0/829751092 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83380ae640 con 0x7f83400cd4e0 2024-04-15T15:31:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5ca7a00640 1 --2- 172.21.15.73:0/2143639953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca015e930 0x7f5ca015ed10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5ca7a00640 1 -- 172.21.15.73:0/2143639953 >> 172.21.15.73:0/2143639953 conn(0x7f5ca00d0540 msgr2=0x7f5ca00d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5d35600640 1 -- 172.21.15.73:0/574131468 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d240b2070 con 0x7f5d3806f6e0 2024-04-15T15:31:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5ca7a00640 1 -- 172.21.15.73:0/2143639953 shutdown_connections 2024-04-15T15:31:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5ca7a00640 1 -- 172.21.15.73:0/2143639953 wait complete. 2024-04-15T15:31:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5d35600640 1 -- 172.21.15.73:0/574131468 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d240ad640 con 0x7f5d3806f6e0 2024-04-15T15:31:55.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f8348400640 1 -- 172.21.15.73:0/829751092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83400cd4e0 msgr2=0x7f83400b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f8348400640 1 --2- 172.21.15.73:0/829751092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83400cd4e0 0x7f83400b3e30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8338009b10 tx=0x7f833801dd00 comp rx=0 tx=0).stop 2024-04-15T15:31:55.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f0319e00640 1 --2- 172.21.15.73:0/427953143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c15a8c0 0x7f031c0b3860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0304009870 tx=0x7f0304024ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=864a653ce3518e47 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f5d35600640 1 -- 172.21.15.73:0/574131468 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d240ada10 con 0x7f5d3806f6e0 2024-04-15T15:31:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.705+0000 7f48e6800640 1 -- 172.21.15.73:0/2951514185 wait complete. 2024-04-15T15:31:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e6800640 1 Processor -- start 2024-04-15T15:31:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5d37e00640 1 -- 172.21.15.73:0/574131468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d3806f6e0 msgr2=0x7f5d3806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5d37e00640 1 --2- 172.21.15.73:0/574131468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d3806f6e0 0x7f5d3806db70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d240097c0 tx=0x7f5d2401c4a0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f0319400640 1 -- 172.21.15.73:0/427953143 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03040ba070 con 0x7f031c15a8c0 2024-04-15T15:31:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f0319400640 1 -- 172.21.15.73:0/427953143 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03040adbb0 con 0x7f031c15a8c0 2024-04-15T15:31:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f0319400640 1 -- 172.21.15.73:0/427953143 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03040ba070 con 0x7f031c15a8c0 2024-04-15T15:31:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e6800640 1 -- start start 2024-04-15T15:31:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a81600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a7c0b27c0 0x7f3a7c14e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a81600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a7c0b3e30 0x7f3a7c157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a81600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a7c15b5d0 0x7f3a7c1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a81600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c06faa0 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a81600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c0cfd00 con 0x7f3a7c0b3e30 2024-04-15T15:31:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a81600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7c06fc20 con 0x7f3a7c15b5d0 2024-04-15T15:31:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a7aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a7c0b27c0 0x7f3a7c14e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a7aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a7c0b27c0 0x7f3a7c14e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45370/0 (socket says 172.21.15.73:45370) 2024-04-15T15:31:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a7aa00640 1 -- 172.21.15.73:0/2069075482 learned_addr learned my addr 172.21.15.73:0/2069075482 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a7b400640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a7c15b5d0 0x7f3a7c1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f8348400640 1 -- 172.21.15.73:0/829751092 shutdown_connections 2024-04-15T15:31:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f8348400640 1 --2- 172.21.15.73:0/829751092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83400cd4e0 0x7f83400b3e30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f8348400640 1 -- 172.21.15.73:0/829751092 >> 172.21.15.73:0/829751092 conn(0x7f83400d0540 msgr2=0x7f83400d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f031b200640 1 -- 172.21.15.73:0/427953143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c15a8c0 msgr2=0x7f031c0b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f031b200640 1 --2- 172.21.15.73:0/427953143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c15a8c0 0x7f031c0b3860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0304009870 tx=0x7f0304024ce0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f031b200640 1 -- 172.21.15.73:0/427953143 shutdown_connections 2024-04-15T15:31:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f031b200640 1 --2- 172.21.15.73:0/427953143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f031c0d0d60 0x7f031c0ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f031b200640 1 --2- 172.21.15.73:0/427953143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c15a8c0 0x7f031c0b3860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f031b200640 1 -- 172.21.15.73:0/427953143 >> 172.21.15.73:0/427953143 conn(0x7f031c06be50 msgr2=0x7f031c06c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f031b200640 1 -- 172.21.15.73:0/427953143 shutdown_connections 2024-04-15T15:31:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f031b200640 1 -- 172.21.15.73:0/427953143 wait complete. 2024-04-15T15:31:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a7a000640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a7c0b3e30 0x7f3a7c157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f8348400640 1 -- 172.21.15.73:0/829751092 shutdown_connections 2024-04-15T15:31:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5ca7a00640 1 Processor -- start 2024-04-15T15:31:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5d37e00640 1 -- 172.21.15.73:0/574131468 shutdown_connections 2024-04-15T15:31:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5d37e00640 1 --2- 172.21.15.73:0/574131468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d380c31f0 0x7f5d380c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5d37e00640 1 --2- 172.21.15.73:0/574131468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d3806f6e0 0x7f5d3806db70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5d37e00640 1 -- 172.21.15.73:0/574131468 >> 172.21.15.73:0/574131468 conn(0x7f5d3806bc20 msgr2=0x7f5d3806c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5d37e00640 1 -- 172.21.15.73:0/574131468 shutdown_connections 2024-04-15T15:31:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5d37e00640 1 -- 172.21.15.73:0/574131468 wait complete. 2024-04-15T15:31:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5ca7a00640 1 -- start start 2024-04-15T15:31:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3889600640 1 --2- 172.21.15.73:0/2601914598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38840b8c40 0x7f38840d3530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3874009870 tx=0x7f387401c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b3b91655a9f556d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a7aa00640 1 -- 172.21.15.73:0/2069075482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a7c15b5d0 msgr2=0x7f3a7c1575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a7aa00640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a7c15b5d0 0x7f3a7c1575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a7aa00640 1 -- 172.21.15.73:0/2069075482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a7c0b3e30 msgr2=0x7f3a7c157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a7aa00640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a7c0b3e30 0x7f3a7c157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3a7aa00640 1 -- 172.21.15.73:0/2069075482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c150b60 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f031b200640 1 Processor -- start 2024-04-15T15:31:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e6800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48e006ca60 0x7f48e0149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48e0144730 0x7f48e013b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48e015bea0 0x7f48e013b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e6800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f48e0167ac0 con 0x7f48e0144730 2024-04-15T15:31:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e6800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f48e006d3d0 con 0x7f48e015bea0 2024-04-15T15:31:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e6800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f48e00cfd10 con 0x7f48e006ca60 2024-04-15T15:31:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3883400640 1 -- 172.21.15.73:0/2601914598 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38740b0070 con 0x7f38840b8c40 2024-04-15T15:31:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3883400640 1 -- 172.21.15.73:0/2601914598 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38740ab600 con 0x7f38840b8c40 2024-04-15T15:31:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f3883400640 1 -- 172.21.15.73:0/2601914598 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38740ab9d0 con 0x7f38840b8c40 2024-04-15T15:31:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f031b200640 1 -- start start 2024-04-15T15:31:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f8348400640 1 -- 172.21.15.73:0/829751092 wait complete. 2024-04-15T15:31:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48e015bea0 0x7f48e013b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48e015bea0 0x7f48e013b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51144/0 (socket says 172.21.15.73:51144) 2024-04-15T15:31:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f48e5e00640 1 -- 172.21.15.73:0/3024682118 learned_addr learned my addr 172.21.15.73:0/3024682118 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f7386000640 1 --2- 172.21.15.73:0/356190847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73900cdc60 0x7f739006fc30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f73780097c0 tx=0x7f737801ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b24949ca09f47675 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.709+0000 7f5ca7a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca00ad8d0 0x7f5ca014dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca7a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca00b2a00 0x7f5ca0155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca7a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca015e930 0x7f5ca0156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48e5e00640 1 -- 172.21.15.73:0/3024682118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48e006ca60 msgr2=0x7f48e0149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48e5e00640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48e006ca60 0x7f48e0149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48e5e00640 1 -- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48e0144730 msgr2=0x7f48e013b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48e5e00640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48e0144730 0x7f48e013b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48e5e00640 1 -- 172.21.15.73:0/3024682118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e00b5d40 con 0x7f48e015bea0 2024-04-15T15:31:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d37e00640 1 Processor -- start 2024-04-15T15:31:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca7a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca00b3f00 con 0x7f5ca00ad8d0 2024-04-15T15:31:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca7a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca00b3d80 con 0x7f5ca015e930 2024-04-15T15:31:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca7a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca016c570 con 0x7f5ca00b2a00 2024-04-15T15:31:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f738e000640 1 -- 172.21.15.73:0/356190847 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73780b5070 con 0x7f73900cdc60 2024-04-15T15:31:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f738e000640 1 -- 172.21.15.73:0/356190847 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73780a8990 con 0x7f73900cdc60 2024-04-15T15:31:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f738e000640 1 -- 172.21.15.73:0/356190847 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73780a8d60 con 0x7f73900cdc60 2024-04-15T15:31:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca5a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca015e930 0x7f5ca0156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca5a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca015e930 0x7f5ca0156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51158/0 (socket says 172.21.15.73:51158) 2024-04-15T15:31:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca5a00640 1 -- 172.21.15.73:0/48599822 learned_addr learned my addr 172.21.15.73:0/48599822 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5c9fe00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca00b2a00 0x7f5ca0155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d37e00640 1 -- start start 2024-04-15T15:31:55.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f388b600640 1 -- 172.21.15.73:0/2601914598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38840b8c40 msgr2=0x7f38840d3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f388b600640 1 --2- 172.21.15.73:0/2601914598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38840b8c40 0x7f38840d3530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3874009870 tx=0x7f387401c4e0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48e5e00640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48e015bea0 0x7f48e013b650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48d8022db0 tx=0x7f48d8021f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f388b600640 1 -- 172.21.15.73:0/2601914598 shutdown_connections 2024-04-15T15:31:55.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f388b600640 1 --2- 172.21.15.73:0/2601914598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38840b8c40 0x7f38840d3530 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f388b600640 1 -- 172.21.15.73:0/2601914598 >> 172.21.15.73:0/2601914598 conn(0x7f38840d4790 msgr2=0x7f38840d4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8348400640 1 Processor -- start 2024-04-15T15:31:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8348400640 1 -- start start 2024-04-15T15:31:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f031b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c0b30e0 0x7f031c14e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f031b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f031c0d0d60 0x7f031c0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f031b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f031c150f70 0x7f031c0b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca5a00640 1 -- 172.21.15.73:0/48599822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca00b2a00 msgr2=0x7f5ca0155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca5a00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca00b2a00 0x7f5ca0155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca5a00640 1 -- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca00ad8d0 msgr2=0x7f5ca014dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca5a00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca00ad8d0 0x7f5ca014dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca5a00640 1 -- 172.21.15.73:0/48599822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca014cd00 con 0x7f5ca015e930 2024-04-15T15:31:55.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48dd600640 1 -- 172.21.15.73:0/3024682118 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d80b9070 con 0x7f48e015bea0 2024-04-15T15:31:55.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5c9fe00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca00b2a00 0x7f5ca0155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f388b600640 1 -- 172.21.15.73:0/2601914598 shutdown_connections 2024-04-15T15:31:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f0319e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c0b30e0 0x7f031c14e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca5a00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca015e930 0x7f5ca0156820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800c6c0 tx=0x7f5c9800cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f0319e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c0b30e0 0x7f031c14e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51168/0 (socket says 172.21.15.73:51168) 2024-04-15T15:31:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f031b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f031c0ae270 con 0x7f031c0d0d60 2024-04-15T15:31:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f031b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f031c0ae0f0 con 0x7f031c0b30e0 2024-04-15T15:31:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f031b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f031c1672f0 con 0x7f031c150f70 2024-04-15T15:31:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5c9cc00640 1 -- 172.21.15.73:0/48599822 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98003b80 con 0x7f5ca015e930 2024-04-15T15:31:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5c9cc00640 1 -- 172.21.15.73:0/48599822 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c98003d40 con 0x7f5ca015e930 2024-04-15T15:31:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5c9cc00640 1 -- 172.21.15.73:0/48599822 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98005310 con 0x7f5ca015e930 2024-04-15T15:31:55.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48dd600640 1 -- 172.21.15.73:0/3024682118 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d80c6070 con 0x7f48e015bea0 2024-04-15T15:31:55.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48dd600640 1 -- 172.21.15.73:0/3024682118 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d80c0890 con 0x7f48e015bea0 2024-04-15T15:31:55.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f0319e00640 1 -- 172.21.15.73:0/1456043178 learned_addr learned my addr 172.21.15.73:0/1456043178 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca014cfe0 con 0x7f5ca015e930 2024-04-15T15:31:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f031a800640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f031c150f70 0x7f031c0b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f0319e00640 1 -- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f031c150f70 msgr2=0x7f031c0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f388b600640 1 -- 172.21.15.73:0/2601914598 wait complete. 2024-04-15T15:31:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f0319e00640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f031c150f70 0x7f031c0b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d37e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d3806f6e0 0x7f5d381655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d37e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d380c31f0 0x7f5d381594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d36a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d3806f6e0 0x7f5d381655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d36a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d3806f6e0 0x7f5d381655d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51178/0 (socket says 172.21.15.73:51178) 2024-04-15T15:31:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d37e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d38162e00 0x7f5d381600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d36a00640 1 -- 172.21.15.73:0/1178515127 learned_addr learned my addr 172.21.15.73:0/1178515127 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5d380af6d0 con 0x7f5d380c31f0 2024-04-15T15:31:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5d380af550 con 0x7f5d3806f6e0 2024-04-15T15:31:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5d380b3ff0 con 0x7f5d38162e00 2024-04-15T15:31:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f0319e00640 1 -- 172.21.15.73:0/1456043178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f031c0d0d60 msgr2=0x7f031c0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f0319e00640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f031c0d0d60 0x7f031c0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca014d5a0 con 0x7f5ca015e930 2024-04-15T15:31:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f0319e00640 1 -- 172.21.15.73:0/1456043178 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c1519a0 con 0x7f031c0b30e0 2024-04-15T15:31:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5d37400640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d38162e00 0x7f5d381600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e01f7460 con 0x7f48e015bea0 2024-04-15T15:31:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e0136fe0 con 0x7f48e015bea0 2024-04-15T15:31:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f7395e00640 1 -- 172.21.15.73:0/356190847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73900cdc60 msgr2=0x7f739006fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f7395e00640 1 --2- 172.21.15.73:0/356190847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73900cdc60 0x7f739006fc30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f73780097c0 tx=0x7f737801ecb0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8348400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340072520 0x7f8340148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8348400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83400cd4e0 0x7f83400cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8348400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f834015a850 0x7f83401591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8348400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f83401687a0 con 0x7f8340072520 2024-04-15T15:31:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8348400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8340168620 con 0x7f83400cd4e0 2024-04-15T15:31:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8348400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8340168920 con 0x7f834015a850 2024-04-15T15:31:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f031a800640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f031c150f70 0x7f031c0b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f3a7aa00640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a7c0b27c0 0x7f3a7c14e8c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800fa40 tx=0x7f3a6800ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ca014d970 con 0x7f5ca015e930 2024-04-15T15:31:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f0319e00640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c0b30e0 0x7f031c14e4d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f03040b8040 tx=0x7f0304021a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f7395e00640 1 -- 172.21.15.73:0/356190847 shutdown_connections 2024-04-15T15:31:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f7395e00640 1 --2- 172.21.15.73:0/356190847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73900cdc60 0x7f739006fc30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f7395e00640 1 --2- 172.21.15.73:0/356190847 >> v2:172.21.15.73:3300/0 conn(0x7f739015c940 0x7f739009b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f7395e00640 1 -- 172.21.15.73:0/356190847 >> 172.21.15.73:0/356190847 conn(0x7f73900b40c0 msgr2=0x7f73900b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8345000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83400cd4e0 0x7f83400cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8345000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83400cd4e0 0x7f83400cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51194/0 (socket says 172.21.15.73:51194) 2024-04-15T15:31:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.713+0000 7f8345000640 1 -- 172.21.15.73:0/2359218189 learned_addr learned my addr 172.21.15.73:0/2359218189 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d37400640 1 -- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d3806f6e0 msgr2=0x7f5d381655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d37400640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d3806f6e0 0x7f5d381655d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d37400640 1 -- 172.21.15.73:0/1178515127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d380c31f0 msgr2=0x7f5d381594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d37400640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d380c31f0 0x7f5d381594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48e0136b40 con 0x7f48e015bea0 2024-04-15T15:31:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d37400640 1 -- 172.21.15.73:0/1178515127 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d38160b00 con 0x7f5d38162e00 2024-04-15T15:31:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f7395e00640 1 -- 172.21.15.73:0/356190847 shutdown_connections 2024-04-15T15:31:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d36a00640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d3806f6e0 0x7f5d381655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f8345000640 1 -- 172.21.15.73:0/2359218189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f834015a850 msgr2=0x7f83401591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f8345000640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f834015a850 0x7f83401591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f8345000640 1 -- 172.21.15.73:0/2359218189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340072520 msgr2=0x7f8340148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f8345000640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340072520 0x7f8340148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f8345000640 1 -- 172.21.15.73:0/2359218189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834014f000 con 0x7f83400cd4e0 2024-04-15T15:31:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f0312a00640 1 -- 172.21.15.73:0/1456043178 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03040c5070 con 0x7f031c0b30e0 2024-04-15T15:31:55.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f0312a00640 1 -- 172.21.15.73:0/1456043178 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0304003a30 con 0x7f031c0b30e0 2024-04-15T15:31:55.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f0312a00640 1 -- 172.21.15.73:0/1456043178 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03040ba070 con 0x7f031c0b30e0 2024-04-15T15:31:55.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f8345000640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83400cd4e0 0x7f83400cf130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f832c00c520 tx=0x7f832c00c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f388b600640 1 Processor -- start 2024-04-15T15:31:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f3a72a00640 1 -- 172.21.15.73:0/2069075482 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6800dc10 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f3a72a00640 1 -- 172.21.15.73:0/2069075482 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6800ddb0 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f3a72a00640 1 -- 172.21.15.73:0/2069075482 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6801a680 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c151c80 con 0x7f031c0b30e0 2024-04-15T15:31:55.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c159210 con 0x7f031c0b30e0 2024-04-15T15:31:55.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d37400640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d38162e00 0x7f5d381600b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800d560 tx=0x7f5d2800da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f7395e00640 1 -- 172.21.15.73:0/356190847 wait complete. 2024-04-15T15:31:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f833d600640 1 -- 172.21.15.73:0/2359218189 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c017070 con 0x7f83400cd4e0 2024-04-15T15:31:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f833d600640 1 -- 172.21.15.73:0/2359218189 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c005480 con 0x7f83400cd4e0 2024-04-15T15:31:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f833d600640 1 -- 172.21.15.73:0/2359218189 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c003820 con 0x7f83400cd4e0 2024-04-15T15:31:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5c9cc00640 1 -- 172.21.15.73:0/48599822 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c980054b0 con 0x7f5ca015e930 2024-04-15T15:31:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5c9cc00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c84068380 0x7f5c8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5c9cc00640 1 -- 172.21.15.73:0/48599822 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5c98086c20 con 0x7f5ca015e930 2024-04-15T15:31:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5c9cc00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] conn(0x7f5c84071a70 0x7f5c84073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5c9cc00640 1 -- 172.21.15.73:0/48599822 --> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c98014e50 con 0x7f5c84071a70 2024-04-15T15:31:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5c9cc00640 1 -- 172.21.15.73:0/48599822 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5c9808b2a0 con 0x7f5ca015e930 2024-04-15T15:31:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a7c150e40 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a7c151400 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5ca5000640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c84068380 0x7f5c8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5c9fe00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] conn(0x7f5c84071a70 0x7f5c84073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f02f4001040 con 0x7f031c0b30e0 2024-04-15T15:31:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d2ea00640 1 -- 172.21.15.73:0/1178515127 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d280125f0 con 0x7f5d38162e00 2024-04-15T15:31:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d2ea00640 1 -- 172.21.15.73:0/1178515127 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d28019070 con 0x7f5d38162e00 2024-04-15T15:31:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d2ea00640 1 -- 172.21.15.73:0/1178515127 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d280129d0 con 0x7f5d38162e00 2024-04-15T15:31:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d38160de0 con 0x7f5d38162e00 2024-04-15T15:31:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d38164dd0 con 0x7f5d38162e00 2024-04-15T15:31:55.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.717+0000 7f48dd600640 1 -- 172.21.15.73:0/3024682118 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f48d80c0a30 con 0x7f48e015bea0 2024-04-15T15:31:55.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7395e00640 1 Processor -- start 2024-04-15T15:31:55.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3a7c068ab0 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7395e00640 1 -- start start 2024-04-15T15:31:55.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5d3804fd60 con 0x7f5d38162e00 2024-04-15T15:31:55.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f0312a00640 1 -- 172.21.15.73:0/1456043178 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f03040c8070 con 0x7f031c0b30e0 2024-04-15T15:31:55.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8340150ae0 con 0x7f83400cd4e0 2024-04-15T15:31:55.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8340148ec0 con 0x7f83400cd4e0 2024-04-15T15:31:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f5ca5000640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c84068380 0x7f5c8406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5c900ae000 tx=0x7f5c900046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f48dd600640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f48c00683d0 0x7f48c006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f388b600640 1 -- start start 2024-04-15T15:31:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f388b600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f388409dd00 0x7f388415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f388b600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38840b8c40 0x7f388406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f388b600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3884167030 0x7f388415b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f388b600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3884170c70 con 0x7f38840b8c40 2024-04-15T15:31:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f388b600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f38840d0f80 con 0x7f388409dd00 2024-04-15T15:31:55.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f388b600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3884170df0 con 0x7f3884167030 2024-04-15T15:31:55.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f48dd600640 1 -- 172.21.15.73:0/3024682118 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f48d812a680 con 0x7f48e015bea0 2024-04-15T15:31:55.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f48dd600640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] conn(0x7f48c0071b50 0x7f48c0073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f48dd600640 1 -- 172.21.15.73:0/3024682118 --> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48d8007e80 con 0x7f48c0071b50 2024-04-15T15:31:55.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f48dd600640 1 -- 172.21.15.73:0/3024682118 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f48d8131050 con 0x7f48e015bea0 2024-04-15T15:31:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f0312a00640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f02f8068450 0x7f02f806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f0312a00640 1 -- 172.21.15.73:0/1456043178 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f03041291e0 con 0x7f031c0b30e0 2024-04-15T15:31:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f0312a00640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] conn(0x7f02f8071bd0 0x7f02f8074010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f0312a00640 1 -- 172.21.15.73:0/1456043178 --> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03040c2ec0 con 0x7f02f8071bd0 2024-04-15T15:31:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f0312a00640 1 -- 172.21.15.73:0/1456043178 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0304130050 con 0x7f031c0b30e0 2024-04-15T15:31:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f3889600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3884167030 0x7f388415b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f3889600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3884167030 0x7f388415b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:57178/0 (socket says 172.21.15.73:57178) 2024-04-15T15:31:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f3889600640 1 -- 172.21.15.73:0/3510147310 learned_addr learned my addr 172.21.15.73:0/3510147310 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f0311400640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f02f8068450 0x7f02f806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7395e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7390070170 0x7f73900ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7395e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73900cdc60 0x7f73900ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7395e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f739015c940 0x7f73900d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7395e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f73900ce0c0 con 0x7f739015c940 2024-04-15T15:31:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7395e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f73900ce470 con 0x7f73900cdc60 2024-04-15T15:31:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7395e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7390150010 con 0x7f7390070170 2024-04-15T15:31:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f5c9fe00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] conn(0x7f5c84071a70 0x7f5c84073eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f031a800640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] conn(0x7f02f8071bd0 0x7f02f8074010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f48e5400640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f48c00683d0 0x7f48c006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f48e4a00640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] conn(0x7f48c0071b50 0x7f48c0073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7386000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73900cdc60 0x7f73900ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7386000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73900cdc60 0x7f73900ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51212/0 (socket says 172.21.15.73:51212) 2024-04-15T15:31:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f738ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7390070170 0x7f73900ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f7386000640 1 -- 172.21.15.73:0/2002163807 learned_addr learned my addr 172.21.15.73:0/2002163807 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f738f400640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f739015c940 0x7f73900d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8340150890 con 0x7f83400cd4e0 2024-04-15T15:31:55.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.721+0000 7f3888c00640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f388409dd00 0x7f388415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3a72a00640 1 -- 172.21.15.73:0/2069075482 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3a680059a0 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f48e4a00640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] conn(0x7f48c0071b50 0x7f48c0073f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f031a800640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] conn(0x7f02f8071bd0 0x7f02f8074010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f48e5400640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f48c00683d0 0x7f48c006a890 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f48d4005890 tx=0x7f48d4001160 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3a72a00640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3a5c068380 0x7f3a5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3a72a00640 1 -- 172.21.15.73:0/2069075482 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3a68087ac0 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3a72a00640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] conn(0x7f3a5c071a80 0x7f3a5c073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3a72a00640 1 -- 172.21.15.73:0/2069075482 --> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a5c074590 con 0x7f3a5c071a80 2024-04-15T15:31:55.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3a7a000640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3a5c068380 0x7f3a5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f5c9cc00640 1 -- 172.21.15.73:0/48599822 <== osd.2 v2:172.21.15.73:6816/81233902 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c98014e50 con 0x7f5c84071a70 2024-04-15T15:31:55.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7386000640 1 -- 172.21.15.73:0/2002163807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7390070170 msgr2=0x7f73900ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7386000640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7390070170 0x7f73900ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7386000640 1 -- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f739015c940 msgr2=0x7f73900d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7386000640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f739015c940 0x7f73900d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7386000640 1 -- 172.21.15.73:0/2002163807 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73901502f0 con 0x7f73900cdc60 2024-04-15T15:31:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7386000640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73900cdc60 0x7f73900ceb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f73780b3040 tx=0x7f737801ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3883e00640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38840b8c40 0x7f388406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3889600640 1 -- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f388409dd00 msgr2=0x7f388415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3889600640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f388409dd00 0x7f388415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3889600640 1 -- 172.21.15.73:0/3510147310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38840b8c40 msgr2=0x7f388406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3889600640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38840b8c40 0x7f388406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3889600640 1 -- 172.21.15.73:0/3510147310 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388415d990 con 0x7f3884167030 2024-04-15T15:31:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3889600640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3884167030 0x7f388415b400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f387401ab90 tx=0x7f3874019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3883e00640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38840b8c40 0x7f388406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f0311400640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f02f8068450 0x7f02f806a910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f030c007fd0 tx=0x7f030c007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f0312a00640 1 -- 172.21.15.73:0/1456043178 <== osd.7 v2:172.21.15.118:6824/2597178366 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f03040c2ec0 con 0x7f02f8071bd0 2024-04-15T15:31:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3880c00640 1 -- 172.21.15.73:0/3510147310 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38740b0050 con 0x7f3884167030 2024-04-15T15:31:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3880c00640 1 -- 172.21.15.73:0/3510147310 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38740bb070 con 0x7f3884167030 2024-04-15T15:31:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3880c00640 1 -- 172.21.15.73:0/3510147310 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38740b5840 con 0x7f3884167030 2024-04-15T15:31:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388415dc70 con 0x7f3884167030 2024-04-15T15:31:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f388406d160 con 0x7f3884167030 2024-04-15T15:31:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3a7b400640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] conn(0x7f3a5c071a80 0x7f3a5c073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f3a7a000640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3a5c068380 0x7f3a5c06a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c1f6810 tx=0x7f3a6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3a72a00640 1 -- 172.21.15.73:0/2069075482 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3a68053960 con 0x7f3a7c0b27c0 2024-04-15T15:31:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3a7b400640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] conn(0x7f3a5c071a80 0x7f3a5c073ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7387e00640 1 -- 172.21.15.73:0/2002163807 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73780bf070 con 0x7f73900cdc60 2024-04-15T15:31:55.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7387e00640 1 -- 172.21.15.73:0/2002163807 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73780b0840 con 0x7f73900cdc60 2024-04-15T15:31:55.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7387e00640 1 -- 172.21.15.73:0/2002163807 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73780b5040 con 0x7f73900cdc60 2024-04-15T15:31:55.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73901505d0 con 0x7f73900cdc60 2024-04-15T15:31:55.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7390150b90 con 0x7f73900cdc60 2024-04-15T15:31:55.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f833d600640 1 -- 172.21.15.73:0/2359218189 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f832c01a070 con 0x7f83400cd4e0 2024-04-15T15:31:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f5d2ea00640 1 -- 172.21.15.73:0/1178515127 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d28012b70 con 0x7f5d38162e00 2024-04-15T15:31:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f5d2ea00640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5d18068480 0x7f5d1806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f5d2ea00640 1 -- 172.21.15.73:0/1178515127 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5d28086f70 con 0x7f5d38162e00 2024-04-15T15:31:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f5d2ea00640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] conn(0x7f5d18071bf0 0x7f5d18074030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f5d2ea00640 1 -- 172.21.15.73:0/1178515127 --> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d28001d40 con 0x7f5d18071bf0 2024-04-15T15:31:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f5d2ea00640 1 -- 172.21.15.73:0/1178515127 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5d280895d0 con 0x7f5d38162e00 2024-04-15T15:31:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.725+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38840691c0 con 0x7f3884167030 2024-04-15T15:31:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3880c00640 1 -- 172.21.15.73:0/3510147310 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f38740b5bf0 con 0x7f3884167030 2024-04-15T15:31:55.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73900691c0 con 0x7f73900cdc60 2024-04-15T15:31:55.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f833d600640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8320068450 0x7f832006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f833d600640 1 -- 172.21.15.73:0/2359218189 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f832c0860a0 con 0x7f83400cd4e0 2024-04-15T15:31:55.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f833d600640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] conn(0x7f8320071bd0 0x7f8320074010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f833d600640 1 -- 172.21.15.73:0/2359218189 --> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f832c016ec0 con 0x7f8320071bd0 2024-04-15T15:31:55.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f833d600640 1 -- 172.21.15.73:0/2359218189 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f832c08d050 con 0x7f83400cd4e0 2024-04-15T15:31:55.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f5d36a00640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5d18068480 0x7f5d1806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f5d36000640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] conn(0x7f5d18071bf0 0x7f5d18074030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f48dd600640 1 -- 172.21.15.73:0/3024682118 <== osd.0 v2:172.21.15.73:6800/3735416960 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d8007e80 con 0x7f48c0071b50 2024-04-15T15:31:55.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3880c00640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3864068380 0x7f386406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3880c00640 1 -- 172.21.15.73:0/3510147310 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3874120e40 con 0x7f3884167030 2024-04-15T15:31:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3880c00640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] conn(0x7f3864071a80 0x7f3864073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3880c00640 1 -- 172.21.15.73:0/3510147310 --> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38740adec0 con 0x7f3864071a80 2024-04-15T15:31:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3880c00640 1 -- 172.21.15.73:0/3510147310 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3874123460 con 0x7f3884167030 2024-04-15T15:31:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3a72a00640 1 -- 172.21.15.73:0/2069075482 <== osd.1 v2:172.21.15.73:6824/721226997 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3a5c074590 con 0x7f3a5c071a80 2024-04-15T15:31:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f8346400640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] conn(0x7f8320071bd0 0x7f8320074010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f8345a00640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8320068450 0x7f832006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3888c00640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3864068380 0x7f386406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3883e00640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] conn(0x7f3864071a80 0x7f3864073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f7387e00640 1 -- 172.21.15.73:0/2002163807 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f73780c2070 con 0x7f73900cdc60 2024-04-15T15:31:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f5d36000640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] conn(0x7f5d18071bf0 0x7f5d18074030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f8346400640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] conn(0x7f8320071bd0 0x7f8320074010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f3888c00640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3864068380 0x7f386406a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3884162d20 tx=0x7f38700090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f7387e00640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f736c068400 0x7f736c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f7387e00640 1 -- 172.21.15.73:0/2002163807 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7378123650 con 0x7f73900cdc60 2024-04-15T15:31:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f738ea00640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f736c068400 0x7f736c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.729+0000 7f5d36a00640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5d18068480 0x7f5d1806a940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d30005c10 tx=0x7f5d30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f7387e00640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] conn(0x7f736c071b70 0x7f736c073fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f7387e00640 1 -- 172.21.15.73:0/2002163807 --> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73780c1e50 con 0x7f736c071b70 2024-04-15T15:31:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f7387e00640 1 -- 172.21.15.73:0/2002163807 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f737812a050 con 0x7f73900cdc60 2024-04-15T15:31:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f5d2ea00640 1 -- 172.21.15.73:0/1178515127 <== osd.5 v2:172.21.15.118:6800/3386675201 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5d28001d40 con 0x7f5d18071bf0 2024-04-15T15:31:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f8345a00640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8320068450 0x7f832006a910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f83400ccb80 tx=0x7f8334006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f833d600640 1 -- 172.21.15.73:0/2359218189 <== osd.4 v2:172.21.15.118:6809/2483912134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f832c016ec0 con 0x7f8320071bd0 2024-04-15T15:31:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f738f400640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] conn(0x7f736c071b70 0x7f736c073fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f738ea00640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f736c068400 0x7f736c06a8c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7380007a60 tx=0x7f7380008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f3883e00640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] conn(0x7f3864071a80 0x7f3864073ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f738f400640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] conn(0x7f736c071b70 0x7f736c073fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.733+0000 7f3880c00640 1 -- 172.21.15.73:0/3510147310 <== osd.6 v2:172.21.15.118:6808/1779259058 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38740adec0 con 0x7f3864071a80 2024-04-15T15:31:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.737+0000 7f7387e00640 1 -- 172.21.15.73:0/2002163807 <== osd.3 v2:172.21.15.73:6808/4025456322 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73780c1e50 con 0x7f736c071b70 2024-04-15T15:31:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.753+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 --> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ca0068ab0 con 0x7f5c84071a70 2024-04-15T15:31:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.757+0000 7f5c9cc00640 1 -- 172.21.15.73:0/48599822 <== osd.2 v2:172.21.15.73:6816/81233902 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ca0068ab0 con 0x7f5c84071a70 2024-04-15T15:31:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.757+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 --> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f02f4002de0 con 0x7f02f8071bd0 2024-04-15T15:31:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.757+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 --> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8340068ab0 con 0x7f8320071bd0 2024-04-15T15:31:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f0312a00640 1 -- 172.21.15.73:0/1456043178 <== osd.7 v2:172.21.15.118:6824/2597178366 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f02f4002de0 con 0x7f02f8071bd0 2024-04-15T15:31:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] conn(0x7f5c84071a70 msgr2=0x7f5c84073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca7a00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] conn(0x7f5c84071a70 0x7f5c84073eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c84068380 msgr2=0x7f5c8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca7a00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c84068380 0x7f5c8406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5c900ae000 tx=0x7f5c900046d0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca015e930 msgr2=0x7f5ca0156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca7a00640 1 --2- 172.21.15.73:0/48599822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca015e930 0x7f5ca0156820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800c6c0 tx=0x7f5c9800cb80 comp rx=0 tx=0).stop 2024-04-15T15:31:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca5a00640 1 -- 172.21.15.73:0/48599822 reap_dead start 2024-04-15T15:31:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 shutdown_connections 2024-04-15T15:31:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 >> 172.21.15.73:0/48599822 conn(0x7f5ca00d0540 msgr2=0x7f5ca00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f833d600640 1 -- 172.21.15.73:0/2359218189 <== osd.4 v2:172.21.15.118:6809/2483912134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8340068ab0 con 0x7f8320071bd0 2024-04-15T15:31:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 --> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3a7c158bd0 con 0x7f3a5c071a80 2024-04-15T15:31:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 shutdown_connections 2024-04-15T15:31:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5ca7a00640 1 -- 172.21.15.73:0/48599822 wait complete. 2024-04-15T15:31:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] conn(0x7f02f8071bd0 msgr2=0x7f02f8074010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031b200640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] conn(0x7f02f8071bd0 0x7f02f8074010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f02f8068450 msgr2=0x7f02f806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031b200640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f02f8068450 0x7f02f806a910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f030c007fd0 tx=0x7f030c007900 comp rx=0 tx=0).stop 2024-04-15T15:31:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c0b30e0 msgr2=0x7f031c14e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031b200640 1 --2- 172.21.15.73:0/1456043178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c0b30e0 0x7f031c14e4d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f03040b8040 tx=0x7f0304021a80 comp rx=0 tx=0).stop 2024-04-15T15:31:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 >> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] conn(0x7f8320071bd0 msgr2=0x7f8320074010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8348400640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] conn(0x7f8320071bd0 0x7f8320074010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031a800640 1 -- 172.21.15.73:0/1456043178 reap_dead start 2024-04-15T15:31:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 shutdown_connections 2024-04-15T15:31:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 >> 172.21.15.73:0/1456043178 conn(0x7f031c06be50 msgr2=0x7f031c0d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8320068450 msgr2=0x7f832006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8348400640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8320068450 0x7f832006a910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f83400ccb80 tx=0x7f8334006bb0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83400cd4e0 msgr2=0x7f83400cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8348400640 1 --2- 172.21.15.73:0/2359218189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83400cd4e0 0x7f83400cf130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f832c00c520 tx=0x7f832c00c9e0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 --> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5d380c39a0 con 0x7f5d18071bf0 2024-04-15T15:31:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8346400640 1 -- 172.21.15.73:0/2359218189 reap_dead start 2024-04-15T15:31:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 shutdown_connections 2024-04-15T15:31:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f031b200640 1 -- 172.21.15.73:0/1456043178 wait complete. 2024-04-15T15:31:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f3a72a00640 1 -- 172.21.15.73:0/2069075482 <== osd.1 v2:172.21.15.73:6824/721226997 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3a7c158bd0 con 0x7f3a5c071a80 2024-04-15T15:31:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 shutdown_connections 2024-04-15T15:31:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 --> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f48e004fd60 con 0x7f48c0071b50 2024-04-15T15:31:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 >> 172.21.15.73:0/2359218189 conn(0x7f83400d0540 msgr2=0x7f83400b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d2ea00640 1 -- 172.21.15.73:0/1178515127 <== osd.5 v2:172.21.15.118:6800/3386675201 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5d380c39a0 con 0x7f5d18071bf0 2024-04-15T15:31:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 shutdown_connections 2024-04-15T15:31:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] conn(0x7f3a5c071a80 msgr2=0x7f3a5c073ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f3a81600640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] conn(0x7f3a5c071a80 0x7f3a5c073ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f8348400640 1 -- 172.21.15.73:0/2359218189 wait complete. 2024-04-15T15:31:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f48dd600640 1 -- 172.21.15.73:0/3024682118 <== osd.0 v2:172.21.15.73:6800/3735416960 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f48e004fd60 con 0x7f48c0071b50 2024-04-15T15:31:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3a5c068380 msgr2=0x7f3a5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f3a81600640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3a5c068380 0x7f3a5c06a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c1f6810 tx=0x7f3a6c008040 comp rx=0 tx=0).stop 2024-04-15T15:31:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a7c0b27c0 msgr2=0x7f3a7c14e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f3a81600640 1 --2- 172.21.15.73:0/2069075482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a7c0b27c0 0x7f3a7c14e8c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800fa40 tx=0x7f3a6800ff00 comp rx=0 tx=0).stop 2024-04-15T15:31:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] conn(0x7f5d18071bf0 msgr2=0x7f5d18074030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d37e00640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] conn(0x7f5d18071bf0 0x7f5d18074030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5d18068480 msgr2=0x7f5d1806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d37e00640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5d18068480 0x7f5d1806a940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d30005c10 tx=0x7f5d30009040 comp rx=0 tx=0).stop 2024-04-15T15:31:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d38162e00 msgr2=0x7f5d381600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d37e00640 1 --2- 172.21.15.73:0/1178515127 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d38162e00 0x7f5d381600b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800d560 tx=0x7f5d2800da20 comp rx=0 tx=0).stop 2024-04-15T15:31:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f3a7b400640 1 -- 172.21.15.73:0/2069075482 reap_dead start 2024-04-15T15:31:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 shutdown_connections 2024-04-15T15:31:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 >> 172.21.15.73:0/2069075482 conn(0x7f3a7c067dd0 msgr2=0x7f3a7c071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d37400640 1 -- 172.21.15.73:0/1178515127 reap_dead start 2024-04-15T15:31:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 shutdown_connections 2024-04-15T15:31:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.761+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 >> 172.21.15.73:0/1178515127 conn(0x7f5d3806bc20 msgr2=0x7f5d380ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 shutdown_connections 2024-04-15T15:31:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 shutdown_connections 2024-04-15T15:31:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f3a81600640 1 -- 172.21.15.73:0/2069075482 wait complete. 2024-04-15T15:31:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f5d37e00640 1 -- 172.21.15.73:0/1178515127 wait complete. 2024-04-15T15:31:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 --> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7390150d60 con 0x7f736c071b70 2024-04-15T15:31:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 --> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f38841657a0 con 0x7f3864071a80 2024-04-15T15:31:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] conn(0x7f48c0071b50 msgr2=0x7f48c0073f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f48e6800640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] conn(0x7f48c0071b50 0x7f48c0073f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f3880c00640 1 -- 172.21.15.73:0/3510147310 <== osd.6 v2:172.21.15.118:6808/1779259058 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f38841657a0 con 0x7f3864071a80 2024-04-15T15:31:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] conn(0x7f3864071a80 msgr2=0x7f3864073ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.765+0000 7f388b600640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] conn(0x7f3864071a80 0x7f3864073ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f7387e00640 1 -- 172.21.15.73:0/2002163807 <== osd.3 v2:172.21.15.73:6808/4025456322 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7390150d60 con 0x7f736c071b70 2024-04-15T15:31:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f48c00683d0 msgr2=0x7f48c006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f48e6800640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f48c00683d0 0x7f48c006a890 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f48d4005890 tx=0x7f48d4001160 comp rx=0 tx=0).stop 2024-04-15T15:31:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48e015bea0 msgr2=0x7f48e013b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f48e6800640 1 --2- 172.21.15.73:0/3024682118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48e015bea0 0x7f48e013b650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48d8022db0 tx=0x7f48d8021f20 comp rx=0 tx=0).stop 2024-04-15T15:31:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f48e5e00640 1 -- 172.21.15.73:0/3024682118 reap_dead start 2024-04-15T15:31:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3864068380 msgr2=0x7f386406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f388b600640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3864068380 0x7f386406a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3884162d20 tx=0x7f38700090e0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3884167030 msgr2=0x7f388415b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f388b600640 1 --2- 172.21.15.73:0/3510147310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3884167030 0x7f388415b400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f387401ab90 tx=0x7f3874019280 comp rx=0 tx=0).stop 2024-04-15T15:31:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f3889600640 1 -- 172.21.15.73:0/3510147310 reap_dead start 2024-04-15T15:31:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] conn(0x7f736c071b70 msgr2=0x7f736c073fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f7395e00640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] conn(0x7f736c071b70 0x7f736c073fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f736c068400 msgr2=0x7f736c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f7395e00640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f736c068400 0x7f736c06a8c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7380007a60 tx=0x7f7380008040 comp rx=0 tx=0).stop 2024-04-15T15:31:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73900cdc60 msgr2=0x7f73900ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f7395e00640 1 --2- 172.21.15.73:0/2002163807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73900cdc60 0x7f73900ceb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f73780b3040 tx=0x7f737801ba50 comp rx=0 tx=0).stop 2024-04-15T15:31:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f738f400640 1 -- 172.21.15.73:0/2002163807 reap_dead start 2024-04-15T15:31:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 shutdown_connections 2024-04-15T15:31:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.769+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 >> 172.21.15.73:0/2002163807 conn(0x7f73900b40c0 msgr2=0x7f73900af240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.773+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 shutdown_connections 2024-04-15T15:31:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.773+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 >> 172.21.15.73:0/3510147310 conn(0x7f38840d4790 msgr2=0x7f38840cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.773+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 shutdown_connections 2024-04-15T15:31:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.773+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 >> 172.21.15.73:0/3024682118 conn(0x7f48e0072370 msgr2=0x7f48e00cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.773+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 shutdown_connections 2024-04-15T15:31:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.773+0000 7f388b600640 1 -- 172.21.15.73:0/3510147310 wait complete. 2024-04-15T15:31:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.773+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 shutdown_connections 2024-04-15T15:31:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.773+0000 7f48e6800640 1 -- 172.21.15.73:0/3024682118 wait complete. 2024-04-15T15:31:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.773+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 shutdown_connections 2024-04-15T15:31:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:55.773+0000 7f7395e00640 1 -- 172.21.15.73:0/2002163807 wait complete. 2024-04-15T15:31:55.815 INFO:teuthology.orchestra.run.smithi073.stdout:55834574859 2024-04-15T15:31:55.816 INFO:teuthology.orchestra.run.smithi073.stdout:55834574858 2024-04-15T15:31:55.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-15T15:31:55.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-15T15:31:55.818 INFO:teuthology.orchestra.run.smithi073.stdout:55834574860 2024-04-15T15:31:55.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T15:31:55.819 INFO:teuthology.orchestra.run.smithi073.stdout:55834574857 2024-04-15T15:31:55.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-15T15:31:55.820 INFO:teuthology.orchestra.run.smithi073.stdout:55834574858 2024-04-15T15:31:55.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-15T15:31:55.821 INFO:teuthology.orchestra.run.smithi073.stdout:55834574858 2024-04-15T15:31:55.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T15:31:55.822 INFO:teuthology.orchestra.run.smithi073.stdout:55834574857 2024-04-15T15:31:55.822 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-15T15:31:55.823 INFO:teuthology.orchestra.run.smithi073.stdout:55834574860 2024-04-15T15:31:55.823 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-15T15:31:56.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.097+0000 7feb68600640 1 Processor -- start 2024-04-15T15:31:56.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb68600640 1 -- start start 2024-04-15T15:31:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb68600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feb58050f10 0x7feb58005ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb68600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb5803a610 0x7feb5804bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb68600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb58006640 con 0x7feb580e1250 2024-04-15T15:31:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb68600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7feb58006410 con 0x7feb58050f10 2024-04-15T15:31:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb68600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7feb58038ac0 con 0x7feb5803a610 2024-04-15T15:31:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb65200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feb58050f10 0x7feb58005ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb65c00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7feb580e1250 0x7feb58039f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:53436/0 (socket says 172.21.15.73:53436) 2024-04-15T15:31:56.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb65c00640 1 -- 172.21.15.73:0/3274183145 learned_addr learned my addr 172.21.15.73:0/3274183145 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:56.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb65200640 1 -- 172.21.15.73:0/3274183145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb5803a610 msgr2=0x7feb5804bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:56.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb65200640 1 --2- 172.21.15.73:0/3274183145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb5803a610 0x7feb5804bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb65200640 1 -- 172.21.15.73:0/3274183145 >> v1:172.21.15.118:6789/0 conn(0x7feb580e1250 legacy=0x7feb58039f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.101+0000 7feb65200640 1 -- 172.21.15.73:0/3274183145 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb58006920 con 0x7feb58050f10 2024-04-15T15:31:56.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.105+0000 7f8e27e00640 1 Processor -- start 2024-04-15T15:31:56.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.105+0000 7f8e27e00640 1 -- start start 2024-04-15T15:31:56.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.105+0000 7f8e27e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8e2815a7b0 0x7f8e28072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.105+0000 7f8e27e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e2815ab90 0x7f8e28073520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.105+0000 7f8e27e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e280b1b80 con 0x7f8e280af730 2024-04-15T15:31:56.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.105+0000 7f8e27e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8e280ce120 con 0x7f8e2815ab90 2024-04-15T15:31:56.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.105+0000 7f8e27e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f8e280ce400 con 0x7f8e2815a7b0 2024-04-15T15:31:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.105+0000 7f8e27400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8e280af730 0x7f8e2815e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:53452/0 (socket says 172.21.15.73:53452) 2024-04-15T15:31:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f8e27400640 1 -- 172.21.15.73:0/3585165806 learned_addr learned my addr 172.21.15.73:0/3585165806 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f8e26000640 1 --2- 172.21.15.73:0/3585165806 >> v2:172.21.15.73:3300/0 conn(0x7f8e2815ab90 0x7f8e28073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f8e26a00640 1 --2- 172.21.15.73:0/3585165806 >> v2:172.21.15.118:3300/0 conn(0x7f8e2815a7b0 0x7f8e28072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f8e25600640 1 -- 172.21.15.73:0/3585165806 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506988090 0 0) 0x7f8e280b1b80 con 0x7f8e280af730 2024-04-15T15:31:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f8e25600640 1 -- 172.21.15.73:0/3585165806 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e0c003530 con 0x7f8e280af730 2024-04-15T15:31:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7feb65200640 1 --2- 172.21.15.73:0/3274183145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb58050f10 0x7feb58005ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb60065590 tx=0x7feb60097ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de657dbfb8b30e1d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7feb5fe00640 1 -- 172.21.15.73:0/3274183145 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60120c40 con 0x7feb58050f10 2024-04-15T15:31:56.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7feb5fe00640 1 -- 172.21.15.73:0/3274183145 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb60120e20 con 0x7feb58050f10 2024-04-15T15:31:56.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f5645200640 1 Processor -- start 2024-04-15T15:31:56.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f5645200640 1 -- start start 2024-04-15T15:31:56.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f5645200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5638050270 0x7f56380530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7feb68600640 1 -- 172.21.15.73:0/3274183145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb58050f10 msgr2=0x7feb58005ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7feb68600640 1 --2- 172.21.15.73:0/3274183145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb58050f10 0x7feb58005ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb60065590 tx=0x7feb60097ea0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f563de00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f56380df1a0 0x7f563804fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:53458/0 (socket says 172.21.15.73:53458) 2024-04-15T15:31:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f563de00640 1 -- 172.21.15.73:0/291116065 learned_addr learned my addr 172.21.15.73:0/291116065 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f563d400640 1 --2- 172.21.15.73:0/291116065 >> v2:172.21.15.118:3300/0 conn(0x7f5638050270 0x7f56380530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f5645200640 1 -- 172.21.15.73:0/291116065 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56380537e0 con 0x7f56380e2d80 2024-04-15T15:31:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f8e26000640 1 -- 172.21.15.73:0/3585165806 >> v2:172.21.15.118:3300/0 conn(0x7f8e2815a7b0 msgr2=0x7f8e28072fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f8e26000640 1 --2- 172.21.15.73:0/3585165806 >> v2:172.21.15.118:3300/0 conn(0x7f8e2815a7b0 0x7f8e28072fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f8e26000640 1 -- 172.21.15.73:0/3585165806 >> v1:172.21.15.118:6789/0 conn(0x7f8e280af730 legacy=0x7f8e2815e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7f8e26000640 1 -- 172.21.15.73:0/3585165806 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e280ce6e0 con 0x7f8e2815ab90 2024-04-15T15:31:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7feb68600640 1 -- 172.21.15.73:0/3274183145 shutdown_connections 2024-04-15T15:31:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7feb68600640 1 --2- 172.21.15.73:0/3274183145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb5803a610 0x7feb5804bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7feb68600640 1 --2- 172.21.15.73:0/3274183145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb58050f10 0x7feb58005ed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.109+0000 7feb68600640 1 -- 172.21.15.73:0/3274183145 >> 172.21.15.73:0/3274183145 conn(0x7feb58054b00 msgr2=0x7feb58054f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7feb68600640 1 -- 172.21.15.73:0/3274183145 shutdown_connections 2024-04-15T15:31:56.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7feb68600640 1 -- 172.21.15.73:0/3274183145 wait complete. 2024-04-15T15:31:56.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f5645200640 1 -- 172.21.15.73:0/291116065 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5638053ac0 con 0x7f56380df1a0 2024-04-15T15:31:56.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f5645200640 1 -- 172.21.15.73:0/291116065 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f5638054880 con 0x7f5638050270 2024-04-15T15:31:56.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f563d400640 1 -- 172.21.15.73:0/291116065 >> v1:172.21.15.118:6789/0 conn(0x7f56380df1a0 legacy=0x7f563804fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f563d400640 1 -- 172.21.15.73:0/291116065 >> v1:172.21.15.73:6789/0 conn(0x7f56380e2d80 legacy=0x7f5638005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f563d400640 1 -- 172.21.15.73:0/291116065 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5638053da0 con 0x7f5638050270 2024-04-15T15:31:56.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f8e26000640 1 --2- 172.21.15.73:0/3585165806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e2815ab90 0x7f8e28073520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8e28074710 tx=0x7f8e1401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c49853a2ca2110 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f1f08e00640 1 Processor -- start 2024-04-15T15:31:56.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f8e25600640 1 -- 172.21.15.73:0/3585165806 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e140b0070 con 0x7f8e2815ab90 2024-04-15T15:31:56.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7feb68600640 1 Processor -- start 2024-04-15T15:31:56.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f8e25600640 1 -- 172.21.15.73:0/3585165806 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e140ab600 con 0x7f8e2815ab90 2024-04-15T15:31:56.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f1f08e00640 1 -- start start 2024-04-15T15:31:56.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7feb68600640 1 -- start start 2024-04-15T15:31:56.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7fa9a5c00640 1 Processor -- start 2024-04-15T15:31:56.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f1f08e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1f04162a80 0x7f1f040b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f1f08e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f040b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f1f08e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f0406e970 con 0x7f1f0406fbd0 2024-04-15T15:31:56.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f1f08e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f1f040b47e0 con 0x7f1f04162a80 2024-04-15T15:31:56.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.113+0000 7f1f08e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1f04163570 con 0x7f1f040b3e30 2024-04-15T15:31:56.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa9a5c00640 1 -- start start 2024-04-15T15:31:56.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f8e25600640 1 -- 172.21.15.73:0/3585165806 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e140ab9b0 con 0x7f8e2815ab90 2024-04-15T15:31:56.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f8e27e00640 1 -- 172.21.15.73:0/3585165806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e2815ab90 msgr2=0x7f8e28073520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f8e27e00640 1 --2- 172.21.15.73:0/3585165806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e2815ab90 0x7f8e28073520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8e28074710 tx=0x7f8e1401c4c0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f8e27e00640 1 -- 172.21.15.73:0/3585165806 shutdown_connections 2024-04-15T15:31:56.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f8e27e00640 1 --2- 172.21.15.73:0/3585165806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e2815ab90 0x7f8e28073520 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f8e27e00640 1 --2- 172.21.15.73:0/3585165806 >> v2:172.21.15.118:3300/0 conn(0x7f8e2815a7b0 0x7f8e28072fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f8e27e00640 1 -- 172.21.15.73:0/3585165806 >> 172.21.15.73:0/3585165806 conn(0x7f8e280d0220 msgr2=0x7f8e280d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f8e27e00640 1 -- 172.21.15.73:0/3585165806 shutdown_connections 2024-04-15T15:31:56.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f8e27e00640 1 -- 172.21.15.73:0/3585165806 wait complete. 2024-04-15T15:31:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb68600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb5803a610 0x7feb580cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb68600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb58050f10 0x7feb580da6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb68600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb580e1250 0x7feb580dac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f9203200640 1 Processor -- start 2024-04-15T15:31:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f9203200640 1 -- start start 2024-04-15T15:31:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f1f02800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f040b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f1f02800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f040b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:57222/0 (socket says 172.21.15.73:57222) 2024-04-15T15:31:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f1f02800640 1 -- 172.21.15.73:0/1804000652 learned_addr learned my addr 172.21.15.73:0/1804000652 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f1f01e00640 1 --2- 172.21.15.73:0/1804000652 >> v2:172.21.15.118:3300/0 conn(0x7f1f04162a80 0x7f1f040b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa9a5c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a00b2120 0x7fa9a00cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb68600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feb58007860 con 0x7feb5803a610 2024-04-15T15:31:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb68600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7feb580076e0 con 0x7feb58050f10 2024-04-15T15:31:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb68600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7feb5804c920 con 0x7feb580e1250 2024-04-15T15:31:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb65200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb58050f10 0x7feb580da6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb65200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb58050f10 0x7feb580da6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51238/0 (socket says 172.21.15.73:51238) 2024-04-15T15:31:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb65200640 1 -- 172.21.15.73:0/243926321 learned_addr learned my addr 172.21.15.73:0/243926321 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb66600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb580e1250 0x7feb580dac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa9a5c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa9a0072520 0x7fa9a00b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa9a5c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9a006deb0 con 0x7fa9a00b3e30 2024-04-15T15:31:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa9a5c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa9a00b55f0 con 0x7fa9a0072520 2024-04-15T15:31:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa9a5c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a00b4290 con 0x7fa9a00b2120 2024-04-15T15:31:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb65c00640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb5803a610 0x7feb580cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f1f00a00640 1 -- 172.21.15.73:0/1804000652 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804519060 0 0) 0x7f1f0406e970 con 0x7f1f0406fbd0 2024-04-15T15:31:56.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f1f00a00640 1 -- 172.21.15.73:0/1804000652 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ee8003530 con 0x7f1f0406fbd0 2024-04-15T15:31:56.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa99e000640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa9a00b3e30 0x7fa9a0071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:53472/0 (socket says 172.21.15.73:53472) 2024-04-15T15:31:56.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f563d400640 1 --2- 172.21.15.73:0/291116065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5638050270 0x7f56380530e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f562c0097f0 tx=0x7f562c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce912787fd3369b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb66600640 1 -- 172.21.15.73:0/243926321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb58050f10 msgr2=0x7feb580da6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb66600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb58050f10 0x7feb580da6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb66600640 1 -- 172.21.15.73:0/243926321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb5803a610 msgr2=0x7feb580cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb66600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb5803a610 0x7feb580cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb66600640 1 -- 172.21.15.73:0/243926321 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb580d98f0 con 0x7feb580e1250 2024-04-15T15:31:56.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa99e000640 1 -- 172.21.15.73:0/4063687174 learned_addr learned my addr 172.21.15.73:0/4063687174 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:56.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa99ea00640 1 --2- 172.21.15.73:0/4063687174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a00b2120 0x7fa9a00cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f9203200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7feb66600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb580e1250 0x7feb580dac30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feb5400b3e0 tx=0x7feb54009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa99f400640 1 --2- 172.21.15.73:0/4063687174 >> v2:172.21.15.118:3300/0 conn(0x7fa9a0072520 0x7fa9a00b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7fa99ea00640 1 -- 172.21.15.73:0/4063687174 >> v2:172.21.15.118:3300/0 conn(0x7fa9a0072520 msgr2=0x7fa9a00b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:56.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f9203200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91fc072350 0x7f91fc166920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f91fbe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f91fbe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc071e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:57248/0 (socket says 172.21.15.73:57248) 2024-04-15T15:31:56.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f563ca00640 1 -- 172.21.15.73:0/291116065 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c0b0070 con 0x7f5638050270 2024-04-15T15:31:56.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f563ca00640 1 -- 172.21.15.73:0/291116065 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562c0ab600 con 0x7f5638050270 2024-04-15T15:31:56.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7feb5d600640 1 -- 172.21.15.73:0/243926321 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54015020 con 0x7feb580e1250 2024-04-15T15:31:56.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f1f02800640 1 -- 172.21.15.73:0/1804000652 >> v2:172.21.15.118:3300/0 conn(0x7f1f04162a80 msgr2=0x7f1f040b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:56.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f1f02800640 1 --2- 172.21.15.73:0/1804000652 >> v2:172.21.15.118:3300/0 conn(0x7f1f04162a80 0x7f1f040b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f1f02800640 1 -- 172.21.15.73:0/1804000652 >> v1:172.21.15.118:6789/0 conn(0x7f1f0406fbd0 legacy=0x7f1f04162e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.117+0000 7f1f02800640 1 -- 172.21.15.73:0/1804000652 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0406ec50 con 0x7f1f040b3e30 2024-04-15T15:31:56.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f563ca00640 1 -- 172.21.15.73:0/291116065 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c0ab9d0 con 0x7f5638050270 2024-04-15T15:31:56.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7feb5d600640 1 -- 172.21.15.73:0/243926321 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb54011830 con 0x7feb580e1250 2024-04-15T15:31:56.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f91fbe00640 1 -- 172.21.15.73:0/749667769 learned_addr learned my addr 172.21.15.73:0/749667769 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7fa99d600640 1 -- 172.21.15.73:0/4063687174 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990593686 0 0) 0x7fa9a006deb0 con 0x7fa9a00b3e30 2024-04-15T15:31:56.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7feb5d600640 1 -- 172.21.15.73:0/243926321 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54011c00 con 0x7feb580e1250 2024-04-15T15:31:56.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7fd13d000640 1 Processor -- start 2024-04-15T15:31:56.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f8e27e00640 1 Processor -- start 2024-04-15T15:31:56.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7feb68600640 1 -- 172.21.15.73:0/243926321 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb580ccbc0 con 0x7feb580e1250 2024-04-15T15:31:56.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7feb68600640 1 -- 172.21.15.73:0/243926321 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb580ddc70 con 0x7feb580e1250 2024-04-15T15:31:56.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f9203200640 1 -- 172.21.15.73:0/749667769 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91fc167610 con 0x7f91fc166e60 2024-04-15T15:31:56.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f9203200640 1 -- 172.21.15.73:0/749667769 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f91fc0727b0 con 0x7f91fc072350 2024-04-15T15:31:56.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f9203200640 1 -- 172.21.15.73:0/749667769 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f91fc0b4a00 con 0x7f91fc15d250 2024-04-15T15:31:56.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f91fb400640 1 --2- 172.21.15.73:0/749667769 >> v2:172.21.15.73:3300/0 conn(0x7f91fc072350 0x7f91fc166920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7fa99ea00640 1 --2- 172.21.15.73:0/4063687174 >> v2:172.21.15.118:3300/0 conn(0x7fa9a0072520 0x7fa9a00b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7fa99ea00640 1 -- 172.21.15.73:0/4063687174 >> v1:172.21.15.118:6789/0 conn(0x7fa9a00b3e30 legacy=0x7fa9a0071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7fa99ea00640 1 -- 172.21.15.73:0/4063687174 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a006e190 con 0x7fa9a00b2120 2024-04-15T15:31:56.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f5645200640 1 -- 172.21.15.73:0/291116065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5638050270 msgr2=0x7f56380530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f5645200640 1 --2- 172.21.15.73:0/291116065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5638050270 0x7f56380530e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f562c0097f0 tx=0x7f562c01c410 comp rx=0 tx=0).stop 2024-04-15T15:31:56.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f5645200640 1 -- 172.21.15.73:0/291116065 shutdown_connections 2024-04-15T15:31:56.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f5645200640 1 --2- 172.21.15.73:0/291116065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5638050270 0x7f56380530e0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f562c0097f0 tx=0x7f562c01c410 comp rx=0 tx=0).stop 2024-04-15T15:31:56.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f5645200640 1 -- 172.21.15.73:0/291116065 >> 172.21.15.73:0/291116065 conn(0x7f5638054b00 msgr2=0x7f5638054f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7fa99f400640 1 --2- 172.21.15.73:0/4063687174 >> v2:172.21.15.118:3300/0 conn(0x7fa9a0072520 0x7fa9a00b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:56.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f8e27e00640 1 -- start start 2024-04-15T15:31:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f91fb400640 1 -- 172.21.15.73:0/749667769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 msgr2=0x7f91fc071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:56.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7feb68600640 1 -- 172.21.15.73:0/243926321 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb580d9720 con 0x7feb580e1250 2024-04-15T15:31:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f91fb400640 1 --2- 172.21.15.73:0/749667769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f91fb400640 1 -- 172.21.15.73:0/749667769 >> v1:172.21.15.73:6789/0 conn(0x7f91fc166e60 legacy=0x7f91fc06e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f91fb400640 1 -- 172.21.15.73:0/749667769 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc0b4c50 con 0x7f91fc072350 2024-04-15T15:31:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f91faa00640 1 -- 172.21.15.73:0/749667769 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647040386 0 0) 0x7f91fc167610 con 0x7f91fc166e60 2024-04-15T15:31:56.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f91fbe00640 1 --2- 172.21.15.73:0/749667769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f8e27e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e280af730 0x7f8e280cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f8e27e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e2815a7b0 0x7f8e280b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f8e27e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e2815ab90 0x7f8e2806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7fd13d000640 1 -- start start 2024-04-15T15:31:56.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f8e27e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280ceb40 con 0x7f8e280af730 2024-04-15T15:31:56.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7feb5d600640 1 -- 172.21.15.73:0/243926321 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb54018020 con 0x7feb580e1250 2024-04-15T15:31:56.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7fd13d000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd138162a80 0x7fd1380b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f5645200640 1 -- 172.21.15.73:0/291116065 shutdown_connections 2024-04-15T15:31:56.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f5645200640 1 -- 172.21.15.73:0/291116065 wait complete. 2024-04-15T15:31:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7f8e26000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e2815a7b0 0x7f8e280b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e2815ab90 0x7f8e2806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e2815ab90 0x7f8e2806ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51244/0 (socket says 172.21.15.73:51244) 2024-04-15T15:31:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27400640 1 -- 172.21.15.73:0/3647350702 learned_addr learned my addr 172.21.15.73:0/3647350702 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e26a00640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e280af730 0x7f8e280cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280ce9c0 con 0x7f8e2815ab90 2024-04-15T15:31:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8e280ca870 con 0x7f8e2815a7b0 2024-04-15T15:31:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.121+0000 7fd13d000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd1380b3e30 0x7fd1380b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd13d000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd13806e970 con 0x7fd13806fbd0 2024-04-15T15:31:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd13d000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd138163570 con 0x7fd138162a80 2024-04-15T15:31:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd13d000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd1380b47a0 con 0x7fd1380b3e30 2024-04-15T15:31:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd135e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd138162a80 0x7fd1380b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd135e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd138162a80 0x7fd1380b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45484/0 (socket says 172.21.15.73:45484) 2024-04-15T15:31:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd135e00640 1 -- 172.21.15.73:0/2742810888 learned_addr learned my addr 172.21.15.73:0/2742810888 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27400640 1 -- 172.21.15.73:0/3647350702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e2815a7b0 msgr2=0x7f8e280b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27400640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e2815a7b0 0x7f8e280b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27400640 1 -- 172.21.15.73:0/3647350702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e280af730 msgr2=0x7f8e280cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27400640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e280af730 0x7f8e280cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27400640 1 -- 172.21.15.73:0/3647350702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e280b5bf0 con 0x7f8e2815ab90 2024-04-15T15:31:56.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7feb5d600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feb40068450 0x7feb4006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd136800640 1 --2- 172.21.15.73:0/2742810888 >> v2:172.21.15.118:3300/0 conn(0x7fd1380b3e30 0x7fd1380b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd135e00640 1 -- 172.21.15.73:0/2742810888 >> v2:172.21.15.118:3300/0 conn(0x7fd1380b3e30 msgr2=0x7fd1380b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:56.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd135e00640 1 --2- 172.21.15.73:0/2742810888 >> v2:172.21.15.118:3300/0 conn(0x7fd1380b3e30 0x7fd1380b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd135e00640 1 -- 172.21.15.73:0/2742810888 >> v1:172.21.15.118:6789/0 conn(0x7fd13806fbd0 legacy=0x7fd138162e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-15T15:31:56.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27400640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e2815ab90 0x7f8e2806ef40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c450 tx=0x7f8e1800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd135e00640 1 -- 172.21.15.73:0/2742810888 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13806ec50 con 0x7fd138162a80 2024-04-15T15:31:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fd136800640 1 --2- 172.21.15.73:0/2742810888 >> v2:172.21.15.118:3300/0 conn(0x7fd1380b3e30 0x7fd1380b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e1ea00640 1 -- 172.21.15.73:0/3647350702 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18017070 con 0x7f8e2815ab90 2024-04-15T15:31:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e280c7390 con 0x7f8e2815ab90 2024-04-15T15:31:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f35e6c00640 1 Processor -- start 2024-04-15T15:31:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f5645200640 1 Processor -- start 2024-04-15T15:31:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e280b5ed0 con 0x7f8e2815ab90 2024-04-15T15:31:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e1ea00640 1 -- 172.21.15.73:0/3647350702 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e18005cf0 con 0x7f8e2815ab90 2024-04-15T15:31:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e1ea00640 1 -- 172.21.15.73:0/3647350702 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18017070 con 0x7f8e2815ab90 2024-04-15T15:31:56.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7feb65c00640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feb40068450 0x7feb4006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7feb5d600640 1 -- 172.21.15.73:0/243926321 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb54086ba0 con 0x7feb580e1250 2024-04-15T15:31:56.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7feb65c00640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feb40068450 0x7feb4006a910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb4c005890 tx=0x7feb4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7fa99ea00640 1 --2- 172.21.15.73:0/4063687174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a00b2120 0x7fa9a00cd4e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa9880097c0 tx=0x7fa98801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ffe2db2d0dec1c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f35e6c00640 1 -- start start 2024-04-15T15:31:56.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f5645200640 1 -- start start 2024-04-15T15:31:56.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f91fb400640 1 --2- 172.21.15.73:0/749667769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91fc072350 0x7f91fc166920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009d90 tx=0x7f91f401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ab86547354ca14 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.125+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e000052a0 con 0x7f8e2815ab90 2024-04-15T15:31:56.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f1f02800640 1 --2- 172.21.15.73:0/1804000652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f040b42a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009870 tx=0x7f1ef401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d92210e632824558 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f91faa00640 1 -- 172.21.15.73:0/749667769 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f40b2070 con 0x7f91fc072350 2024-04-15T15:31:56.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f91faa00640 1 -- 172.21.15.73:0/749667769 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f40a57b0 con 0x7f91fc072350 2024-04-15T15:31:56.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f91faa00640 1 -- 172.21.15.73:0/749667769 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f40a5b80 con 0x7f91fc072350 2024-04-15T15:31:56.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5645200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56380df1a0 0x7f56380d6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f9203200640 1 -- 172.21.15.73:0/749667769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91fc072350 msgr2=0x7f91fc166920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f9203200640 1 --2- 172.21.15.73:0/749667769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91fc072350 0x7f91fc166920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009d90 tx=0x7f91f401c8e0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5645200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56380e2d80 0x7f56380d8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5645200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56380d9260 0x7f56380e8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f9203200640 1 -- 172.21.15.73:0/749667769 shutdown_connections 2024-04-15T15:31:56.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f9203200640 1 --2- 172.21.15.73:0/749667769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91fc072350 0x7f91fc166920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f9203200640 1 --2- 172.21.15.73:0/749667769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f9203200640 1 -- 172.21.15.73:0/749667769 >> 172.21.15.73:0/749667769 conn(0x7f91fc0d0540 msgr2=0x7f91fc0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56380e2d80 0x7f56380d8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56380df1a0 0x7f56380d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56380e2d80 0x7f56380d8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45486/0 (socket says 172.21.15.73:45486) 2024-04-15T15:31:56.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563d400640 1 -- 172.21.15.73:0/3545102544 learned_addr learned my addr 172.21.15.73:0/3545102544 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5638006f70 con 0x7f56380e2d80 2024-04-15T15:31:56.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5638006df0 con 0x7f56380df1a0 2024-04-15T15:31:56.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f56380ee250 con 0x7f56380d9260 2024-04-15T15:31:56.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563e800640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56380d9260 0x7f56380e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f8e1ea00640 1 -- 172.21.15.73:0/3647350702 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e1801a070 con 0x7f8e2815ab90 2024-04-15T15:31:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f9203200640 1 -- 172.21.15.73:0/749667769 shutdown_connections 2024-04-15T15:31:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f9203200640 1 -- 172.21.15.73:0/749667769 wait complete. 2024-04-15T15:31:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35e6c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f35e015e870 0x7f35e015fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35e6c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35e015ec50 0x7f35e00b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35e6c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e00b3960 0x7f35e006f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35e6c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f35e01600a0 con 0x7f35e015ec50 2024-04-15T15:31:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35e6c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f35e00b3ea0 con 0x7f35e015e870 2024-04-15T15:31:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35e6c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f35e00b4180 con 0x7f35e00b3960 2024-04-15T15:31:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35df400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35e015ec50 0x7f35e00b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35df400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35e015ec50 0x7f35e00b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45496/0 (socket says 172.21.15.73:45496) 2024-04-15T15:31:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563e800640 1 -- 172.21.15.73:0/3545102544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56380df1a0 msgr2=0x7f56380d6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563e800640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56380df1a0 0x7f56380d6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563e800640 1 -- 172.21.15.73:0/3545102544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56380e2d80 msgr2=0x7f56380d8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563e800640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56380e2d80 0x7f56380d8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563e800640 1 -- 172.21.15.73:0/3545102544 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563804cb70 con 0x7f56380d9260 2024-04-15T15:31:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7feb5d600640 1 -- 172.21.15.73:0/243926321 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feb5401f020 con 0x7feb580e1250 2024-04-15T15:31:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f1f00a00640 1 -- 172.21.15.73:0/1804000652 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40a95f0 con 0x7f1f040b3e30 2024-04-15T15:31:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f1f00a00640 1 -- 172.21.15.73:0/1804000652 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef40a9790 con 0x7f1f040b3e30 2024-04-15T15:31:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f1f00a00640 1 -- 172.21.15.73:0/1804000652 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40a9b60 con 0x7f1f040b3e30 2024-04-15T15:31:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35df400640 1 -- 172.21.15.73:0/1700732061 learned_addr learned my addr 172.21.15.73:0/1700732061 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35e4c00640 1 --2- 172.21.15.73:0/1700732061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e00b3960 0x7f35e006f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35df400640 1 -- 172.21.15.73:0/1700732061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e00b3960 msgr2=0x7f35e006f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35df400640 1 --2- 172.21.15.73:0/1700732061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e00b3960 0x7f35e006f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35df400640 1 -- 172.21.15.73:0/1700732061 >> v2:172.21.15.118:3300/0 conn(0x7f35e015e870 msgr2=0x7f35e015fb60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-15T15:31:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35df400640 1 --2- 172.21.15.73:0/1700732061 >> v2:172.21.15.118:3300/0 conn(0x7f35e015e870 0x7f35e015fb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f35df400640 1 -- 172.21.15.73:0/1700732061 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e015f360 con 0x7f35e015ec50 2024-04-15T15:31:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f8e1ea00640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e08068580 0x7f8e0806aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7fa99d600640 1 -- 172.21.15.73:0/4063687174 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9880b1070 con 0x7fa9a00b2120 2024-04-15T15:31:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7fa99d600640 1 -- 172.21.15.73:0/4063687174 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9880ac410 con 0x7fa9a00b2120 2024-04-15T15:31:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7fa99d600640 1 -- 172.21.15.73:0/4063687174 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9880ac7e0 con 0x7fa9a00b2120 2024-04-15T15:31:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f563e800640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56380d9260 0x7f56380e8250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f56380e3230 tx=0x7f5640069590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5636000640 1 -- 172.21.15.73:0/3545102544 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5640068e20 con 0x7f56380d9260 2024-04-15T15:31:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5636000640 1 -- 172.21.15.73:0/3545102544 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5640075080 con 0x7f56380d9260 2024-04-15T15:31:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5636000640 1 -- 172.21.15.73:0/3545102544 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56400754d0 con 0x7f56380d9260 2024-04-15T15:31:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563804cdf0 con 0x7f56380d9260 2024-04-15T15:31:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f8e1ea00640 1 -- 172.21.15.73:0/3647350702 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8e18085b40 con 0x7f8e2815ab90 2024-04-15T15:31:56.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f8e26a00640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e08068580 0x7f8e0806aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.129+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f563804d0b0 con 0x7f56380d9260 2024-04-15T15:31:56.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f1f08e00640 1 -- 172.21.15.73:0/1804000652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 msgr2=0x7f1f040b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f1f08e00640 1 --2- 172.21.15.73:0/1804000652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f040b42a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009870 tx=0x7f1ef401c530 comp rx=0 tx=0).stop 2024-04-15T15:31:56.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9203200640 1 Processor -- start 2024-04-15T15:31:56.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9203200640 1 -- start start 2024-04-15T15:31:56.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f8e26a00640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e08068580 0x7f8e0806aa40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8e200113e0 tx=0x7f8e2000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fa9a5c00640 1 -- 172.21.15.73:0/4063687174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a00b2120 msgr2=0x7fa9a00cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fa9a5c00640 1 --2- 172.21.15.73:0/4063687174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a00b2120 0x7fa9a00cd4e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa9880097c0 tx=0x7fa98801c4c0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56380053d0 con 0x7f56380d9260 2024-04-15T15:31:56.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f1f08e00640 1 -- 172.21.15.73:0/1804000652 shutdown_connections 2024-04-15T15:31:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f1f08e00640 1 --2- 172.21.15.73:0/1804000652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f040b42a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f1f08e00640 1 --2- 172.21.15.73:0/1804000652 >> v2:172.21.15.118:3300/0 conn(0x7f1f04162a80 0x7f1f040b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f1f08e00640 1 -- 172.21.15.73:0/1804000652 >> 172.21.15.73:0/1804000652 conn(0x7f1f04067dd0 msgr2=0x7f1f040d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f1f08e00640 1 -- 172.21.15.73:0/1804000652 shutdown_connections 2024-04-15T15:31:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fd135e00640 1 --2- 172.21.15.73:0/2742810888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd138162a80 0x7fd1380b3420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd1380b0040 tx=0x7fd12801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530a622251396140 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fa9a5c00640 1 -- 172.21.15.73:0/4063687174 shutdown_connections 2024-04-15T15:31:56.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f1f08e00640 1 -- 172.21.15.73:0/1804000652 wait complete. 2024-04-15T15:31:56.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fa9a5c00640 1 --2- 172.21.15.73:0/4063687174 >> v2:172.21.15.118:3300/0 conn(0x7fa9a0072520 0x7fa9a00b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fd134a00640 1 -- 172.21.15.73:0/2742810888 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1280a5840 con 0x7fd138162a80 2024-04-15T15:31:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9203200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91fc072350 0x7f91fc156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fa9a5c00640 1 --2- 172.21.15.73:0/4063687174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a00b2120 0x7fa9a00cd4e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fd134a00640 1 -- 172.21.15.73:0/2742810888 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1280a59e0 con 0x7fd138162a80 2024-04-15T15:31:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fd134a00640 1 -- 172.21.15.73:0/2742810888 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1280a5db0 con 0x7fd138162a80 2024-04-15T15:31:56.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9203200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc15c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9203200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc166e60 0x7f91fc14f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fa9a5c00640 1 -- 172.21.15.73:0/4063687174 >> 172.21.15.73:0/4063687174 conn(0x7fa9a00d0540 msgr2=0x7fa9a00d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f5636000640 1 -- 172.21.15.73:0/3545102544 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5640094420 con 0x7f56380d9260 2024-04-15T15:31:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fa9a5c00640 1 -- 172.21.15.73:0/4063687174 shutdown_connections 2024-04-15T15:31:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fa9a5c00640 1 -- 172.21.15.73:0/4063687174 wait complete. 2024-04-15T15:31:56.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9203200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc0b5730 con 0x7f91fc072350 2024-04-15T15:31:56.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9203200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc15d630 con 0x7f91fc166e60 2024-04-15T15:31:56.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9203200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f91fc1565b0 con 0x7f91fc15d250 2024-04-15T15:31:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fd13d000640 1 -- 172.21.15.73:0/2742810888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd138162a80 msgr2=0x7fd1380b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fd13d000640 1 --2- 172.21.15.73:0/2742810888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd138162a80 0x7fd1380b3420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd1380b0040 tx=0x7fd12801c980 comp rx=0 tx=0).stop 2024-04-15T15:31:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9201200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc166e60 0x7f91fc14f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9201200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc166e60 0x7f91fc14f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51268/0 (socket says 172.21.15.73:51268) 2024-04-15T15:31:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f9201200640 1 -- 172.21.15.73:0/3485937407 learned_addr learned my addr 172.21.15.73:0/3485937407 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f91fb400640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f91fbe00640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91fc072350 0x7f91fc156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fd13d000640 1 -- 172.21.15.73:0/2742810888 shutdown_connections 2024-04-15T15:31:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fd13d000640 1 --2- 172.21.15.73:0/2742810888 >> v2:172.21.15.118:3300/0 conn(0x7fd1380b3e30 0x7fd1380b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fd13d000640 1 --2- 172.21.15.73:0/2742810888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd138162a80 0x7fd1380b3420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7fd13d000640 1 -- 172.21.15.73:0/2742810888 >> 172.21.15.73:0/2742810888 conn(0x7fd138067dd0 msgr2=0x7fd1380d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f5636000640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5620070c60 0x7f5620073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f35df400640 1 --2- 172.21.15.73:0/1700732061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e015ec50 0x7f35e00b3420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35e00d0f70 tx=0x7f35cc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e9b9bb319b082a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7fd13d000640 1 -- 172.21.15.73:0/2742810888 shutdown_connections 2024-04-15T15:31:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7fd13d000640 1 -- 172.21.15.73:0/2742810888 wait complete. 2024-04-15T15:31:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f563de00640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5620070c60 0x7f5620073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f8e1ea00640 1 -- 172.21.15.73:0/3647350702 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8e18055820 con 0x7f8e2815ab90 2024-04-15T15:31:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35dea00640 1 -- 172.21.15.73:0/1700732061 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0b2070 con 0x7f35e015ec50 2024-04-15T15:31:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35dea00640 1 -- 172.21.15.73:0/1700732061 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35cc0a5890 con 0x7f35e015ec50 2024-04-15T15:31:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35dea00640 1 -- 172.21.15.73:0/1700732061 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0a5c60 con 0x7f35e015ec50 2024-04-15T15:31:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f1f08e00640 1 Processor -- start 2024-04-15T15:31:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f91fb400640 1 -- 172.21.15.73:0/3485937407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc166e60 msgr2=0x7f91fc14f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f91fb400640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc166e60 0x7f91fc14f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f91fb400640 1 -- 172.21.15.73:0/3485937407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91fc072350 msgr2=0x7f91fc156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f91fb400640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91fc072350 0x7f91fc156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.133+0000 7f91fb400640 1 -- 172.21.15.73:0/3485937407 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc0cf1f0 con 0x7f91fc15d250 2024-04-15T15:31:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f91fb400640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc15c110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f91f40ac000 tx=0x7f91f4019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35e6c00640 1 -- 172.21.15.73:0/1700732061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e015ec50 msgr2=0x7f35e00b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35e6c00640 1 --2- 172.21.15.73:0/1700732061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e015ec50 0x7f35e00b3420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35e00d0f70 tx=0x7f35cc01ca10 comp rx=0 tx=0).stop 2024-04-15T15:31:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f1f08e00640 1 -- start start 2024-04-15T15:31:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f563de00640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5620070c60 0x7f5620073120 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5630005890 tx=0x7f5630009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7fd13d000640 1 Processor -- start 2024-04-15T15:31:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7fd13d000640 1 -- start start 2024-04-15T15:31:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f5636000640 1 -- 172.21.15.73:0/3545102544 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5640101be0 con 0x7f56380d9260 2024-04-15T15:31:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35e6c00640 1 -- 172.21.15.73:0/1700732061 shutdown_connections 2024-04-15T15:31:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35e6c00640 1 --2- 172.21.15.73:0/1700732061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e00b3960 0x7f35e006f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35e6c00640 1 --2- 172.21.15.73:0/1700732061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e015ec50 0x7f35e00b3420 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f1f08e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f0406fbd0 0x7f1f041484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35e6c00640 1 --2- 172.21.15.73:0/1700732061 >> v2:172.21.15.118:3300/0 conn(0x7f35e015e870 0x7f35e015fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35e6c00640 1 -- 172.21.15.73:0/1700732061 >> 172.21.15.73:0/1700732061 conn(0x7f35e0067dd0 msgr2=0x7f35e00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f1f08e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f04163710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f1f08e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f04162a80 0x7f1f04163c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35e6c00640 1 -- 172.21.15.73:0/1700732061 shutdown_connections 2024-04-15T15:31:56.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7fa9a5c00640 1 Processor -- start 2024-04-15T15:31:56.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.137+0000 7f35e6c00640 1 -- 172.21.15.73:0/1700732061 wait complete. 2024-04-15T15:31:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f01400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f04163710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f02800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f04162a80 0x7f1f04163c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f01400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f04163710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:57282/0 (socket says 172.21.15.73:57282) 2024-04-15T15:31:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f08e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04072620 con 0x7f1f04162a80 2024-04-15T15:31:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f08e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1f040b3960 con 0x7f1f0406fbd0 2024-04-15T15:31:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f08e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1f040727a0 con 0x7f1f040b3e30 2024-04-15T15:31:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f01400640 1 -- 172.21.15.73:0/2922463429 learned_addr learned my addr 172.21.15.73:0/2922463429 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f01e00640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f0406fbd0 0x7f1f041484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fa9a5c00640 1 -- start start 2024-04-15T15:31:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f5636000640 1 -- 172.21.15.73:0/3545102544 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f563804cb70 con 0x7f56380d9260 2024-04-15T15:31:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd13d000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd13806fbd0 0x7fd138156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd13d000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1380b3e30 0x7fd1380cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd13d000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd138162a80 0x7fd138158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd13d000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd138072620 con 0x7fd1380b3e30 2024-04-15T15:31:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd13d000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd1380b3960 con 0x7fd13806fbd0 2024-04-15T15:31:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd13d000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd1380727a0 con 0x7fd138162a80 2024-04-15T15:31:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f02800640 1 -- 172.21.15.73:0/2922463429 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 msgr2=0x7f1f04163710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f02800640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f04163710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f02800640 1 -- 172.21.15.73:0/2922463429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f0406fbd0 msgr2=0x7f1f041484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f02800640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f0406fbd0 0x7f1f041484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f02800640 1 -- 172.21.15.73:0/2922463429 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f041589a0 con 0x7f1f04162a80 2024-04-15T15:31:56.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f01400640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f04163710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:56.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd136800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd138162a80 0x7fd138158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd136800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd138162a80 0x7fd138158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:57298/0 (socket says 172.21.15.73:57298) 2024-04-15T15:31:56.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd136800640 1 -- 172.21.15.73:0/410667541 learned_addr learned my addr 172.21.15.73:0/410667541 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f02800640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f04162a80 0x7f1f04163c50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f040d0ef0 tx=0x7f1ef401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1efa000640 1 -- 172.21.15.73:0/2922463429 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40bc650 con 0x7f1f04162a80 2024-04-15T15:31:56.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1efa000640 1 -- 172.21.15.73:0/2922463429 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef40bc7f0 con 0x7f1f04162a80 2024-04-15T15:31:56.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1efa000640 1 -- 172.21.15.73:0/2922463429 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40bcbe0 con 0x7f1f04162a80 2024-04-15T15:31:56.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f91f3e00640 1 -- 172.21.15.73:0/3485937407 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f40bd020 con 0x7f91fc15d250 2024-04-15T15:31:56.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f91f3e00640 1 -- 172.21.15.73:0/3485937407 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f40b3040 con 0x7f91fc15d250 2024-04-15T15:31:56.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f91f3e00640 1 -- 172.21.15.73:0/3485937407 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f40b2050 con 0x7f91fc15d250 2024-04-15T15:31:56.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f9203200640 1 -- 172.21.15.73:0/3485937407 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91fc155590 con 0x7f91fc15d250 2024-04-15T15:31:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f9203200640 1 -- 172.21.15.73:0/3485937407 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91fc155b50 con 0x7f91fc15d250 2024-04-15T15:31:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fa9a5c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a0072520 0x7fa9a00b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fa9a5c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a00b2120 0x7fa9a0150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fa9a5c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9a00b3e30 0x7fa9a014e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd135e00640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd13806fbd0 0x7fd138156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f08e00640 1 -- 172.21.15.73:0/2922463429 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0415b5c0 con 0x7f1f04162a80 2024-04-15T15:31:56.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f1f08e00640 1 -- 172.21.15.73:0/2922463429 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0415bb80 con 0x7f1f04162a80 2024-04-15T15:31:56.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7f35e6c00640 1 Processor -- start 2024-04-15T15:31:56.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd136800640 1 -- 172.21.15.73:0/410667541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd13806fbd0 msgr2=0x7fd138156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd136800640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd13806fbd0 0x7fd138156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd136800640 1 -- 172.21.15.73:0/410667541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1380b3e30 msgr2=0x7fd1380cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd136800640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1380b3e30 0x7fd1380cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.141+0000 7fd136800640 1 -- 172.21.15.73:0/410667541 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1381687e0 con 0x7fd138162a80 2024-04-15T15:31:56.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35e6c00640 1 -- start start 2024-04-15T15:31:56.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa99ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a0072520 0x7fa9a00b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa99ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a0072520 0x7fa9a00b0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:57300/0 (socket says 172.21.15.73:57300) 2024-04-15T15:31:56.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f9203200640 1 -- 172.21.15.73:0/3485937407 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91fc1553b0 con 0x7f91fc15d250 2024-04-15T15:31:56.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa99e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a00b2120 0x7fa9a0150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fd136800640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd138162a80 0x7fd138158380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd13000c7f0 tx=0x7fd13000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f1f08e00640 1 -- 172.21.15.73:0/2922463429 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f04068ab0 con 0x7f1f04162a80 2024-04-15T15:31:56.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa99e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a00b2120 0x7fa9a0150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45540/0 (socket says 172.21.15.73:45540) 2024-04-15T15:31:56.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fd12e000640 1 -- 172.21.15.73:0/410667541 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130015070 con 0x7fd138162a80 2024-04-15T15:31:56.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa99f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9a00b3e30 0x7fa9a014e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa99f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9a00b3e30 0x7fa9a014e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51274/0 (socket says 172.21.15.73:51274) 2024-04-15T15:31:56.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa99ea00640 1 -- 172.21.15.73:0/575903713 learned_addr learned my addr 172.21.15.73:0/575903713 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fd12e000640 1 -- 172.21.15.73:0/410667541 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd130007840 con 0x7fd138162a80 2024-04-15T15:31:56.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fd12e000640 1 -- 172.21.15.73:0/410667541 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130007c30 con 0x7fd138162a80 2024-04-15T15:31:56.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a006f810 con 0x7fa9a00b2120 2024-04-15T15:31:56.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a006f690 con 0x7fa9a00b3e30 2024-04-15T15:31:56.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a006f990 con 0x7fa9a0072520 2024-04-15T15:31:56.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fd13d000640 1 -- 172.21.15.73:0/410667541 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd138168220 con 0x7fd138162a80 2024-04-15T15:31:56.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35e6c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35e00b3960 0x7f35e0141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35e6c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e015e870 0x7f35e01fbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35e6c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e015ec50 0x7f35e0150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fd13d000640 1 -- 172.21.15.73:0/410667541 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1380ce6a0 con 0x7fd138162a80 2024-04-15T15:31:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35dfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35e00b3960 0x7f35e0141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35dfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35e00b3960 0x7f35e0141c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:51286/0 (socket says 172.21.15.73:51286) 2024-04-15T15:31:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f91f3e00640 1 -- 172.21.15.73:0/3485937407 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91f40c0070 con 0x7f91fc15d250 2024-04-15T15:31:56.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35e6c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f35e00b52e0 con 0x7f35e015e870 2024-04-15T15:31:56.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35e6c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f35e00b5160 con 0x7f35e00b3960 2024-04-15T15:31:56.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35e6c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f35e00700c0 con 0x7f35e015ec50 2024-04-15T15:31:56.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35df400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e015e870 0x7f35e01fbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7f35dfe00640 1 -- 172.21.15.73:0/3987523345 learned_addr learned my addr 172.21.15.73:0/3987523345 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:56.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f1efa000640 1 -- 172.21.15.73:0/2922463429 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ef40c53f0 con 0x7f1f04162a80 2024-04-15T15:31:56.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.145+0000 7fa99ea00640 1 -- 172.21.15.73:0/575903713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9a00b3e30 msgr2=0x7fa9a014e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7fa99ea00640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9a00b3e30 0x7fa9a014e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7fa99ea00640 1 -- 172.21.15.73:0/575903713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a00b2120 msgr2=0x7fa9a0150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7fa99ea00640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a00b2120 0x7fa9a0150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7fa99ea00640 1 -- 172.21.15.73:0/575903713 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a015c500 con 0x7fa9a0072520 2024-04-15T15:31:56.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f35e4c00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e015ec50 0x7f35e0150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f91f3e00640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f91dc0683d0 0x7f91dc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7fa99e000640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a00b2120 0x7fa9a0150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:56.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f35e4c00640 1 -- 172.21.15.73:0/3987523345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35e00b3960 msgr2=0x7f35e0141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f35e4c00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35e00b3960 0x7f35e0141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f35e4c00640 1 -- 172.21.15.73:0/3987523345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e015e870 msgr2=0x7f35e01fbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f35e4c00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e015e870 0x7f35e01fbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f35e4c00640 1 -- 172.21.15.73:0/3987523345 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e0150e90 con 0x7f35e015ec50 2024-04-15T15:31:56.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f35dfe00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35e00b3960 0x7f35e0141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:56.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f35e4c00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e015ec50 0x7f35e0150580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f35d000a7e0 tx=0x7f35d000aca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7fd13d000640 1 -- 172.21.15.73:0/410667541 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd138068ab0 con 0x7fd138162a80 2024-04-15T15:31:56.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f1efa000640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ee4068450 0x7f1ee406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f91f3e00640 1 -- 172.21.15.73:0/3485937407 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f91f41210c0 con 0x7f91fc15d250 2024-04-15T15:31:56.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7fa99ea00640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a0072520 0x7fa9a00b0b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa9880190d0 tx=0x7fa988019260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f91fbe00640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f91dc0683d0 0x7f91dc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f1efa000640 1 -- 172.21.15.73:0/2922463429 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1ef4121600 con 0x7f1f04162a80 2024-04-15T15:31:56.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f1f01e00640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ee4068450 0x7f1ee406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7f91fbe00640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f91dc0683d0 0x7f91dc06a890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f91e8006fd0 tx=0x7f91e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.149+0000 7fd12e000640 1 -- 172.21.15.73:0/410667541 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd130018070 con 0x7fd138162a80 2024-04-15T15:31:56.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.153+0000 7fd12e000640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd118068480 0x7fd11806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.153+0000 7f1f01e00640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ee4068450 0x7f1ee406a910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f041ff230 tx=0x7f1efc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.153+0000 7fd12e000640 1 -- 172.21.15.73:0/410667541 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd130086dc0 con 0x7fd138162a80 2024-04-15T15:31:56.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.153+0000 7f35d7e00640 1 -- 172.21.15.73:0/3987523345 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d001a070 con 0x7f35e015ec50 2024-04-15T15:31:56.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.153+0000 7f91f3e00640 1 -- 172.21.15.73:0/3485937407 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f91fc1553b0 con 0x7f91fc15d250 2024-04-15T15:31:56.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.153+0000 7f35e6c00640 1 -- 172.21.15.73:0/3987523345 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e0151170 con 0x7f35e015ec50 2024-04-15T15:31:56.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.153+0000 7f35e6c00640 1 -- 172.21.15.73:0/3987523345 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e01fc000 con 0x7f35e015ec50 2024-04-15T15:31:56.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.153+0000 7fd135e00640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd118068480 0x7fd11806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.153+0000 7f35e6c00640 1 -- 172.21.15.73:0/3987523345 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e0068ab0 con 0x7f35e015ec50 2024-04-15T15:31:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.153+0000 7fd135e00640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd118068480 0x7fd11806a940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1280ae000 tx=0x7fd1280a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.157+0000 7f1efa000640 1 -- 172.21.15.73:0/2922463429 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ef40ad020 con 0x7f1f04162a80 2024-04-15T15:31:56.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.157+0000 7fd12e000640 1 -- 172.21.15.73:0/410667541 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd1300569d0 con 0x7fd138162a80 2024-04-15T15:31:56.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.157+0000 7f35d7e00640 1 -- 172.21.15.73:0/3987523345 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d000de40 con 0x7f35e015ec50 2024-04-15T15:31:56.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.157+0000 7f35d7e00640 1 -- 172.21.15.73:0/3987523345 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0024060 con 0x7f35e015ec50 2024-04-15T15:31:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.157+0000 7fa996a00640 1 -- 172.21.15.73:0/575903713 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9880b1040 con 0x7fa9a0072520 2024-04-15T15:31:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.157+0000 7fa996a00640 1 -- 172.21.15.73:0/575903713 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9880ace20 con 0x7fa9a0072520 2024-04-15T15:31:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.157+0000 7fa996a00640 1 -- 172.21.15.73:0/575903713 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9880c23f0 con 0x7fa9a0072520 2024-04-15T15:31:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.157+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a015c7e0 con 0x7fa9a0072520 2024-04-15T15:31:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.157+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a015cda0 con 0x7fa9a0072520 2024-04-15T15:31:56.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.161+0000 7f35d7e00640 1 -- 172.21.15.73:0/3987523345 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35d001d070 con 0x7f35e015ec50 2024-04-15T15:31:56.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.161+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a0068ab0 con 0x7fa9a0072520 2024-04-15T15:31:56.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.161+0000 7f35d7e00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35c0068380 0x7f35c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.161+0000 7f35d7e00640 1 -- 172.21.15.73:0/3987523345 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f35d0086eb0 con 0x7f35e015ec50 2024-04-15T15:31:56.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.161+0000 7f35d7e00640 1 -- 172.21.15.73:0/3987523345 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f35d0087280 con 0x7f35e015ec50 2024-04-15T15:31:56.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.165+0000 7fa996a00640 1 -- 172.21.15.73:0/575903713 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa9880cb440 con 0x7fa9a0072520 2024-04-15T15:31:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.165+0000 7fa996a00640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa97c068450 0x7fa97c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.165+0000 7f35dfe00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35c0068380 0x7f35c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.165+0000 7fa996a00640 1 -- 172.21.15.73:0/575903713 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa9881292f0 con 0x7fa9a0072520 2024-04-15T15:31:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.165+0000 7fa996a00640 1 -- 172.21.15.73:0/575903713 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa9880160b0 con 0x7fa9a0072520 2024-04-15T15:31:56.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.169+0000 7fa99e000640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa97c068450 0x7fa97c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:56.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.169+0000 7f35dfe00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35c0068380 0x7f35c006a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35d800a450 tx=0x7f35d8007580 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.169+0000 7fa99e000640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa97c068450 0x7fa97c06a910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0140890 tx=0x7fa990005b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:56.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.473+0000 7feb68600640 1 -- 172.21.15.73:0/243926321 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feb580053d0 con 0x7feb580e1250 2024-04-15T15:31:56.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.473+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5638052c90 con 0x7f56380d9260 2024-04-15T15:31:56.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.473+0000 7f5636000640 1 -- 172.21.15.73:0/3545102544 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56400d17f0 con 0x7f56380d9260 2024-04-15T15:31:56.477 INFO:teuthology.orchestra.run.smithi073.stdout:55834574858 2024-04-15T15:31:56.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.473+0000 7feb5d600640 1 -- 172.21.15.73:0/243926321 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb54056e00 con 0x7feb580e1250 2024-04-15T15:31:56.477 INFO:teuthology.orchestra.run.smithi073.stdout:55834574857 2024-04-15T15:31:56.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 -- 172.21.15.73:0/243926321 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feb40068450 msgr2=0x7feb4006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5620070c60 msgr2=0x7f5620073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feb40068450 0x7feb4006a910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb4c005890 tx=0x7feb4c009040 comp rx=0 tx=0).stop 2024-04-15T15:31:56.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7f5645200640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5620070c60 0x7f5620073120 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5630005890 tx=0x7f5630009040 comp rx=0 tx=0).stop 2024-04-15T15:31:56.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56380d9260 msgr2=0x7f56380e8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7f5645200640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56380d9260 0x7f56380e8250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f56380e3230 tx=0x7f5640069590 comp rx=0 tx=0).stop 2024-04-15T15:31:56.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 shutdown_connections 2024-04-15T15:31:56.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7f5645200640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5620070c60 0x7f5620073120 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 -- 172.21.15.73:0/243926321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb580e1250 msgr2=0x7feb580dac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb580e1250 0x7feb580dac30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feb5400b3e0 tx=0x7feb54009f90 comp rx=0 tx=0).stop 2024-04-15T15:31:56.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 -- 172.21.15.73:0/243926321 shutdown_connections 2024-04-15T15:31:56.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7feb40068450 0x7feb4006a910 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb580e1250 0x7feb580dac30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb58050f10 0x7feb580da6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 --2- 172.21.15.73:0/243926321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb5803a610 0x7feb580cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 -- 172.21.15.73:0/243926321 >> 172.21.15.73:0/243926321 conn(0x7feb58054b00 msgr2=0x7feb580e0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7f5645200640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56380d9260 0x7f56380e8250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7f5645200640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56380e2d80 0x7f56380d8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7f5645200640 1 --2- 172.21.15.73:0/3545102544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56380df1a0 0x7f56380d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 >> 172.21.15.73:0/3545102544 conn(0x7f5638054b00 msgr2=0x7f56380e1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.481+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 shutdown_connections 2024-04-15T15:31:56.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.481+0000 7f5645200640 1 -- 172.21.15.73:0/3545102544 wait complete. 2024-04-15T15:31:56.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 -- 172.21.15.73:0/243926321 shutdown_connections 2024-04-15T15:31:56.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.477+0000 7feb68600640 1 -- 172.21.15.73:0/243926321 wait complete. 2024-04-15T15:31:56.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.481+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8e00005590 con 0x7f8e2815ab90 2024-04-15T15:31:56.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.481+0000 7f8e1ea00640 1 -- 172.21.15.73:0/3647350702 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e18059b20 con 0x7f8e2815ab90 2024-04-15T15:31:56.492 INFO:teuthology.orchestra.run.smithi073.stdout:55834574856 2024-04-15T15:31:56.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e08068580 msgr2=0x7f8e0806aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f8e27e00640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e08068580 0x7f8e0806aa40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8e200113e0 tx=0x7f8e2000b040 comp rx=0 tx=0).stop 2024-04-15T15:31:56.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e2815ab90 msgr2=0x7f8e2806ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f8e27e00640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e2815ab90 0x7f8e2806ef40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c450 tx=0x7f8e1800c910 comp rx=0 tx=0).stop 2024-04-15T15:31:56.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f9203200640 1 -- 172.21.15.73:0/3485937407 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f91fc068ab0 con 0x7f91fc15d250 2024-04-15T15:31:56.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f91f3e00640 1 -- 172.21.15.73:0/3485937407 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91f4016560 con 0x7f91fc15d250 2024-04-15T15:31:56.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 shutdown_connections 2024-04-15T15:31:56.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f8e27e00640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e2815ab90 0x7f8e2806ef40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f8e27e00640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e08068580 0x7f8e0806aa40 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8e200113e0 tx=0x7f8e2000b040 comp rx=0 tx=0).stop 2024-04-15T15:31:56.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f8e27e00640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e2815a7b0 0x7f8e280b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f8e27e00640 1 --2- 172.21.15.73:0/3647350702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e280af730 0x7f8e280cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.493+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 >> 172.21.15.73:0/3647350702 conn(0x7f8e280d0220 msgr2=0x7f8e280cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.495 INFO:teuthology.orchestra.run.smithi073.stdout:55834574856 2024-04-15T15:31:56.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 shutdown_connections 2024-04-15T15:31:56.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f8e27e00640 1 -- 172.21.15.73:0/3647350702 wait complete. 2024-04-15T15:31:56.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 -- 172.21.15.73:0/3485937407 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f91dc0683d0 msgr2=0x7f91dc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f91dc0683d0 0x7f91dc06a890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f91e8006fd0 tx=0x7f91e8008040 comp rx=0 tx=0).stop 2024-04-15T15:31:56.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 -- 172.21.15.73:0/3485937407 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 msgr2=0x7f91fc15c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc15c110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f91f40ac000 tx=0x7f91f4019680 comp rx=0 tx=0).stop 2024-04-15T15:31:56.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f35e6c00640 1 -- 172.21.15.73:0/3987523345 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f35e00afd20 con 0x7f35e015ec50 2024-04-15T15:31:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 -- 172.21.15.73:0/3485937407 shutdown_connections 2024-04-15T15:31:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc166e60 0x7f91fc14f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f91dc0683d0 0x7f91dc06a890 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91fc15d250 0x7f91fc15c110 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 --2- 172.21.15.73:0/3485937407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91fc072350 0x7f91fc156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 -- 172.21.15.73:0/3485937407 >> 172.21.15.73:0/3485937407 conn(0x7f91fc0d0540 msgr2=0x7f91fc0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 -- 172.21.15.73:0/3485937407 shutdown_connections 2024-04-15T15:31:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f9203200640 1 -- 172.21.15.73:0/3485937407 wait complete. 2024-04-15T15:31:56.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.497+0000 7f1f08e00640 1 -- 172.21.15.73:0/2922463429 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1f041620a0 con 0x7f1f04162a80 2024-04-15T15:31:56.501 INFO:teuthology.orchestra.run.smithi073.stdout:55834574858 2024-04-15T15:31:56.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.501+0000 7f35d7e00640 1 -- 172.21.15.73:0/3987523345 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f35d0056ac0 con 0x7f35e015ec50 2024-04-15T15:31:56.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.501+0000 7f1efa000640 1 -- 172.21.15.73:0/2922463429 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ef4016170 con 0x7f1f04162a80 2024-04-15T15:31:56.504 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-04-15T15:31:56.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 -- 172.21.15.73:0/3987523345 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35c0068380 msgr2=0x7f35c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35c0068380 0x7f35c006a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35d800a450 tx=0x7f35d8007580 comp rx=0 tx=0).stop 2024-04-15T15:31:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 -- 172.21.15.73:0/3987523345 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e015ec50 msgr2=0x7f35e0150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e015ec50 0x7f35e0150580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f35d000a7e0 tx=0x7f35d000aca0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 -- 172.21.15.73:0/3987523345 shutdown_connections 2024-04-15T15:31:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35c0068380 0x7f35c006a840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35e015ec50 0x7f35e0150580 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e015e870 0x7f35e01fbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 --2- 172.21.15.73:0/3987523345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35e00b3960 0x7f35e0141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 -- 172.21.15.73:0/3987523345 >> 172.21.15.73:0/3987523345 conn(0x7f35e0067dd0 msgr2=0x7f35e006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 -- 172.21.15.73:0/2922463429 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ee4068450 msgr2=0x7f1ee406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ee4068450 0x7f1ee406a910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f041ff230 tx=0x7f1efc00b040 comp rx=0 tx=0).stop 2024-04-15T15:31:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 -- 172.21.15.73:0/2922463429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f04162a80 msgr2=0x7f1f04163c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f04162a80 0x7f1f04163c50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f040d0ef0 tx=0x7f1ef401ad70 comp rx=0 tx=0).stop 2024-04-15T15:31:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 -- 172.21.15.73:0/3987523345 shutdown_connections 2024-04-15T15:31:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f35e6c00640 1 -- 172.21.15.73:0/3987523345 wait complete. 2024-04-15T15:31:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7fd13d000640 1 -- 172.21.15.73:0/410667541 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd13806cdf0 con 0x7fd138162a80 2024-04-15T15:31:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 -- 172.21.15.73:0/2922463429 shutdown_connections 2024-04-15T15:31:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f04162a80 0x7f1f04163c50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ee4068450 0x7f1ee406a910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f040b3e30 0x7f1f04163710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 --2- 172.21.15.73:0/2922463429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f0406fbd0 0x7f1f041484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 -- 172.21.15.73:0/2922463429 >> 172.21.15.73:0/2922463429 conn(0x7f1f04067dd0 msgr2=0x7f1f04165bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 -- 172.21.15.73:0/2922463429 shutdown_connections 2024-04-15T15:31:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.505+0000 7f1f08e00640 1 -- 172.21.15.73:0/2922463429 wait complete. 2024-04-15T15:31:56.512 INFO:teuthology.orchestra.run.smithi073.stdout:55834574856 2024-04-15T15:31:56.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa9a006dda0 con 0x7fa9a0072520 2024-04-15T15:31:56.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fa996a00640 1 -- 172.21.15.73:0/575903713 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa9880f95e0 con 0x7fa9a0072520 2024-04-15T15:31:56.513 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-04-15T15:31:56.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd12e000640 1 -- 172.21.15.73:0/410667541 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd13005acd0 con 0x7fd138162a80 2024-04-15T15:31:56.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd13d000640 1 -- 172.21.15.73:0/410667541 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd118068480 msgr2=0x7fd11806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd13d000640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd118068480 0x7fd11806a940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1280ae000 tx=0x7fd1280a7070 comp rx=0 tx=0).stop 2024-04-15T15:31:56.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd13d000640 1 -- 172.21.15.73:0/410667541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd138162a80 msgr2=0x7fd138158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd13d000640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd138162a80 0x7fd138158380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd13000c7f0 tx=0x7fd13000ccb0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd13d000640 1 -- 172.21.15.73:0/410667541 shutdown_connections 2024-04-15T15:31:56.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd13d000640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd118068480 0x7fd11806a940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd13d000640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd138162a80 0x7fd138158380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd13d000640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1380b3e30 0x7fd1380cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd13d000640 1 --2- 172.21.15.73:0/410667541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd13806fbd0 0x7fd138156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.509+0000 7fd13d000640 1 -- 172.21.15.73:0/410667541 >> 172.21.15.73:0/410667541 conn(0x7fd138067dd0 msgr2=0x7fd1380b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fd13d000640 1 -- 172.21.15.73:0/410667541 shutdown_connections 2024-04-15T15:31:56.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fd13d000640 1 -- 172.21.15.73:0/410667541 wait complete. 2024-04-15T15:31:56.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa97c068450 msgr2=0x7fa97c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa97c068450 0x7fa97c06a910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0140890 tx=0x7fa990005b80 comp rx=0 tx=0).stop 2024-04-15T15:31:56.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a0072520 msgr2=0x7fa9a00b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:56.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a0072520 0x7fa9a00b0b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa9880190d0 tx=0x7fa988019260 comp rx=0 tx=0).stop 2024-04-15T15:31:56.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 shutdown_connections 2024-04-15T15:31:56.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9a00b3e30 0x7fa9a014e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a00b2120 0x7fa9a0150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa97c068450 0x7fa97c06a910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 --2- 172.21.15.73:0/575903713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa9a0072520 0x7fa9a00b0b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:56.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 >> 172.21.15.73:0/575903713 conn(0x7fa9a00d0540 msgr2=0x7fa9a0158180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:56.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.513+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 shutdown_connections 2024-04-15T15:31:56.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:56.517+0000 7fa9a5c00640 1 -- 172.21.15.73:0/575903713 wait complete. 2024-04-15T15:31:56.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.1 2024-04-15T15:31:56.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.2 2024-04-15T15:31:56.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.4 2024-04-15T15:31:56.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2024-04-15T15:31:56.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.6 2024-04-15T15:31:56.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.0 2024-04-15T15:31:56.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.3 2024-04-15T15:31:56.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.5 2024-04-15T15:31:57.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T15:31:57.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-15T15:31:57.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-15T15:31:57.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-15T15:31:57.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-15T15:31:57.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T15:31:57.550 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-15T15:31:57.551 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-15T15:31:57.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.733+0000 7f1d09200640 1 Processor -- start 2024-04-15T15:31:57.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f8649000640 1 Processor -- start 2024-04-15T15:31:57.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d09200640 1 -- start start 2024-04-15T15:31:57.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d09200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d0415a870 0x7f1d0415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d09200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 0x7f1d04072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d09200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d0415b190 con 0x7f1d04073520 2024-04-15T15:31:57.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d09200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f1d0415b420 con 0x7f1d0415a870 2024-04-15T15:31:57.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d09200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1d0415b700 con 0x7f1d040b2630 2024-04-15T15:31:57.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f8649000640 1 -- start start 2024-04-15T15:31:57.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d03400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d0415a870 0x7f1d0415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d03400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d0415a870 0x7f1d0415ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50476/0 (socket says 172.21.15.73:50476) 2024-04-15T15:31:57.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d03e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1d04073520 0x7f1d0415c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53106/0 (socket says 172.21.15.73:53106) 2024-04-15T15:31:57.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d02a00640 1 --2- 172.21.15.73:0/2811946123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 0x7f1d04072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f8649000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f863c053c20 0x7f863c0540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.737+0000 7f1d03400640 1 -- 172.21.15.73:0/2811946123 learned_addr learned my addr 172.21.15.73:0/2811946123 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f1d02a00640 1 -- 172.21.15.73:0/2811946123 >> v2:172.21.15.118:3300/0 conn(0x7f1d0415a870 msgr2=0x7f1d0415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f1d02a00640 1 --2- 172.21.15.73:0/2811946123 >> v2:172.21.15.118:3300/0 conn(0x7f1d0415a870 0x7f1d0415ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f1d02a00640 1 -- 172.21.15.73:0/2811946123 >> v1:172.21.15.73:6789/0 conn(0x7f1d04073520 legacy=0x7f1d0415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f1d02a00640 1 -- 172.21.15.73:0/2811946123 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0415b9e0 con 0x7f1d040b2630 2024-04-15T15:31:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8641400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f863c053c20 0x7f863c0540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8641400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f863c053c20 0x7f863c0540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50480/0 (socket says 172.21.15.73:50480) 2024-04-15T15:31:57.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8649000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f863c006800 0x7f863c006c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8641400640 1 -- 172.21.15.73:0/3500588883 learned_addr learned my addr 172.21.15.73:0/3500588883 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8649000640 1 -- 172.21.15.73:0/3500588883 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f863c057df0 con 0x7f863c0e32e0 2024-04-15T15:31:57.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8649000640 1 -- 172.21.15.73:0/3500588883 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f863c03bfd0 con 0x7f863c006800 2024-04-15T15:31:57.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8649000640 1 -- 172.21.15.73:0/3500588883 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f863c03ef60 con 0x7f863c053c20 2024-04-15T15:31:57.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8641400640 1 -- 172.21.15.73:0/3500588883 >> v2:172.21.15.73:3300/0 conn(0x7f863c006800 msgr2=0x7f863c006c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8642800640 1 --2- 172.21.15.73:0/3500588883 >> v2:172.21.15.73:3300/0 conn(0x7f863c006800 0x7f863c006c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8641400640 1 --2- 172.21.15.73:0/3500588883 >> v2:172.21.15.73:3300/0 conn(0x7f863c006800 0x7f863c006c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8641400640 1 -- 172.21.15.73:0/3500588883 >> v1:172.21.15.118:6789/0 conn(0x7f863c0e32e0 legacy=0x7f863c03e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.741+0000 7f8641400640 1 -- 172.21.15.73:0/3500588883 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c0580d0 con 0x7f863c053c20 2024-04-15T15:31:57.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.745+0000 7f1d02a00640 1 --2- 172.21.15.73:0/2811946123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 0x7f1d04072fe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00097c0 tx=0x7f1cf001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a85ceb55374b3f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.745+0000 7f8641400640 1 --2- 172.21.15.73:0/3500588883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c053c20 0x7f863c0540b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f863c059f30 tx=0x7f8630024c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65cd11465d1f80e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.745+0000 7f1d02000640 1 -- 172.21.15.73:0/2811946123 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00b2070 con 0x7f1d040b2630 2024-04-15T15:31:57.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.745+0000 7f1d02000640 1 -- 172.21.15.73:0/2811946123 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf00ad640 con 0x7f1d040b2630 2024-04-15T15:31:57.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.745+0000 7f1d02000640 1 -- 172.21.15.73:0/2811946123 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00ada10 con 0x7f1d040b2630 2024-04-15T15:31:57.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8640a00640 1 -- 172.21.15.73:0/3500588883 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86300ba070 con 0x7f863c053c20 2024-04-15T15:31:57.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8640a00640 1 -- 172.21.15.73:0/3500588883 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86300adac0 con 0x7f863c053c20 2024-04-15T15:31:57.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f1d09200640 1 -- 172.21.15.73:0/2811946123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 msgr2=0x7f1d04072fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f1d09200640 1 --2- 172.21.15.73:0/2811946123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 0x7f1d04072fe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00097c0 tx=0x7f1cf001c4a0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8640a00640 1 -- 172.21.15.73:0/3500588883 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86300ba070 con 0x7f863c053c20 2024-04-15T15:31:57.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f1d09200640 1 -- 172.21.15.73:0/2811946123 shutdown_connections 2024-04-15T15:31:57.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f1d09200640 1 --2- 172.21.15.73:0/2811946123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 0x7f1d04072fe0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f1d09200640 1 --2- 172.21.15.73:0/2811946123 >> v2:172.21.15.118:3300/0 conn(0x7f1d0415a870 0x7f1d0415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f1d09200640 1 -- 172.21.15.73:0/2811946123 >> 172.21.15.73:0/2811946123 conn(0x7f1d040b57b0 msgr2=0x7f1d040b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:57.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f1d09200640 1 -- 172.21.15.73:0/2811946123 shutdown_connections 2024-04-15T15:31:57.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f1d09200640 1 -- 172.21.15.73:0/2811946123 wait complete. 2024-04-15T15:31:57.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8649000640 1 -- 172.21.15.73:0/3500588883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c053c20 msgr2=0x7f863c0540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8649000640 1 --2- 172.21.15.73:0/3500588883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c053c20 0x7f863c0540b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f863c059f30 tx=0x7f8630024c10 comp rx=0 tx=0).stop 2024-04-15T15:31:57.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8649000640 1 -- 172.21.15.73:0/3500588883 shutdown_connections 2024-04-15T15:31:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8649000640 1 --2- 172.21.15.73:0/3500588883 >> v2:172.21.15.73:3300/0 conn(0x7f863c006800 0x7f863c006c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8649000640 1 --2- 172.21.15.73:0/3500588883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c053c20 0x7f863c0540b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8649000640 1 -- 172.21.15.73:0/3500588883 >> 172.21.15.73:0/3500588883 conn(0x7f863c0559f0 msgr2=0x7f863c055e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8649000640 1 -- 172.21.15.73:0/3500588883 shutdown_connections 2024-04-15T15:31:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.753+0000 7f1d09200640 1 Processor -- start 2024-04-15T15:31:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.749+0000 7f8649000640 1 -- 172.21.15.73:0/3500588883 wait complete. 2024-04-15T15:31:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.753+0000 7f1d09200640 1 -- start start 2024-04-15T15:31:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.753+0000 7f8649000640 1 Processor -- start 2024-04-15T15:31:57.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.753+0000 7f8649000640 1 -- start start 2024-04-15T15:31:57.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.753+0000 7f1d09200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d04073520 0x7f1d04149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d09200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 0x7f1d04152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d09200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d0415a870 0x7f1d04157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d09200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0415d3e0 con 0x7f1d04073520 2024-04-15T15:31:57.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d09200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d040b2c60 con 0x7f1d0415a870 2024-04-15T15:31:57.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d09200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1d0415d560 con 0x7f1d040b2630 2024-04-15T15:31:57.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d03e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d0415a870 0x7f1d04157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d03e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d0415a870 0x7f1d04157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50486/0 (socket says 172.21.15.73:50486) 2024-04-15T15:31:57.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d03e00640 1 -- 172.21.15.73:0/1086554512 learned_addr learned my addr 172.21.15.73:0/1086554512 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d02a00640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 0x7f1d04152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8649000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c006800 0x7f863c0e53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8649000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c053c20 0x7f863c16c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d03400640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d04073520 0x7f1d04149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8649000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f863c16cdd0 0x7f863c050af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d03e00640 1 -- 172.21.15.73:0/1086554512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 msgr2=0x7f1d04152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d03e00640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 0x7f1d04152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d03e00640 1 -- 172.21.15.73:0/1086554512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d04073520 msgr2=0x7f1d04149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d03e00640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d04073520 0x7f1d04149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d03e00640 1 -- 172.21.15.73:0/1086554512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0414c2f0 con 0x7f1d0415a870 2024-04-15T15:31:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8649000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f863c00bef0 con 0x7f863c16cdd0 2024-04-15T15:31:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8649000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f863c00bd70 con 0x7f863c053c20 2024-04-15T15:31:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8649000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f863c00c070 con 0x7f863c006800 2024-04-15T15:31:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c006800 0x7f863c0e53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c006800 0x7f863c0e53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:34634/0 (socket says 172.21.15.73:34634) 2024-04-15T15:31:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641e00640 1 -- 172.21.15.73:0/2648044839 learned_addr learned my addr 172.21.15.73:0/2648044839 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641400640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c053c20 0x7f863c16c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d03e00640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d0415a870 0x7f1d04157ac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc005c30 tx=0x7f1cfc00cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8642800640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f863c16cdd0 0x7f863c050af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641e00640 1 -- 172.21.15.73:0/2648044839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c053c20 msgr2=0x7f863c16c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641e00640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c053c20 0x7f863c16c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641e00640 1 -- 172.21.15.73:0/2648044839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f863c16cdd0 msgr2=0x7f863c050af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641e00640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f863c16cdd0 0x7f863c050af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641e00640 1 -- 172.21.15.73:0/2648044839 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c16b810 con 0x7f863c006800 2024-04-15T15:31:57.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641400640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c053c20 0x7f863c16c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1cfb400640 1 -- 172.21.15.73:0/1086554512 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00ac30 con 0x7f1d0415a870 2024-04-15T15:31:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d09200640 1 -- 172.21.15.73:0/1086554512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0414c5b0 con 0x7f1d0415a870 2024-04-15T15:31:57.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f1d09200640 1 -- 172.21.15.73:0/1086554512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0414cb70 con 0x7f1d0415a870 2024-04-15T15:31:57.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.757+0000 7f8641e00640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c006800 0x7f863c0e53e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f863400b410 tx=0x7f863400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.761+0000 7f1cfb400640 1 -- 172.21.15.73:0/1086554512 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cfc00add0 con 0x7f1d0415a870 2024-04-15T15:31:57.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.761+0000 7f1cfb400640 1 -- 172.21.15.73:0/1086554512 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc012620 con 0x7f1d0415a870 2024-04-15T15:31:57.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.761+0000 7f863a000640 1 -- 172.21.15.73:0/2648044839 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634015020 con 0x7f863c006800 2024-04-15T15:31:57.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.761+0000 7f863a000640 1 -- 172.21.15.73:0/2648044839 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8634011830 con 0x7f863c006800 2024-04-15T15:31:57.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.761+0000 7f8649000640 1 -- 172.21.15.73:0/2648044839 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863c16baf0 con 0x7f863c006800 2024-04-15T15:31:57.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.761+0000 7f863a000640 1 -- 172.21.15.73:0/2648044839 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634011c20 con 0x7f863c006800 2024-04-15T15:31:57.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.761+0000 7f8649000640 1 -- 172.21.15.73:0/2648044839 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f863c16c0b0 con 0x7f863c006800 2024-04-15T15:31:57.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.761+0000 7f8649000640 1 -- 172.21.15.73:0/2648044839 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863c0057f0 con 0x7f863c006800 2024-04-15T15:31:57.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.761+0000 7f1d09200640 1 -- 172.21.15.73:0/1086554512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d0404fdd0 con 0x7f1d0415a870 2024-04-15T15:31:57.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.761+0000 7f1cfb400640 1 -- 172.21.15.73:0/1086554512 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1cfc0127c0 con 0x7f1d0415a870 2024-04-15T15:31:57.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.765+0000 7f863a000640 1 -- 172.21.15.73:0/2648044839 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8634018020 con 0x7f863c006800 2024-04-15T15:31:57.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.765+0000 7f1cfb400640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ce4068380 0x7f1ce406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.765+0000 7f1cfb400640 1 -- 172.21.15.73:0/1086554512 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1cfc087270 con 0x7f1d0415a870 2024-04-15T15:31:57.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.765+0000 7f863a000640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f86240683d0 0x7f862406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.765+0000 7f863a000640 1 -- 172.21.15.73:0/2648044839 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8634053b50 con 0x7f863c006800 2024-04-15T15:31:57.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.765+0000 7f8641400640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f86240683d0 0x7f862406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.765+0000 7f1d03400640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ce4068380 0x7f1ce406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.769+0000 7f1d03400640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ce4068380 0x7f1ce406a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d04157630 tx=0x7f1cf4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.769+0000 7f8641400640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f86240683d0 0x7f862406a890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86300b7000 tx=0x7f86300af070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.769+0000 7f1cfb400640 1 -- 172.21.15.73:0/1086554512 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1cfc0574e0 con 0x7f1d0415a870 2024-04-15T15:31:57.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.769+0000 7f863a000640 1 -- 172.21.15.73:0/2648044839 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f863400d280 con 0x7f863c006800 2024-04-15T15:31:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.817+0000 7f2531400640 1 Processor -- start 2024-04-15T15:31:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.817+0000 7f2531400640 1 -- start start 2024-04-15T15:31:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2531400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f252c0c54c0 0x7f252c06cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2531400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c163c00 0x7f252c06fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2531400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252c09ab00 con 0x7f252c09b5a0 2024-04-15T15:31:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2531400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f252c09b110 con 0x7f252c0c54c0 2024-04-15T15:31:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2531400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f252c06d1f0 con 0x7f252c163c00 2024-04-15T15:31:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f252c09b5a0 0x7f252c0c58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:55706/0 (socket says 172.21.15.73:55706) 2024-04-15T15:31:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529e00640 1 -- 172.21.15.73:0/4286515296 learned_addr learned my addr 172.21.15.73:0/4286515296 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848102689 0 0) 0x7f252c09ab00 con 0x7f252c09b5a0 2024-04-15T15:31:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2510003530 con 0x7f252c09b5a0 2024-04-15T15:31:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1023069970 0 0) 0x7f2510003530 con 0x7f252c09b5a0 2024-04-15T15:31:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c163c00 msgr2=0x7f252c06fdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-15T15:31:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c163c00 0x7f252c06fdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 >> v2:172.21.15.118:3300/0 conn(0x7f252c0c54c0 msgr2=0x7f252c06cb60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T15:31:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 --2- 172.21.15.73:0/4286515296 >> v2:172.21.15.118:3300/0 conn(0x7f252c0c54c0 0x7f252c06cb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252c09ada0 con 0x7f252c09b5a0 2024-04-15T15:31:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f251c001680 con 0x7f252c09b5a0 2024-04-15T15:31:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 >> v1:172.21.15.118:6789/0 conn(0x7f252c09b5a0 legacy=0x7f252c0c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25100039c0 0x7f2510003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2510004810 0x7f2510004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25100052f0 0x7f251000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f252c09b110 con 0x7f25100052f0 2024-04-15T15:31:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f252c06d1f0 con 0x7f2510004810 2024-04-15T15:31:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f251000c250 con 0x7f25100039c0 2024-04-15T15:31:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f494ba00640 1 Processor -- start 2024-04-15T15:31:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f252b200640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25100052f0 0x7f251000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f252a800640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25100039c0 0x7f2510003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529e00640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2510004810 0x7f2510004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f252b200640 1 -- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25100039c0 msgr2=0x7f2510003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f252b200640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25100039c0 0x7f2510003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f252b200640 1 -- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2510004810 msgr2=0x7f2510004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f252b200640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2510004810 0x7f2510004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f252b200640 1 -- 172.21.15.73:0/4286515296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252c09ada0 con 0x7f25100052f0 2024-04-15T15:31:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f2529e00640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2510004810 0x7f2510004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:57.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f252a800640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25100039c0 0x7f2510003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:57.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.821+0000 7f494ba00640 1 -- start start 2024-04-15T15:31:57.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f494ba00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f493c053c20 0x7f493c0540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f494ba00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 0x7f493c006c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f494ba00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f493c057df0 con 0x7f493c0e32e0 2024-04-15T15:31:57.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f494ba00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f493c03bfd0 con 0x7f493c053c20 2024-04-15T15:31:57.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f494ba00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f493c03ef60 con 0x7f493c006800 2024-04-15T15:31:57.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f9f6b200640 1 Processor -- start 2024-04-15T15:31:57.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f4943e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f493c053c20 0x7f493c0540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f4943e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f493c053c20 0x7f493c0540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50514/0 (socket says 172.21.15.73:50514) 2024-04-15T15:31:57.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f4943e00640 1 -- 172.21.15.73:0/3691797998 learned_addr learned my addr 172.21.15.73:0/3691797998 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f4949a00640 1 --2- 172.21.15.73:0/3691797998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 0x7f493c006c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7fa680c00640 1 Processor -- start 2024-04-15T15:31:57.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f4943e00640 1 -- 172.21.15.73:0/3691797998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 msgr2=0x7f493c006c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f4943e00640 1 --2- 172.21.15.73:0/3691797998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 0x7f493c006c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f4943e00640 1 -- 172.21.15.73:0/3691797998 >> v1:172.21.15.73:6789/0 conn(0x7f493c0e32e0 legacy=0x7f493c03e850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T15:31:57.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f4943e00640 1 -- 172.21.15.73:0/3691797998 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c0580d0 con 0x7f493c053c20 2024-04-15T15:31:57.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7fa680c00640 1 -- start start 2024-04-15T15:31:57.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f72d6800640 1 Processor -- start 2024-04-15T15:31:57.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f72d6800640 1 -- start start 2024-04-15T15:31:57.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f72d6800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d015c6d0 0x7f72d00d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f72d6800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72d00cd1b0 0x7f72d00d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f72d6800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d00cd690 con 0x7f72d015cab0 2024-04-15T15:31:57.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f72d6800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f72d00cd970 con 0x7f72d00cd1b0 2024-04-15T15:31:57.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.825+0000 7f72d6800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f72d00cdc50 con 0x7f72d015c6d0 2024-04-15T15:31:57.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7fa680c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa67c0d07e0 0x7fa67c0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6b200640 1 -- start start 2024-04-15T15:31:57.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f72cf400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d015c6d0 0x7f72d00d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f72cf400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d015c6d0 0x7f72d00d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:34668/0 (socket says 172.21.15.73:34668) 2024-04-15T15:31:57.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f72cea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72d00cd1b0 0x7f72d00d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f72cf400640 1 -- 172.21.15.73:0/3452155410 learned_addr learned my addr 172.21.15.73:0/3452155410 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f72cfe00640 1 --1- 172.21.15.73:0/3452155410 >> v1:172.21.15.73:6789/0 conn(0x7f72d015cab0 0x7f72d009aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53122/0 (socket says 172.21.15.73:53122) 2024-04-15T15:31:57.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7fa680c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c0d1100 con 0x7fa67c0b4370 2024-04-15T15:31:57.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f72cea00640 1 -- 172.21.15.73:0/3452155410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d015c6d0 msgr2=0x7f72d00d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f72cea00640 1 --2- 172.21.15.73:0/3452155410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d015c6d0 0x7f72d00d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f72cea00640 1 -- 172.21.15.73:0/3452155410 >> v1:172.21.15.73:6789/0 conn(0x7f72d015cab0 legacy=0x7f72d009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f72cea00640 1 -- 172.21.15.73:0/3452155410 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d00cdf30 con 0x7f72d00cd1b0 2024-04-15T15:31:57.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7fa680c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c0b02c0 con 0x7fa67c15c0f0 2024-04-15T15:31:57.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7fa680c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa67c0b50a0 con 0x7fa67c0d07e0 2024-04-15T15:31:57.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f252b200640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25100052f0 0x7f251000b9d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2524009e00 tx=0x7f252401cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0f33860dc4d2f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7fa679e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa67c0d07e0 0x7fa67c0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7fa679400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa67c0b4370 0x7fa67c0b47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53132/0 (socket says 172.21.15.73:53132) 2024-04-15T15:31:57.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7fa679400640 1 -- 172.21.15.73:0/873864760 learned_addr learned my addr 172.21.15.73:0/873864760 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:57.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9f6c15e960 0x7f9f6c0ae170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6b200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f6c0ce600 0x7f9f6c0cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0cbe90 0x7f9f6c0af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7fa679e00640 1 -- 172.21.15.73:0/873864760 >> v1:172.21.15.118:6789/0 conn(0x7fa67c15c0f0 legacy=0x7fa67c15c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7fa679e00640 1 -- 172.21.15.73:0/873864760 >> v1:172.21.15.73:6789/0 conn(0x7fa67c0b4370 legacy=0x7fa67c0b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7fa679e00640 1 -- 172.21.15.73:0/873864760 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c15be90 con 0x7fa67c0d07e0 2024-04-15T15:31:57.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f69400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f6c0ce600 0x7f9f6c0cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f69400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f6c0ce600 0x7f9f6c0cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50542/0 (socket says 172.21.15.73:50542) 2024-04-15T15:31:57.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f69e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9f6c15e960 0x7f9f6c0ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6b200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9f6c0ae800 con 0x7f9f6c15e960 2024-04-15T15:31:57.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6b200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f9f6c0aeae0 con 0x7f9f6c0ce600 2024-04-15T15:31:57.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6c0aedc0 con 0x7f9f6c0cbe90 2024-04-15T15:31:57.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6a800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0cbe90 0x7f9f6c0af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6a800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0cbe90 0x7f9f6c0af8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:34684/0 (socket says 172.21.15.73:34684) 2024-04-15T15:31:57.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6a800640 1 -- 172.21.15.73:0/2761894737 learned_addr learned my addr 172.21.15.73:0/2761894737 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25240b2070 con 0x7f25100052f0 2024-04-15T15:31:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6a800640 1 -- 172.21.15.73:0/2761894737 >> v2:172.21.15.118:3300/0 conn(0x7f9f6c0ce600 msgr2=0x7f9f6c0cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6a800640 1 --2- 172.21.15.73:0/2761894737 >> v2:172.21.15.118:3300/0 conn(0x7f9f6c0ce600 0x7f9f6c0cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6a800640 1 -- 172.21.15.73:0/2761894737 >> v2:172.21.15.73:3300/0 conn(0x7f9f6c15e960 msgr2=0x7f9f6c0ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.829+0000 7f9f6a800640 1 --2- 172.21.15.73:0/2761894737 >> v2:172.21.15.73:3300/0 conn(0x7f9f6c15e960 0x7f9f6c0ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f9f6a800640 1 -- 172.21.15.73:0/2761894737 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6c0af0a0 con 0x7f9f6c0cbe90 2024-04-15T15:31:57.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25240a5de0 con 0x7f25100052f0 2024-04-15T15:31:57.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f9f69400640 1 --2- 172.21.15.73:0/2761894737 >> v2:172.21.15.118:3300/0 conn(0x7f9f6c0ce600 0x7f9f6c0cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:57.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f9f69e00640 1 --2- 172.21.15.73:0/2761894737 >> v2:172.21.15.73:3300/0 conn(0x7f9f6c15e960 0x7f9f6c0ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:57.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f2529400640 1 -- 172.21.15.73:0/4286515296 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524009a50 con 0x7f25100052f0 2024-04-15T15:31:57.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72cea00640 1 --2- 172.21.15.73:0/3452155410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d00cd1b0 0x7f72d00d12b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00dbe0 tx=0x7f72bc0207a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68313de750eacce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f2531400640 1 -- 172.21.15.73:0/4286515296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25100052f0 msgr2=0x7f251000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f2531400640 1 --2- 172.21.15.73:0/4286515296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25100052f0 0x7f251000b9d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2524009e00 tx=0x7f252401cdd0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f252b200640 1 -- 172.21.15.73:0/4286515296 reap_dead start 2024-04-15T15:31:57.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f2531400640 1 -- 172.21.15.73:0/4286515296 shutdown_connections 2024-04-15T15:31:57.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f2531400640 1 -- 172.21.15.73:0/4286515296 >> 172.21.15.73:0/4286515296 conn(0x7f252c0b3fe0 msgr2=0x7f252c0b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:57.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f2531400640 1 -- 172.21.15.73:0/4286515296 shutdown_connections 2024-04-15T15:31:57.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72ce000640 1 -- 172.21.15.73:0/3452155410 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00d2d0 con 0x7f72d00cd1b0 2024-04-15T15:31:57.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72ce000640 1 -- 172.21.15.73:0/3452155410 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc0a9560 con 0x7f72d00cd1b0 2024-04-15T15:31:57.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72ce000640 1 -- 172.21.15.73:0/3452155410 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0a9930 con 0x7f72d00cd1b0 2024-04-15T15:31:57.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72d6800640 1 -- 172.21.15.73:0/3452155410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d00cd1b0 msgr2=0x7f72d00d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72d6800640 1 --2- 172.21.15.73:0/3452155410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d00cd1b0 0x7f72d00d12b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00dbe0 tx=0x7f72bc0207a0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72d6800640 1 -- 172.21.15.73:0/3452155410 shutdown_connections 2024-04-15T15:31:57.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72d6800640 1 --2- 172.21.15.73:0/3452155410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d00cd1b0 0x7f72d00d12b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72d6800640 1 --2- 172.21.15.73:0/3452155410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d015c6d0 0x7f72d00d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72d6800640 1 -- 172.21.15.73:0/3452155410 >> 172.21.15.73:0/3452155410 conn(0x7f72d00b3fe0 msgr2=0x7f72d00b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:57.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f2531400640 1 -- 172.21.15.73:0/4286515296 wait complete. 2024-04-15T15:31:57.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72d6800640 1 -- 172.21.15.73:0/3452155410 shutdown_connections 2024-04-15T15:31:57.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.833+0000 7f72d6800640 1 -- 172.21.15.73:0/3452155410 wait complete. 2024-04-15T15:31:57.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f4943e00640 1 --2- 172.21.15.73:0/3691797998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 0x7f493c0540b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4930009870 tx=0x7f493001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a430e1a2f99a57ba server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2531400640 1 Processor -- start 2024-04-15T15:31:57.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2531400640 1 -- start start 2024-04-15T15:31:57.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f4943400640 1 -- 172.21.15.73:0/3691797998 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49300b0070 con 0x7f493c053c20 2024-04-15T15:31:57.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f4943400640 1 -- 172.21.15.73:0/3691797998 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49300ab600 con 0x7f493c053c20 2024-04-15T15:31:57.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f4943400640 1 -- 172.21.15.73:0/3691797998 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49300ab9d0 con 0x7f493c053c20 2024-04-15T15:31:57.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7fa679e00640 1 --2- 172.21.15.73:0/873864760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c0d07e0 0x7fa67c0d0bc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c2e0 tx=0x7fa67401dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=646bf93047bb4720 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f9f6a800640 1 --2- 172.21.15.73:0/2761894737 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0cbe90 0x7f9f6c0af8a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c073bf0 tx=0x7f9f6401c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad0e8332735d68c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7fa678a00640 1 -- 172.21.15.73:0/873864760 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67400a0d0 con 0x7fa67c0d07e0 2024-04-15T15:31:57.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f494ba00640 1 -- 172.21.15.73:0/3691797998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 msgr2=0x7f493c0540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2531400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25100052f0 0x7f252c0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2531400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c157f00 0x7f252c0b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2531400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c0b7090 0x7f252c09f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2531400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f252c06d650 con 0x7f25100052f0 2024-04-15T15:31:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2531400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f252c06d4d0 con 0x7f252c157f00 2024-04-15T15:31:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2531400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f252c164090 con 0x7f252c0b7090 2024-04-15T15:31:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f72d6800640 1 Processor -- start 2024-04-15T15:31:57.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f72d6800640 1 -- start start 2024-04-15T15:31:57.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f252a800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25100052f0 0x7f252c0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2529e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c157f00 0x7f252c0b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f494ba00640 1 --2- 172.21.15.73:0/3691797998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 0x7f493c0540b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4930009870 tx=0x7f493001c540 comp rx=0 tx=0).stop 2024-04-15T15:31:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f494ba00640 1 -- 172.21.15.73:0/3691797998 shutdown_connections 2024-04-15T15:31:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f494ba00640 1 --2- 172.21.15.73:0/3691797998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 0x7f493c006c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f494ba00640 1 --2- 172.21.15.73:0/3691797998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 0x7f493c0540b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f494ba00640 1 -- 172.21.15.73:0/3691797998 >> 172.21.15.73:0/3691797998 conn(0x7f493c0559f0 msgr2=0x7f493c055e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f494ba00640 1 -- 172.21.15.73:0/3691797998 shutdown_connections 2024-04-15T15:31:57.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f494ba00640 1 -- 172.21.15.73:0/3691797998 wait complete. 2024-04-15T15:31:57.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2529e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c157f00 0x7f252c0b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50544/0 (socket says 172.21.15.73:50544) 2024-04-15T15:31:57.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2529e00640 1 -- 172.21.15.73:0/2182615806 learned_addr learned my addr 172.21.15.73:0/2182615806 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7fa678a00640 1 -- 172.21.15.73:0/873864760 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67400a270 con 0x7fa67c0d07e0 2024-04-15T15:31:57.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7fa678a00640 1 -- 172.21.15.73:0/873864760 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67400a640 con 0x7fa67c0d07e0 2024-04-15T15:31:57.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f252b200640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c0b7090 0x7f252c09f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7fa680c00640 1 -- 172.21.15.73:0/873864760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c0d07e0 msgr2=0x7fa67c0d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f9f68a00640 1 -- 172.21.15.73:0/2761894737 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f640a5750 con 0x7f9f6c0cbe90 2024-04-15T15:31:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f9f68a00640 1 -- 172.21.15.73:0/2761894737 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f640a58f0 con 0x7f9f6c0cbe90 2024-04-15T15:31:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f9f68a00640 1 -- 172.21.15.73:0/2761894737 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f640a5cc0 con 0x7f9f6c0cbe90 2024-04-15T15:31:57.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7fa680c00640 1 --2- 172.21.15.73:0/873864760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c0d07e0 0x7fa67c0d0bc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c2e0 tx=0x7fa67401dde0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2529e00640 1 -- 172.21.15.73:0/2182615806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c0b7090 msgr2=0x7f252c09f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2529e00640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c0b7090 0x7f252c09f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2529e00640 1 -- 172.21.15.73:0/2182615806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25100052f0 msgr2=0x7f252c0c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2529e00640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25100052f0 0x7f252c0c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7f2529e00640 1 -- 172.21.15.73:0/2182615806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252c09e190 con 0x7f252c157f00 2024-04-15T15:31:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7fa680c00640 1 -- 172.21.15.73:0/873864760 shutdown_connections 2024-04-15T15:31:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7fa680c00640 1 --2- 172.21.15.73:0/873864760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c0d07e0 0x7fa67c0d0bc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.837+0000 7fa680c00640 1 -- 172.21.15.73:0/873864760 >> 172.21.15.73:0/873864760 conn(0x7fa67c06ba50 msgr2=0x7fa67c06be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7fa680c00640 1 -- 172.21.15.73:0/873864760 shutdown_connections 2024-04-15T15:31:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f2529e00640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c157f00 0x7f252c0b6b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f251c005670 tx=0x7f251c00e4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f2522a00640 1 -- 172.21.15.73:0/2182615806 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c01b070 con 0x7f252c157f00 2024-04-15T15:31:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f2522a00640 1 -- 172.21.15.73:0/2182615806 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f251c011040 con 0x7f252c157f00 2024-04-15T15:31:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f2531400640 1 -- 172.21.15.73:0/2182615806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f252c09e430 con 0x7f252c157f00 2024-04-15T15:31:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72d6800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d00cd1b0 0x7f72d0156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72d6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d015c6d0 0x7f72d00c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cf400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d00cd1b0 0x7f72d0156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cf400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d00cd1b0 0x7f72d0156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:34706/0 (socket says 172.21.15.73:34706) 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cf400640 1 -- 172.21.15.73:0/3331047311 learned_addr learned my addr 172.21.15.73:0/3331047311 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72d6800640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d015cab0 0x7f72d00b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f72d00b1890 con 0x7f72d015c6d0 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f72d009b380 con 0x7f72d015cab0 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f72d00b1a10 con 0x7f72d00cd1b0 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f9f6b200640 1 -- 172.21.15.73:0/2761894737 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0cbe90 msgr2=0x7f9f6c0af8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f9f6b200640 1 --2- 172.21.15.73:0/2761894737 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0cbe90 0x7f9f6c0af8a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c073bf0 tx=0x7f9f6401c9c0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f9f6b200640 1 -- 172.21.15.73:0/2761894737 shutdown_connections 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f9f6b200640 1 --2- 172.21.15.73:0/2761894737 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0cbe90 0x7f9f6c0af8a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f9f6b200640 1 --2- 172.21.15.73:0/2761894737 >> v2:172.21.15.118:3300/0 conn(0x7f9f6c0ce600 0x7f9f6c0cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f9f6b200640 1 --2- 172.21.15.73:0/2761894737 >> v2:172.21.15.73:3300/0 conn(0x7f9f6c15e960 0x7f9f6c0ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f9f6b200640 1 -- 172.21.15.73:0/2761894737 >> 172.21.15.73:0/2761894737 conn(0x7f9f6c0b2e90 msgr2=0x7f9f6c0b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:57.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cea00640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d015c6d0 0x7f72d00c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f494ba00640 1 Processor -- start 2024-04-15T15:31:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f2522a00640 1 -- 172.21.15.73:0/2182615806 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c0145a0 con 0x7f252c157f00 2024-04-15T15:31:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f2531400640 1 -- 172.21.15.73:0/2182615806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f252c09e9f0 con 0x7f252c157f00 2024-04-15T15:31:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cfe00640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d015cab0 0x7f72d00b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cf400640 1 -- 172.21.15.73:0/3331047311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d015cab0 msgr2=0x7f72d00b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cf400640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d015cab0 0x7f72d00b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7fa680c00640 1 -- 172.21.15.73:0/873864760 wait complete. 2024-04-15T15:31:57.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f2531400640 1 -- 172.21.15.73:0/2182615806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f252c068ab0 con 0x7f252c157f00 2024-04-15T15:31:57.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cf400640 1 -- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d015c6d0 msgr2=0x7f72d00c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cf400640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d015c6d0 0x7f72d00c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cf400640 1 -- 172.21.15.73:0/3331047311 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d015abd0 con 0x7f72d00cd1b0 2024-04-15T15:31:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cea00640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d015c6d0 0x7f72d00c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cfe00640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d015cab0 0x7f72d00b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f494ba00640 1 -- start start 2024-04-15T15:31:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f494ba00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 0x7f493c188c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f494ba00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 0x7f493c0e3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f72cf400640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d00cd1b0 0x7f72d0156e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f72c000e870 tx=0x7f72c000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f494ba00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f493c0528f0 0x7f493c0e18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f4949000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 0x7f493c188c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f4949000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 0x7f493c188c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:34718/0 (socket says 172.21.15.73:34718) 2024-04-15T15:31:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f4943e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 0x7f493c0e3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f4943e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 0x7f493c0e3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50568/0 (socket says 172.21.15.73:50568) 2024-04-15T15:31:57.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f4949a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f493c0528f0 0x7f493c0e18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f4949a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f493c0528f0 0x7f493c0e18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58734/0 (socket says 172.21.15.73:58734) 2024-04-15T15:31:57.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7fa680c00640 1 Processor -- start 2024-04-15T15:31:57.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f4949000640 1 -- 172.21.15.73:0/909864773 learned_addr learned my addr 172.21.15.73:0/909864773 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f493c0efe80 con 0x7f493c0528f0 2024-04-15T15:31:57.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f493c0efd00 con 0x7f493c053c20 2024-04-15T15:31:57.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f493c0f0000 con 0x7f493c006800 2024-04-15T15:31:57.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f2522a00640 1 -- 172.21.15.73:0/2182615806 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f251c01e070 con 0x7f252c157f00 2024-04-15T15:31:57.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f9f6b200640 1 -- 172.21.15.73:0/2761894737 shutdown_connections 2024-04-15T15:31:57.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.841+0000 7f9f6b200640 1 -- 172.21.15.73:0/2761894737 wait complete. 2024-04-15T15:31:57.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa680c00640 1 -- start start 2024-04-15T15:31:57.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f5761800640 1 Processor -- start 2024-04-15T15:31:57.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f4943e00640 1 -- 172.21.15.73:0/909864773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 msgr2=0x7f493c188c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f4943e00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 0x7f493c188c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f4943e00640 1 -- 172.21.15.73:0/909864773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f493c0528f0 msgr2=0x7f493c0e18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f4943e00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f493c0528f0 0x7f493c0e18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f4943e00640 1 -- 172.21.15.73:0/909864773 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c052da0 con 0x7f493c053c20 2024-04-15T15:31:57.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f4949a00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f493c0528f0 0x7f493c0e18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:57.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f5761800640 1 -- start start 2024-04-15T15:31:57.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f9f6b200640 1 Processor -- start 2024-04-15T15:31:57.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa680c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67c0b4370 0x7fa67c1463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa680c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa67c0d07e0 0x7fa67c0a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa680c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c15c0f0 0x7fa67c0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa680c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c15ad70 con 0x7fa67c0d07e0 2024-04-15T15:31:57.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa680c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c15b970 con 0x7fa67c15c0f0 2024-04-15T15:31:57.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa680c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa67c15d0a0 con 0x7fa67c0b4370 2024-04-15T15:31:57.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f2522a00640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f250c068480 0x7f250c06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f2522a00640 1 -- 172.21.15.73:0/2182615806 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f251c089960 con 0x7f252c157f00 2024-04-15T15:31:57.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f252a800640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f250c068480 0x7f250c06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f9f6b200640 1 -- start start 2024-04-15T15:31:57.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f4943e00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 0x7f493c0e3a90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f49300ab000 tx=0x7f49300192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa679400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa67c0d07e0 0x7fa67c0a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa67a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c15c0f0 0x7fa67c0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa67a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c15c0f0 0x7fa67c0b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50580/0 (socket says 172.21.15.73:50580) 2024-04-15T15:31:57.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa67a800640 1 -- 172.21.15.73:0/4249080220 learned_addr learned my addr 172.21.15.73:0/4249080220 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa679e00640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67c0b4370 0x7fa67c1463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa679400640 1 -- 172.21.15.73:0/4249080220 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67c0b4370 msgr2=0x7fa67c1463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa679400640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67c0b4370 0x7fa67c1463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa679400640 1 -- 172.21.15.73:0/4249080220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c15c0f0 msgr2=0x7fa67c0b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa679400640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c15c0f0 0x7fa67c0b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa679400640 1 -- 172.21.15.73:0/4249080220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0a9a00 con 0x7fa67c0d07e0 2024-04-15T15:31:57.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa67a800640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c15c0f0 0x7fa67c0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:57.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f9f6b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f6c0cbe90 0x7f9f6c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7fa679400640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa67c0d07e0 0x7fa67c0a94c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c340 tx=0x7fa66c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f72c7400640 1 -- 172.21.15.73:0/3331047311 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0017070 con 0x7f72d00cd1b0 2024-04-15T15:31:57.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f72c7400640 1 -- 172.21.15.73:0/3331047311 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c000c940 con 0x7f72d00cd1b0 2024-04-15T15:31:57.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f252a800640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f250c068480 0x7f250c06a940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f251800b800 tx=0x7f2518008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f72c7400640 1 -- 172.21.15.73:0/3331047311 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c000cd10 con 0x7f72d00cd1b0 2024-04-15T15:31:57.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d00b7700 con 0x7f72d00cd1b0 2024-04-15T15:31:57.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.845+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d00b7cc0 con 0x7f72d00cd1b0 2024-04-15T15:31:57.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7fa672000640 1 -- 172.21.15.73:0/4249080220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c017070 con 0x7fa67c0d07e0 2024-04-15T15:31:57.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5761800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f575c072520 0x7f575c0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5761800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f575c0b3e30 0x7f575c0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5761800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f575c0b44c0 con 0x7f575c15a850 2024-04-15T15:31:57.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5761800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f575c0b4280 con 0x7f575c0b3e30 2024-04-15T15:31:57.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5761800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f575c06e7e0 con 0x7f575c072520 2024-04-15T15:31:57.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7fa680c00640 1 -- 172.21.15.73:0/4249080220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c143ba0 con 0x7fa67c0d07e0 2024-04-15T15:31:57.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7fa680c00640 1 -- 172.21.15.73:0/4249080220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67c144160 con 0x7fa67c0d07e0 2024-04-15T15:31:57.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f575aa00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f575c15a850 0x7f575c071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:55728/0 (socket says 172.21.15.73:55728) 2024-04-15T15:31:57.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7fa672000640 1 -- 172.21.15.73:0/4249080220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c005cf0 con 0x7fa67c0d07e0 2024-04-15T15:31:57.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f575aa00640 1 -- 172.21.15.73:0/1657026935 learned_addr learned my addr 172.21.15.73:0/1657026935 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:57.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f6b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0ce600 0x7f9f6c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f6b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f6c15e960 0x7f9f6c0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f6b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c0d0e40 con 0x7f9f6c15e960 2024-04-15T15:31:57.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f6b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c0d0cc0 con 0x7f9f6c0cbe90 2024-04-15T15:31:57.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f6b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6c06ba50 con 0x7f9f6c0ce600 2024-04-15T15:31:57.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f69e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f6c0cbe90 0x7f9f6c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f69e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f6c0cbe90 0x7f9f6c15f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50596/0 (socket says 172.21.15.73:50596) 2024-04-15T15:31:57.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f69e00640 1 -- 172.21.15.73:0/2284060044 learned_addr learned my addr 172.21.15.73:0/2284060044 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f69400640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0ce600 0x7f9f6c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f69400640 1 -- 172.21.15.73:0/2284060044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f6c0cbe90 msgr2=0x7f9f6c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f69400640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f6c0cbe90 0x7f9f6c15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f69400640 1 -- 172.21.15.73:0/2284060044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f6c15e960 msgr2=0x7f9f6c0b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f69400640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f6c15e960 0x7f9f6c0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f9f69400640 1 -- 172.21.15.73:0/2284060044 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6c15f9a0 con 0x7f9f6c0ce600 2024-04-15T15:31:57.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475543105 0 0) 0x7f575c0b44c0 con 0x7f575c15a850 2024-04-15T15:31:57.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5740003530 con 0x7f575c15a850 2024-04-15T15:31:57.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7fa672000640 1 -- 172.21.15.73:0/4249080220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c021060 con 0x7fa67c0d07e0 2024-04-15T15:31:57.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f4940c00640 1 -- 172.21.15.73:0/909864773 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49300ba070 con 0x7f493c053c20 2024-04-15T15:31:57.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f4940c00640 1 -- 172.21.15.73:0/909864773 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49300b1040 con 0x7f493c053c20 2024-04-15T15:31:57.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f4940c00640 1 -- 172.21.15.73:0/909864773 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49300b0050 con 0x7f493c053c20 2024-04-15T15:31:57.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3115707603 0 0) 0x7f5740003530 con 0x7f575c15a850 2024-04-15T15:31:57.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 >> v2:172.21.15.118:3300/0 conn(0x7f575c072520 msgr2=0x7f575c0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a80052a0 con 0x7f72d00cd1b0 2024-04-15T15:31:57.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f575a000640 1 --2- 172.21.15.73:0/1657026935 >> v2:172.21.15.118:3300/0 conn(0x7f575c072520 0x7f575c0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f2522a00640 1 -- 172.21.15.73:0/2182615806 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f251c059570 con 0x7f252c157f00 2024-04-15T15:31:57.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493c051850 con 0x7f493c053c20 2024-04-15T15:31:57.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493c051e10 con 0x7f493c053c20 2024-04-15T15:31:57.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 --2- 172.21.15.73:0/1657026935 >> v2:172.21.15.118:3300/0 conn(0x7f575c072520 0x7f575c0cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 >> v2:172.21.15.73:3300/0 conn(0x7f575c0b3e30 msgr2=0x7f575c0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 --2- 172.21.15.73:0/1657026935 >> v2:172.21.15.73:3300/0 conn(0x7f575c0b3e30 0x7f575c0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c06deb0 con 0x7f575c15a850 2024-04-15T15:31:57.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f5748001680 con 0x7f575c15a850 2024-04-15T15:31:57.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 >> v1:172.21.15.118:6789/0 conn(0x7f575c15a850 legacy=0x7f575c071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57400039c0 0x7f5740003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5740004810 0x7f5740004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57400052f0 0x7f574000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f575c0b4280 con 0x7f57400052f0 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f575c06e7e0 con 0x7f5740004810 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f574000c330 con 0x7f57400039c0 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f575a000640 1 --2- 172.21.15.73:0/1657026935 >> v2:172.21.15.118:3300/0 conn(0x7f575c072520 0x7f575c0cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f575aa00640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57400039c0 0x7f5740003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f575a000640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5740004810 0x7f5740004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f575aa00640 1 -- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5740004810 msgr2=0x7f5740004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.849+0000 7f72c7400640 1 -- 172.21.15.73:0/3331047311 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72c001a070 con 0x7f72d00cd1b0 2024-04-15T15:31:57.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f72c7400640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f72b00683d0 0x7f72b006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493c0057f0 con 0x7f493c053c20 2024-04-15T15:31:57.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f575aa00640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5740004810 0x7f5740004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f575aa00640 1 -- 172.21.15.73:0/1657026935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57400052f0 msgr2=0x7f574000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:57.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f575aa00640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57400052f0 0x7f574000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f575aa00640 1 -- 172.21.15.73:0/1657026935 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c06deb0 con 0x7f57400039c0 2024-04-15T15:31:57.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f575a000640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5740004810 0x7f5740004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:57.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f72cea00640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f72b00683d0 0x7f72b006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7fa680c00640 1 -- 172.21.15.73:0/4249080220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6540052a0 con 0x7fa67c0d07e0 2024-04-15T15:31:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f9f69400640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0ce600 0x7f9f6c1528f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00e5e0 tx=0x7f9f5c00eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f575b400640 1 -- 172.21.15.73:0/1657026935 reap_dead start 2024-04-15T15:31:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f4940c00640 1 -- 172.21.15.73:0/909864773 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f493c0079e0 con 0x7f493c053c20 2024-04-15T15:31:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7fa672000640 1 -- 172.21.15.73:0/4249080220 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa66c01a070 con 0x7fa67c0d07e0 2024-04-15T15:31:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7fa672000640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa65c068380 0x7fa65c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7fa672000640 1 -- 172.21.15.73:0/4249080220 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa66c085eb0 con 0x7fa67c0d07e0 2024-04-15T15:31:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.853+0000 7f4940c00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f49240683d0 0x7f492406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f9f62000640 1 -- 172.21.15.73:0/2284060044 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c00f040 con 0x7f9f6c0ce600 2024-04-15T15:31:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f9f62000640 1 -- 172.21.15.73:0/2284060044 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f5c004230 con 0x7f9f6c0ce600 2024-04-15T15:31:57.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f4940c00640 1 -- 172.21.15.73:0/909864773 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f493011fdc0 con 0x7f493c053c20 2024-04-15T15:31:57.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7fa679e00640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa65c068380 0x7fa65c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f9f62000640 1 -- 172.21.15.73:0/2284060044 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c003620 con 0x7f9f6c0ce600 2024-04-15T15:31:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f9f6b200640 1 -- 172.21.15.73:0/2284060044 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6c15fc80 con 0x7f9f6c0ce600 2024-04-15T15:31:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f4949000640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f49240683d0 0x7f492406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f9f6b200640 1 -- 172.21.15.73:0/2284060044 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6c160240 con 0x7f9f6c0ce600 2024-04-15T15:31:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f72cea00640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f72b00683d0 0x7f72b006a890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0b2000 tx=0x7f72bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f575aa00640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57400039c0 0x7f5740003de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f574800c290 tx=0x7f574801cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7935ca82102ed427 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7fa679e00640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa65c068380 0x7fa65c06a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6740af000 tx=0x7fa67400c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f72c7400640 1 -- 172.21.15.73:0/3331047311 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f72c0054c40 con 0x7f72d00cd1b0 2024-04-15T15:31:57.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f9f6b200640 1 -- 172.21.15.73:0/2284060044 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f440052a0 con 0x7f9f6c0ce600 2024-04-15T15:31:57.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.857+0000 7f4949000640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f49240683d0 0x7f492406a890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f49380099a0 tx=0x7f49380090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5748007d70 con 0x7f57400039c0 2024-04-15T15:31:57.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f72c7400640 1 -- 172.21.15.73:0/3331047311 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f72c00572a0 con 0x7f72d00cd1b0 2024-04-15T15:31:57.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f5759600640 1 -- 172.21.15.73:0/1657026935 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57480a9020 con 0x7f57400039c0 2024-04-15T15:31:57.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f5761800640 1 -- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57400039c0 msgr2=0x7f5740003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f5761800640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57400039c0 0x7f5740003de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f574800c290 tx=0x7f574801cd00 comp rx=0 tx=0).stop 2024-04-15T15:31:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f5761800640 1 -- 172.21.15.73:0/1657026935 shutdown_connections 2024-04-15T15:31:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f5761800640 1 --2- 172.21.15.73:0/1657026935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57400039c0 0x7f5740003de0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f5761800640 1 -- 172.21.15.73:0/1657026935 >> 172.21.15.73:0/1657026935 conn(0x7f575c0d0540 msgr2=0x7f575c0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f5761800640 1 -- 172.21.15.73:0/1657026935 shutdown_connections 2024-04-15T15:31:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f4940c00640 1 -- 172.21.15.73:0/909864773 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4930016130 con 0x7f493c053c20 2024-04-15T15:31:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f5761800640 1 -- 172.21.15.73:0/1657026935 wait complete. 2024-04-15T15:31:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.861+0000 7f9f62000640 1 -- 172.21.15.73:0/2284060044 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f5c0037c0 con 0x7f9f6c0ce600 2024-04-15T15:31:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f5761800640 1 Processor -- start 2024-04-15T15:31:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f9f62000640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f4c068450 0x7f9f4c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f5761800640 1 -- start start 2024-04-15T15:31:57.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f9f62000640 1 -- 172.21.15.73:0/2284060044 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9f5c086bf0 con 0x7f9f6c0ce600 2024-04-15T15:31:57.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f9f62000640 1 -- 172.21.15.73:0/2284060044 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f5c017020 con 0x7f9f6c0ce600 2024-04-15T15:31:57.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f5761800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f575c151ef0 0x7f575c0cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f9f69e00640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f4c068450 0x7f9f4c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f5761800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c15c310 0x7f575c158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7fa672000640 1 -- 172.21.15.73:0/4249080220 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa66c055ad0 con 0x7fa67c0d07e0 2024-04-15T15:31:57.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f575a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c15c310 0x7f575c158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f575a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c15c310 0x7f575c158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50612/0 (socket says 172.21.15.73:50612) 2024-04-15T15:31:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f575aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f575c151ef0 0x7f575c0cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f575aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f575c151ef0 0x7f575c0cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58782/0 (socket says 172.21.15.73:58782) 2024-04-15T15:31:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f5761800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f575c1586c0 0x7f575c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f5761800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f575c15ac30 con 0x7f575c151ef0 2024-04-15T15:31:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f5761800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f575c06e470 con 0x7f575c15c310 2024-04-15T15:31:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f5761800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f575c0b2120 con 0x7f575c1586c0 2024-04-15T15:31:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.865+0000 7f575a000640 1 -- 172.21.15.73:0/2750713260 learned_addr learned my addr 172.21.15.73:0/2750713260 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.869+0000 7f9f69e00640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f4c068450 0x7f9f4c06a910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c159dd0 tx=0x7f9f58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.869+0000 7f575b400640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f575c1586c0 0x7f575c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.869+0000 7f575a000640 1 -- 172.21.15.73:0/2750713260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f575c1586c0 msgr2=0x7f575c15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.869+0000 7f575a000640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f575c1586c0 0x7f575c15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.869+0000 7f575a000640 1 -- 172.21.15.73:0/2750713260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f575c151ef0 msgr2=0x7f575c0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.869+0000 7f575a000640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f575c151ef0 0x7f575c0cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.869+0000 7f575a000640 1 -- 172.21.15.73:0/2750713260 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c0cd660 con 0x7f575c15c310 2024-04-15T15:31:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.869+0000 7f575a000640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c15c310 0x7f575c158180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f574c01e870 tx=0x7f574c01ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.873+0000 7f5752a00640 1 -- 172.21.15.73:0/2750713260 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c019910 con 0x7f575c15c310 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.873+0000 7f5752a00640 1 -- 172.21.15.73:0/2750713260 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c019ab0 con 0x7f575c15c310 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.873+0000 7f5752a00640 1 -- 172.21.15.73:0/2750713260 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c023470 con 0x7f575c15c310 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.873+0000 7f5761800640 1 -- 172.21.15.73:0/2750713260 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c0cd940 con 0x7f575c15c310 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.873+0000 7f5761800640 1 -- 172.21.15.73:0/2750713260 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c0cdf00 con 0x7f575c15c310 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.877+0000 7f5761800640 1 -- 172.21.15.73:0/2750713260 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575c158ad0 con 0x7f575c15c310 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.877+0000 7f5752a00640 1 -- 172.21.15.73:0/2750713260 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f574c023610 con 0x7f575c15c310 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.881+0000 7f5752a00640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f573c068380 0x7f573c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.881+0000 7f5752a00640 1 -- 172.21.15.73:0/2750713260 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f574c0982f0 con 0x7f575c15c310 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.885+0000 7f575aa00640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f573c068380 0x7f573c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.885+0000 7f5752a00640 1 -- 172.21.15.73:0/2750713260 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f575c158ad0 con 0x7f575c15c310 2024-04-15T15:31:57.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:57.885+0000 7f575aa00640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f573c068380 0x7f573c06a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f57480aa000 tx=0x7f57480019f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:58.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.105+0000 7f1d09200640 1 -- 172.21.15.73:0/1086554512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1d0415a040 con 0x7f1d0415a870 2024-04-15T15:31:58.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.109+0000 7f1cfb400640 1 -- 172.21.15.73:0/1086554512 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1cfc056de0 con 0x7f1d0415a870 2024-04-15T15:31:58.112 INFO:teuthology.orchestra.run.smithi073.stdout:55834574860 2024-04-15T15:31:58.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.109+0000 7f8649000640 1 -- 172.21.15.73:0/2648044839 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f863c005c10 con 0x7f863c006800 2024-04-15T15:31:58.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.109+0000 7f1d09200640 1 -- 172.21.15.73:0/1086554512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ce4068380 msgr2=0x7f1ce406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.109+0000 7f1d09200640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ce4068380 0x7f1ce406a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d04157630 tx=0x7f1cf4008040 comp rx=0 tx=0).stop 2024-04-15T15:31:58.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.109+0000 7f1d09200640 1 -- 172.21.15.73:0/1086554512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d0415a870 msgr2=0x7f1d04157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.109+0000 7f1d09200640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d0415a870 0x7f1d04157ac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc005c30 tx=0x7f1cfc00cf90 comp rx=0 tx=0).stop 2024-04-15T15:31:58.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.113+0000 7f1d09200640 1 -- 172.21.15.73:0/1086554512 shutdown_connections 2024-04-15T15:31:58.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.113+0000 7f1d09200640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d0415a870 0x7f1d04157ac0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.113+0000 7f1d09200640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ce4068380 0x7f1ce406a840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.113+0000 7f1d09200640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d040b2630 0x7f1d04152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.113+0000 7f1d09200640 1 --2- 172.21.15.73:0/1086554512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d04073520 0x7f1d04149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.113+0000 7f1d09200640 1 -- 172.21.15.73:0/1086554512 >> 172.21.15.73:0/1086554512 conn(0x7f1d040b57b0 msgr2=0x7f1d0409a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.113+0000 7f1d09200640 1 -- 172.21.15.73:0/1086554512 shutdown_connections 2024-04-15T15:31:58.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.113+0000 7f1d09200640 1 -- 172.21.15.73:0/1086554512 wait complete. 2024-04-15T15:31:58.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.113+0000 7f863a000640 1 -- 172.21.15.73:0/2648044839 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86340561b0 con 0x7f863c006800 2024-04-15T15:31:58.114 INFO:teuthology.orchestra.run.smithi073.stdout:55834574859 2024-04-15T15:31:58.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 -- 172.21.15.73:0/2648044839 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f86240683d0 msgr2=0x7f862406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f86240683d0 0x7f862406a890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86300b7000 tx=0x7f86300af070 comp rx=0 tx=0).stop 2024-04-15T15:31:58.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 -- 172.21.15.73:0/2648044839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c006800 msgr2=0x7f863c0e53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c006800 0x7f863c0e53e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f863400b410 tx=0x7f863400b8d0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 -- 172.21.15.73:0/2648044839 shutdown_connections 2024-04-15T15:31:58.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f863c16cdd0 0x7f863c050af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c053c20 0x7f863c16c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f86240683d0 0x7f862406a890 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86300b7000 tx=0x7f86300af070 comp rx=0 tx=0).stop 2024-04-15T15:31:58.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 --2- 172.21.15.73:0/2648044839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c006800 0x7f863c0e53e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 -- 172.21.15.73:0/2648044839 >> 172.21.15.73:0/2648044839 conn(0x7f863c0559f0 msgr2=0x7f863c038990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 -- 172.21.15.73:0/2648044839 shutdown_connections 2024-04-15T15:31:58.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.121+0000 7f8649000640 1 -- 172.21.15.73:0/2648044839 wait complete. 2024-04-15T15:31:58.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2024-04-15T15:31:58.149 DEBUG:teuthology.parallel:result is None 2024-04-15T15:31:58.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-04-15T15:31:58.155 DEBUG:teuthology.parallel:result is None 2024-04-15T15:31:58.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.177+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f493c0dcf80 con 0x7f493c053c20 2024-04-15T15:31:58.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.177+0000 7f4940c00640 1 -- 172.21.15.73:0/909864773 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4930016130 con 0x7f493c053c20 2024-04-15T15:31:58.179 INFO:teuthology.orchestra.run.smithi073.stdout:55834574860 2024-04-15T15:31:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f49240683d0 msgr2=0x7f492406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f49240683d0 0x7f492406a890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f49380099a0 tx=0x7f49380090e0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 msgr2=0x7f493c0e3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 0x7f493c0e3a90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f49300ab000 tx=0x7f49300192e0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 shutdown_connections 2024-04-15T15:31:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f493c0528f0 0x7f493c0e18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f493c053c20 0x7f493c0e3a90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f49240683d0 0x7f492406a890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 --2- 172.21.15.73:0/909864773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f493c006800 0x7f493c188c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 >> 172.21.15.73:0/909864773 conn(0x7f493c0559f0 msgr2=0x7f493c055dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 shutdown_connections 2024-04-15T15:31:58.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.181+0000 7f494ba00640 1 -- 172.21.15.73:0/909864773 wait complete. 2024-04-15T15:31:58.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.185+0000 7f5761800640 1 -- 172.21.15.73:0/2750713260 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f575c068ab0 con 0x7f575c15c310 2024-04-15T15:31:58.189 INFO:teuthology.orchestra.run.smithi073.stdout:55834574857 2024-04-15T15:31:58.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5752a00640 1 -- 172.21.15.73:0/2750713260 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f574c027020 con 0x7f575c15c310 2024-04-15T15:31:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f2531400640 1 -- 172.21.15.73:0/2182615806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f252c0b1870 con 0x7f252c157f00 2024-04-15T15:31:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 -- 172.21.15.73:0/2750713260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f573c068380 msgr2=0x7f573c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f573c068380 0x7f573c06a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f57480aa000 tx=0x7f57480019f0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 -- 172.21.15.73:0/2750713260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c15c310 msgr2=0x7f575c158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c15c310 0x7f575c158180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f574c01e870 tx=0x7f574c01ed30 comp rx=0 tx=0).stop 2024-04-15T15:31:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 -- 172.21.15.73:0/2750713260 shutdown_connections 2024-04-15T15:31:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f573c068380 0x7f573c06a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f575c1586c0 0x7f575c15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c15c310 0x7f575c158180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 --2- 172.21.15.73:0/2750713260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f575c151ef0 0x7f575c0cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 -- 172.21.15.73:0/2750713260 >> 172.21.15.73:0/2750713260 conn(0x7f575c0d0540 msgr2=0x7f575c0b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 -- 172.21.15.73:0/2750713260 shutdown_connections 2024-04-15T15:31:58.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f5761800640 1 -- 172.21.15.73:0/2750713260 wait complete. 2024-04-15T15:31:58.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.189+0000 7f2522a00640 1 -- 172.21.15.73:0/2182615806 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f251c05d870 con 0x7f252c157f00 2024-04-15T15:31:58.193 INFO:teuthology.orchestra.run.smithi073.stdout:55834574858 2024-04-15T15:31:58.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 -- 172.21.15.73:0/2182615806 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f250c068480 msgr2=0x7f250c06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f250c068480 0x7f250c06a940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f251800b800 tx=0x7f2518008040 comp rx=0 tx=0).stop 2024-04-15T15:31:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 -- 172.21.15.73:0/2182615806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c157f00 msgr2=0x7f252c0b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c157f00 0x7f252c0b6b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f251c005670 tx=0x7f251c00e4d0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 -- 172.21.15.73:0/2182615806 shutdown_connections 2024-04-15T15:31:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f250c068480 0x7f250c06a940 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f252c0b7090 0x7f252c09f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252c157f00 0x7f252c0b6b50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 --2- 172.21.15.73:0/2182615806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25100052f0 0x7f252c0c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 -- 172.21.15.73:0/2182615806 >> 172.21.15.73:0/2182615806 conn(0x7f252c0b3fe0 msgr2=0x7f252c070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 -- 172.21.15.73:0/2182615806 shutdown_connections 2024-04-15T15:31:58.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.197+0000 7f2531400640 1 -- 172.21.15.73:0/2182615806 wait complete. 2024-04-15T15:31:58.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.201+0000 7f9f6b200640 1 -- 172.21.15.73:0/2284060044 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9f44005860 con 0x7f9f6c0ce600 2024-04-15T15:31:58.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.201+0000 7f9f62000640 1 -- 172.21.15.73:0/2284060044 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f5c056890 con 0x7f9f6c0ce600 2024-04-15T15:31:58.203 INFO:teuthology.orchestra.run.smithi073.stdout:55834574858 2024-04-15T15:31:58.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.3 2024-04-15T15:31:58.205 DEBUG:teuthology.parallel:result is None 2024-04-15T15:31:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 -- 172.21.15.73:0/2284060044 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f4c068450 msgr2=0x7f9f4c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f4c068450 0x7f9f4c06a910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c159dd0 tx=0x7f9f58008040 comp rx=0 tx=0).stop 2024-04-15T15:31:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 -- 172.21.15.73:0/2284060044 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0ce600 msgr2=0x7f9f6c1528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0ce600 0x7f9f6c1528f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00e5e0 tx=0x7f9f5c00eaa0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 -- 172.21.15.73:0/2284060044 shutdown_connections 2024-04-15T15:31:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f6c15e960 0x7f9f6c0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f4c068450 0x7f9f4c06a910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f6c0ce600 0x7f9f6c1528f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 --2- 172.21.15.73:0/2284060044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f6c0cbe90 0x7f9f6c15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 -- 172.21.15.73:0/2284060044 >> 172.21.15.73:0/2284060044 conn(0x7f9f6c0b2e90 msgr2=0x7f9f6c0b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 -- 172.21.15.73:0/2284060044 shutdown_connections 2024-04-15T15:31:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f9f6b200640 1 -- 172.21.15.73:0/2284060044 wait complete. 2024-04-15T15:31:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7fa680c00640 1 -- 172.21.15.73:0/4249080220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa654005590 con 0x7fa67c0d07e0 2024-04-15T15:31:58.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f72a8005860 con 0x7f72d00cd1b0 2024-04-15T15:31:58.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7f72c7400640 1 -- 172.21.15.73:0/3331047311 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f72c0056ba0 con 0x7f72d00cd1b0 2024-04-15T15:31:58.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.205+0000 7fa672000640 1 -- 172.21.15.73:0/4249080220 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa66c059dd0 con 0x7fa67c0d07e0 2024-04-15T15:31:58.210 INFO:teuthology.orchestra.run.smithi073.stdout:55834574857 2024-04-15T15:31:58.210 INFO:teuthology.orchestra.run.smithi073.stdout:55834574858 2024-04-15T15:31:58.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f72b00683d0 msgr2=0x7f72b006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f72b00683d0 0x7f72b006a890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0b2000 tx=0x7f72bc008040 comp rx=0 tx=0).stop 2024-04-15T15:31:58.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d00cd1b0 msgr2=0x7f72d0156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d00cd1b0 0x7f72d0156e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f72c000e870 tx=0x7f72c000ed30 comp rx=0 tx=0).stop 2024-04-15T15:31:58.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 shutdown_connections 2024-04-15T15:31:58.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d015cab0 0x7f72d00b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72d015c6d0 0x7f72d00c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f72b00683d0 0x7f72b006a890 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 --2- 172.21.15.73:0/3331047311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72d00cd1b0 0x7f72d0156e80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 >> 172.21.15.73:0/3331047311 conn(0x7f72d00b3fe0 msgr2=0x7f72d00affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 shutdown_connections 2024-04-15T15:31:58.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7f72d6800640 1 -- 172.21.15.73:0/3331047311 wait complete. 2024-04-15T15:31:58.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7fa680c00640 1 -- 172.21.15.73:0/4249080220 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa65c068380 msgr2=0x7fa65c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7fa680c00640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa65c068380 0x7fa65c06a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6740af000 tx=0x7fa67400c040 comp rx=0 tx=0).stop 2024-04-15T15:31:58.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7fa680c00640 1 -- 172.21.15.73:0/4249080220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa67c0d07e0 msgr2=0x7fa67c0a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7fa680c00640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa67c0d07e0 0x7fa67c0a94c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c340 tx=0x7fa66c00c800 comp rx=0 tx=0).stop 2024-04-15T15:31:58.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7fa680c00640 1 -- 172.21.15.73:0/4249080220 shutdown_connections 2024-04-15T15:31:58.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7fa680c00640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa67c15c0f0 0x7fa67c0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7fa680c00640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa67c0d07e0 0x7fa67c0a94c0 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c340 tx=0x7fa66c00c800 comp rx=0 tx=0).stop 2024-04-15T15:31:58.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7fa680c00640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa65c068380 0x7fa65c06a840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7fa680c00640 1 --2- 172.21.15.73:0/4249080220 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67c0b4370 0x7fa67c1463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.209+0000 7fa680c00640 1 -- 172.21.15.73:0/4249080220 >> 172.21.15.73:0/4249080220 conn(0x7fa67c06ba50 msgr2=0x7fa67c06f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.213+0000 7fa680c00640 1 -- 172.21.15.73:0/4249080220 shutdown_connections 2024-04-15T15:31:58.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.213+0000 7fa680c00640 1 -- 172.21.15.73:0/4249080220 wait complete. 2024-04-15T15:31:58.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-04-15T15:31:58.222 DEBUG:teuthology.parallel:result is None 2024-04-15T15:31:58.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-15T15:31:58.238 DEBUG:teuthology.parallel:result is None 2024-04-15T15:31:58.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-04-15T15:31:58.242 DEBUG:teuthology.parallel:result is None 2024-04-15T15:31:58.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-15T15:31:58.245 DEBUG:teuthology.parallel:result is None 2024-04-15T15:31:58.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-04-15T15:31:58.246 DEBUG:teuthology.parallel:result is None 2024-04-15T15:31:58.246 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T15:31:58.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:31:58.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d36200640 1 Processor -- start 2024-04-15T15:31:58.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d36200640 1 -- start start 2024-04-15T15:31:58.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d36200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2d3015c6d0 0x7f2d300d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d36200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2d300cd1b0 0x7f2d300d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d36200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d300cd690 con 0x7f2d3015cab0 2024-04-15T15:31:58.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d36200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2d300cd970 con 0x7f2d3015c6d0 2024-04-15T15:31:58.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d36200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f2d300cdc50 con 0x7f2d300cd1b0 2024-04-15T15:31:58.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d2f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2d3015c6d0 0x7f2d300d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d2f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2d3015c6d0 0x7f2d300d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58790/0 (socket says 172.21.15.73:58790) 2024-04-15T15:31:58.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d2f400640 1 -- 172.21.15.73:0/312814310 learned_addr learned my addr 172.21.15.73:0/312814310 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:58.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d26a00640 1 --2- 172.21.15.73:0/312814310 >> v2:172.21.15.118:3300/0 conn(0x7f2d300cd1b0 0x7f2d300d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d2f400640 1 -- 172.21.15.73:0/312814310 >> v2:172.21.15.118:3300/0 conn(0x7f2d300cd1b0 msgr2=0x7f2d300d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:58.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d2f400640 1 --2- 172.21.15.73:0/312814310 >> v2:172.21.15.118:3300/0 conn(0x7f2d300cd1b0 0x7f2d300d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d2f400640 1 -- 172.21.15.73:0/312814310 >> v1:172.21.15.118:6789/0 conn(0x7f2d3015cab0 legacy=0x7f2d3009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:58.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d2f400640 1 -- 172.21.15.73:0/312814310 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d300cdf30 con 0x7f2d3015c6d0 2024-04-15T15:31:58.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.425+0000 7f2d26a00640 1 --2- 172.21.15.73:0/312814310 >> v2:172.21.15.118:3300/0 conn(0x7f2d300cd1b0 0x7f2d300d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:31:58.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d2f400640 1 --2- 172.21.15.73:0/312814310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d3015c6d0 0x7f2d300d0d70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d30073af0 tx=0x7f2d2001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd948357cc50dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:58.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d2ea00640 1 -- 172.21.15.73:0/312814310 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d200aa430 con 0x7f2d3015c6d0 2024-04-15T15:31:58.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d2ea00640 1 -- 172.21.15.73:0/312814310 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d200af070 con 0x7f2d3015c6d0 2024-04-15T15:31:58.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d2ea00640 1 -- 172.21.15.73:0/312814310 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d200aa7f0 con 0x7f2d3015c6d0 2024-04-15T15:31:58.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d36200640 1 -- 172.21.15.73:0/312814310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d3015c6d0 msgr2=0x7f2d300d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d36200640 1 --2- 172.21.15.73:0/312814310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d3015c6d0 0x7f2d300d0d70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d30073af0 tx=0x7f2d2001c4b0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d36200640 1 -- 172.21.15.73:0/312814310 shutdown_connections 2024-04-15T15:31:58.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d36200640 1 --2- 172.21.15.73:0/312814310 >> v2:172.21.15.118:3300/0 conn(0x7f2d300cd1b0 0x7f2d300d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d36200640 1 --2- 172.21.15.73:0/312814310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d3015c6d0 0x7f2d300d0d70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d36200640 1 -- 172.21.15.73:0/312814310 >> 172.21.15.73:0/312814310 conn(0x7f2d300b3fe0 msgr2=0x7f2d300b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d36200640 1 -- 172.21.15.73:0/312814310 shutdown_connections 2024-04-15T15:31:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.429+0000 7f2d36200640 1 -- 172.21.15.73:0/312814310 wait complete. 2024-04-15T15:31:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 Processor -- start 2024-04-15T15:31:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 -- start start 2024-04-15T15:31:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300cd1b0 0x7f2d3015b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d3015c6d0 0x7f2d3015a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d3015cab0 0x7f2d301faa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2d300b1c20 con 0x7f2d300cd1b0 2024-04-15T15:31:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2d300b1aa0 con 0x7f2d3015cab0 2024-04-15T15:31:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2d300b1da0 con 0x7f2d3015c6d0 2024-04-15T15:31:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300cd1b0 0x7f2d3015b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300cd1b0 0x7f2d3015b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58794/0 (socket says 172.21.15.73:58794) 2024-04-15T15:31:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2f400640 1 -- 172.21.15.73:0/862174694 learned_addr learned my addr 172.21.15.73:0/862174694 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2fe00640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d3015cab0 0x7f2d301faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d26a00640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d3015c6d0 0x7f2d3015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2f400640 1 -- 172.21.15.73:0/862174694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d3015c6d0 msgr2=0x7f2d3015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2f400640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d3015c6d0 0x7f2d3015a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2f400640 1 -- 172.21.15.73:0/862174694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d3015cab0 msgr2=0x7f2d301faa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2f400640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d3015cab0 0x7f2d301faa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2f400640 1 -- 172.21.15.73:0/862174694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d300c91b0 con 0x7f2d300cd1b0 2024-04-15T15:31:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2fe00640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d3015cab0 0x7f2d301faa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d2f400640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300cd1b0 0x7f2d3015b160 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2d2001ab60 tx=0x7f2d20019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d27e00640 1 -- 172.21.15.73:0/862174694 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20003b10 con 0x7f2d300cd1b0 2024-04-15T15:31:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d27e00640 1 -- 172.21.15.73:0/862174694 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d20003cb0 con 0x7f2d300cd1b0 2024-04-15T15:31:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 -- 172.21.15.73:0/862174694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3015fc50 con 0x7f2d300cd1b0 2024-04-15T15:31:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d27e00640 1 -- 172.21.15.73:0/862174694 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20003e60 con 0x7f2d300cd1b0 2024-04-15T15:31:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 -- 172.21.15.73:0/862174694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3015aeb0 con 0x7f2d300cd1b0 2024-04-15T15:31:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.433+0000 7f2d36200640 1 -- 172.21.15.73:0/862174694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d30068ab0 con 0x7f2d300cd1b0 2024-04-15T15:31:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.437+0000 7f2d27e00640 1 -- 172.21.15.73:0/862174694 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d200aa670 con 0x7f2d300cd1b0 2024-04-15T15:31:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.437+0000 7f2d27e00640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2d0c068380 0x7f2d0c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.437+0000 7f2d27e00640 1 -- 172.21.15.73:0/862174694 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d20121300 con 0x7f2d300cd1b0 2024-04-15T15:31:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.437+0000 7f2d26a00640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2d0c068380 0x7f2d0c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.437+0000 7f2d26a00640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2d0c068380 0x7f2d0c06a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2d300cfef0 tx=0x7f2d18008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.441+0000 7f2d27e00640 1 -- 172.21.15.73:0/862174694 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d200b8030 con 0x7f2d300cd1b0 2024-04-15T15:31:58.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.597+0000 7f2d36200640 1 -- 172.21.15.73:0/862174694 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d300c8f60 con 0x7f2d0c068380 2024-04-15T15:31:58.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.605+0000 7f2d27e00640 1 -- 172.21.15.73:0/862174694 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332538 (secure 0 0 0) 0x7f2d300c8f60 con 0x7f2d0c068380 2024-04-15T15:31:58.613 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:58.615 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:31:58.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.609+0000 7f2d36200640 1 -- 172.21.15.73:0/862174694 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2d0c068380 msgr2=0x7f2d0c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.609+0000 7f2d36200640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2d0c068380 0x7f2d0c06a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2d300cfef0 tx=0x7f2d18008040 comp rx=0 tx=0).stop 2024-04-15T15:31:58.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.609+0000 7f2d36200640 1 -- 172.21.15.73:0/862174694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300cd1b0 msgr2=0x7f2d3015b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.609+0000 7f2d36200640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300cd1b0 0x7f2d3015b160 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2d2001ab60 tx=0x7f2d20019250 comp rx=0 tx=0).stop 2024-04-15T15:31:58.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.613+0000 7f2d36200640 1 -- 172.21.15.73:0/862174694 shutdown_connections 2024-04-15T15:31:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.613+0000 7f2d36200640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d3015cab0 0x7f2d301faa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.613+0000 7f2d36200640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2d0c068380 0x7f2d0c06a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.613+0000 7f2d36200640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d3015c6d0 0x7f2d3015a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.613+0000 7f2d36200640 1 --2- 172.21.15.73:0/862174694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300cd1b0 0x7f2d3015b160 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.613+0000 7f2d36200640 1 -- 172.21.15.73:0/862174694 >> 172.21.15.73:0/862174694 conn(0x7f2d300b3fe0 msgr2=0x7f2d300afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.613+0000 7f2d36200640 1 -- 172.21.15.73:0/862174694 shutdown_connections 2024-04-15T15:31:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.613+0000 7f2d36200640 1 -- 172.21.15.73:0/862174694 wait complete. 2024-04-15T15:31:58.631 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-15T15:31:57.360864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223632,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751088,"statfs":{"total":773094113280,"available":772865114112,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002612"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749471+0000","last_change":"2024-04-15T15:31:33.445529+0000","last_active":"2024-04-15T15:31:41.749471+0000","last_peered":"2024-04-15T15:31:41.749471+0000","last_clean":"2024-04-15T15:31:41.749471+0000","last_became_active":"2024-04-15T15:31:33.444843+0000","last_became_peered":"2024-04-15T15:31:33.444843+0000","last_unstale":"2024-04-15T15:31:41.749471+0000","last_undegraded":"2024-04-15T15:31:41.749471+0000","last_fullsized":"2024-04-15T15:31:41.749471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:55:28.751007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494876+0000","last_change":"2024-04-15T15:31:34.469462+0000","last_active":"2024-04-15T15:31:39.494876+0000","last_peered":"2024-04-15T15:31:39.494876+0000","last_clean":"2024-04-15T15:31:39.494876+0000","last_became_active":"2024-04-15T15:31:34.468636+0000","last_became_peered":"2024-04-15T15:31:34.468636+0000","last_unstale":"2024-04-15T15:31:39.494876+0000","last_undegraded":"2024-04-15T15:31:39.494876+0000","last_fullsized":"2024-04-15T15:31:39.494876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494365+0000","last_change":"2024-04-15T15:31:38.508287+0000","last_active":"2024-04-15T15:31:39.494365+0000","last_peered":"2024-04-15T15:31:39.494365+0000","last_clean":"2024-04-15T15:31:39.494365+0000","last_became_active":"2024-04-15T15:31:38.507377+0000","last_became_peered":"2024-04-15T15:31:38.507377+0000","last_unstale":"2024-04-15T15:31:39.494365+0000","last_undegraded":"2024-04-15T15:31:39.494365+0000","last_fullsized":"2024-04-15T15:31:39.494365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:19.820153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495019+0000","last_change":"2024-04-15T15:31:33.461774+0000","last_active":"2024-04-15T15:31:39.495019+0000","last_peered":"2024-04-15T15:31:39.495019+0000","last_clean":"2024-04-15T15:31:39.495019+0000","last_became_active":"2024-04-15T15:31:33.461439+0000","last_became_peered":"2024-04-15T15:31:33.461439+0000","last_unstale":"2024-04-15T15:31:39.495019+0000","last_undegraded":"2024-04-15T15:31:39.495019+0000","last_fullsized":"2024-04-15T15:31:39.495019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750446+0000","last_change":"2024-04-15T15:31:34.482829+0000","last_active":"2024-04-15T15:31:41.750446+0000","last_peered":"2024-04-15T15:31:41.750446+0000","last_clean":"2024-04-15T15:31:41.750446+0000","last_became_active":"2024-04-15T15:31:34.481691+0000","last_became_peered":"2024-04-15T15:31:34.481691+0000","last_unstale":"2024-04-15T15:31:41.750446+0000","last_undegraded":"2024-04-15T15:31:41.750446+0000","last_fullsized":"2024-04-15T15:31:41.750446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494732+0000","last_change":"2024-04-15T15:31:38.509783+0000","last_active":"2024-04-15T15:31:39.494732+0000","last_peered":"2024-04-15T15:31:39.494732+0000","last_clean":"2024-04-15T15:31:39.494732+0000","last_became_active":"2024-04-15T15:31:38.509318+0000","last_became_peered":"2024-04-15T15:31:38.509318+0000","last_unstale":"2024-04-15T15:31:39.494732+0000","last_undegraded":"2024-04-15T15:31:39.494732+0000","last_fullsized":"2024-04-15T15:31:39.494732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:41.291523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496578+0000","last_change":"2024-04-15T15:31:33.469801+0000","last_active":"2024-04-15T15:31:39.496578+0000","last_peered":"2024-04-15T15:31:39.496578+0000","last_clean":"2024-04-15T15:31:39.496578+0000","last_became_active":"2024-04-15T15:31:33.469406+0000","last_became_peered":"2024-04-15T15:31:33.469406+0000","last_unstale":"2024-04-15T15:31:39.496578+0000","last_undegraded":"2024-04-15T15:31:39.496578+0000","last_fullsized":"2024-04-15T15:31:39.496578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397887+0000","last_change":"2024-04-15T15:31:34.480152+0000","last_active":"2024-04-15T15:31:41.397887+0000","last_peered":"2024-04-15T15:31:41.397887+0000","last_clean":"2024-04-15T15:31:41.397887+0000","last_became_active":"2024-04-15T15:31:34.479857+0000","last_became_peered":"2024-04-15T15:31:34.479857+0000","last_unstale":"2024-04-15T15:31:41.397887+0000","last_undegraded":"2024-04-15T15:31:41.397887+0000","last_fullsized":"2024-04-15T15:31:41.397887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495216+0000","last_change":"2024-04-15T15:31:38.513301+0000","last_active":"2024-04-15T15:31:39.495216+0000","last_peered":"2024-04-15T15:31:39.495216+0000","last_clean":"2024-04-15T15:31:39.495216+0000","last_became_active":"2024-04-15T15:31:38.512294+0000","last_became_peered":"2024-04-15T15:31:38.512294+0000","last_unstale":"2024-04-15T15:31:39.495216+0000","last_undegraded":"2024-04-15T15:31:39.495216+0000","last_fullsized":"2024-04-15T15:31:39.495216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:58.375388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495343+0000","last_change":"2024-04-15T15:31:33.468436+0000","last_active":"2024-04-15T15:31:39.495343+0000","last_peered":"2024-04-15T15:31:39.495343+0000","last_clean":"2024-04-15T15:31:39.495343+0000","last_became_active":"2024-04-15T15:31:33.468066+0000","last_became_peered":"2024-04-15T15:31:33.468066+0000","last_unstale":"2024-04-15T15:31:39.495343+0000","last_undegraded":"2024-04-15T15:31:39.495343+0000","last_fullsized":"2024-04-15T15:31:39.495343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397924+0000","last_change":"2024-04-15T15:31:34.478455+0000","last_active":"2024-04-15T15:31:41.397924+0000","last_peered":"2024-04-15T15:31:41.397924+0000","last_clean":"2024-04-15T15:31:41.397924+0000","last_became_active":"2024-04-15T15:31:34.477083+0000","last_became_peered":"2024-04-15T15:31:34.477083+0000","last_unstale":"2024-04-15T15:31:41.397924+0000","last_undegraded":"2024-04-15T15:31:41.397924+0000","last_fullsized":"2024-04-15T15:31:41.397924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:28.573374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495022+0000","last_change":"2024-04-15T15:31:38.513693+0000","last_active":"2024-04-15T15:31:39.495022+0000","last_peered":"2024-04-15T15:31:39.495022+0000","last_clean":"2024-04-15T15:31:39.495022+0000","last_became_active":"2024-04-15T15:31:38.508340+0000","last_became_peered":"2024-04-15T15:31:38.508340+0000","last_unstale":"2024-04-15T15:31:39.495022+0000","last_undegraded":"2024-04-15T15:31:39.495022+0000","last_fullsized":"2024-04-15T15:31:39.495022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:40:02.295646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043775+0000","last_change":"2024-04-15T15:31:34.470639+0000","last_active":"2024-04-15T15:31:41.043775+0000","last_peered":"2024-04-15T15:31:41.043775+0000","last_clean":"2024-04-15T15:31:41.043775+0000","last_became_active":"2024-04-15T15:31:34.470352+0000","last_became_peered":"2024-04-15T15:31:34.470352+0000","last_unstale":"2024-04-15T15:31:41.043775+0000","last_undegraded":"2024-04-15T15:31:41.043775+0000","last_fullsized":"2024-04-15T15:31:41.043775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495785+0000","last_change":"2024-04-15T15:31:33.468093+0000","last_active":"2024-04-15T15:31:39.495785+0000","last_peered":"2024-04-15T15:31:39.495785+0000","last_clean":"2024-04-15T15:31:39.495785+0000","last_became_active":"2024-04-15T15:31:33.464597+0000","last_became_peered":"2024-04-15T15:31:33.464597+0000","last_unstale":"2024-04-15T15:31:39.495785+0000","last_undegraded":"2024-04-15T15:31:39.495785+0000","last_fullsized":"2024-04-15T15:31:39.495785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:31.218635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495353+0000","last_change":"2024-04-15T15:31:38.508916+0000","last_active":"2024-04-15T15:31:39.495353+0000","last_peered":"2024-04-15T15:31:39.495353+0000","last_clean":"2024-04-15T15:31:39.495353+0000","last_became_active":"2024-04-15T15:31:38.507396+0000","last_became_peered":"2024-04-15T15:31:38.507396+0000","last_unstale":"2024-04-15T15:31:39.495353+0000","last_undegraded":"2024-04-15T15:31:39.495353+0000","last_fullsized":"2024-04-15T15:31:39.495353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:16.026259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494597+0000","last_change":"2024-04-15T15:31:34.478907+0000","last_active":"2024-04-15T15:31:39.494597+0000","last_peered":"2024-04-15T15:31:39.494597+0000","last_clean":"2024-04-15T15:31:39.494597+0000","last_became_active":"2024-04-15T15:31:34.478612+0000","last_became_peered":"2024-04-15T15:31:34.478612+0000","last_unstale":"2024-04-15T15:31:39.494597+0000","last_undegraded":"2024-04-15T15:31:39.494597+0000","last_fullsized":"2024-04-15T15:31:39.494597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660317+0000","last_change":"2024-04-15T15:31:33.464608+0000","last_active":"2024-04-15T15:31:41.660317+0000","last_peered":"2024-04-15T15:31:41.660317+0000","last_clean":"2024-04-15T15:31:41.660317+0000","last_became_active":"2024-04-15T15:31:33.463697+0000","last_became_peered":"2024-04-15T15:31:33.463697+0000","last_unstale":"2024-04-15T15:31:41.660317+0000","last_undegraded":"2024-04-15T15:31:41.660317+0000","last_fullsized":"2024-04-15T15:31:41.660317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495009+0000","last_change":"2024-04-15T15:31:38.512929+0000","last_active":"2024-04-15T15:31:39.495009+0000","last_peered":"2024-04-15T15:31:39.495009+0000","last_clean":"2024-04-15T15:31:39.495009+0000","last_became_active":"2024-04-15T15:31:38.512502+0000","last_became_peered":"2024-04-15T15:31:38.512502+0000","last_unstale":"2024-04-15T15:31:39.495009+0000","last_undegraded":"2024-04-15T15:31:39.495009+0000","last_fullsized":"2024-04-15T15:31:39.495009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:07.300884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494687+0000","last_change":"2024-04-15T15:31:34.475733+0000","last_active":"2024-04-15T15:31:39.494687+0000","last_peered":"2024-04-15T15:31:39.494687+0000","last_clean":"2024-04-15T15:31:39.494687+0000","last_became_active":"2024-04-15T15:31:34.475366+0000","last_became_peered":"2024-04-15T15:31:34.475366+0000","last_unstale":"2024-04-15T15:31:39.494687+0000","last_undegraded":"2024-04-15T15:31:39.494687+0000","last_fullsized":"2024-04-15T15:31:39.494687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660301+0000","last_change":"2024-04-15T15:31:33.471618+0000","last_active":"2024-04-15T15:31:41.660301+0000","last_peered":"2024-04-15T15:31:41.660301+0000","last_clean":"2024-04-15T15:31:41.660301+0000","last_became_active":"2024-04-15T15:31:33.471405+0000","last_became_peered":"2024-04-15T15:31:33.471405+0000","last_unstale":"2024-04-15T15:31:41.660301+0000","last_undegraded":"2024-04-15T15:31:41.660301+0000","last_fullsized":"2024-04-15T15:31:41.660301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661411+0000","last_change":"2024-04-15T15:31:38.525886+0000","last_active":"2024-04-15T15:31:41.661411+0000","last_peered":"2024-04-15T15:31:41.661411+0000","last_clean":"2024-04-15T15:31:41.661411+0000","last_became_active":"2024-04-15T15:31:38.525493+0000","last_became_peered":"2024-04-15T15:31:38.525493+0000","last_unstale":"2024-04-15T15:31:41.661411+0000","last_undegraded":"2024-04-15T15:31:41.661411+0000","last_fullsized":"2024-04-15T15:31:41.661411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:20.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496343+0000","last_change":"2024-04-15T15:31:34.458960+0000","last_active":"2024-04-15T15:31:39.496343+0000","last_peered":"2024-04-15T15:31:39.496343+0000","last_clean":"2024-04-15T15:31:39.496343+0000","last_became_active":"2024-04-15T15:31:34.457972+0000","last_became_peered":"2024-04-15T15:31:34.457972+0000","last_unstale":"2024-04-15T15:31:39.496343+0000","last_undegraded":"2024-04-15T15:31:39.496343+0000","last_fullsized":"2024-04-15T15:31:39.496343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:34.951963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494692+0000","last_change":"2024-04-15T15:31:33.461302+0000","last_active":"2024-04-15T15:31:39.494692+0000","last_peered":"2024-04-15T15:31:39.494692+0000","last_clean":"2024-04-15T15:31:39.494692+0000","last_became_active":"2024-04-15T15:31:33.458813+0000","last_became_peered":"2024-04-15T15:31:33.458813+0000","last_unstale":"2024-04-15T15:31:39.494692+0000","last_undegraded":"2024-04-15T15:31:39.494692+0000","last_fullsized":"2024-04-15T15:31:39.494692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495913+0000","last_change":"2024-04-15T15:31:38.514622+0000","last_active":"2024-04-15T15:31:39.495913+0000","last_peered":"2024-04-15T15:31:39.495913+0000","last_clean":"2024-04-15T15:31:39.495913+0000","last_became_active":"2024-04-15T15:31:38.513418+0000","last_became_peered":"2024-04-15T15:31:38.513418+0000","last_unstale":"2024-04-15T15:31:39.495913+0000","last_undegraded":"2024-04-15T15:31:39.495913+0000","last_fullsized":"2024-04-15T15:31:39.495913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750568+0000","last_change":"2024-04-15T15:31:34.468186+0000","last_active":"2024-04-15T15:31:41.750568+0000","last_peered":"2024-04-15T15:31:41.750568+0000","last_clean":"2024-04-15T15:31:41.750568+0000","last_became_active":"2024-04-15T15:31:34.467908+0000","last_became_peered":"2024-04-15T15:31:34.467908+0000","last_unstale":"2024-04-15T15:31:41.750568+0000","last_undegraded":"2024-04-15T15:31:41.750568+0000","last_fullsized":"2024-04-15T15:31:41.750568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044539+0000","last_change":"2024-04-15T15:31:33.467227+0000","last_active":"2024-04-15T15:31:41.044539+0000","last_peered":"2024-04-15T15:31:41.044539+0000","last_clean":"2024-04-15T15:31:41.044539+0000","last_became_active":"2024-04-15T15:31:33.466947+0000","last_became_peered":"2024-04-15T15:31:33.466947+0000","last_unstale":"2024-04-15T15:31:41.044539+0000","last_undegraded":"2024-04-15T15:31:41.044539+0000","last_fullsized":"2024-04-15T15:31:41.044539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496140+0000","last_change":"2024-04-15T15:31:38.508721+0000","last_active":"2024-04-15T15:31:39.496140+0000","last_peered":"2024-04-15T15:31:39.496140+0000","last_clean":"2024-04-15T15:31:39.496140+0000","last_became_active":"2024-04-15T15:31:38.508183+0000","last_became_peered":"2024-04-15T15:31:38.508183+0000","last_unstale":"2024-04-15T15:31:39.496140+0000","last_undegraded":"2024-04-15T15:31:39.496140+0000","last_fullsized":"2024-04-15T15:31:39.496140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495271+0000","last_change":"2024-04-15T15:31:34.479989+0000","last_active":"2024-04-15T15:31:39.495271+0000","last_peered":"2024-04-15T15:31:39.495271+0000","last_clean":"2024-04-15T15:31:39.495271+0000","last_became_active":"2024-04-15T15:31:34.479662+0000","last_became_peered":"2024-04-15T15:31:34.479662+0000","last_unstale":"2024-04-15T15:31:39.495271+0000","last_undegraded":"2024-04-15T15:31:39.495271+0000","last_fullsized":"2024-04-15T15:31:39.495271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660411+0000","last_change":"2024-04-15T15:31:33.470912+0000","last_active":"2024-04-15T15:31:41.660411+0000","last_peered":"2024-04-15T15:31:41.660411+0000","last_clean":"2024-04-15T15:31:41.660411+0000","last_became_active":"2024-04-15T15:31:33.470665+0000","last_became_peered":"2024-04-15T15:31:33.470665+0000","last_unstale":"2024-04-15T15:31:41.660411+0000","last_undegraded":"2024-04-15T15:31:41.660411+0000","last_fullsized":"2024-04-15T15:31:41.660411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494323+0000","last_change":"2024-04-15T15:31:38.530139+0000","last_active":"2024-04-15T15:31:39.494323+0000","last_peered":"2024-04-15T15:31:39.494323+0000","last_clean":"2024-04-15T15:31:39.494323+0000","last_became_active":"2024-04-15T15:31:38.529420+0000","last_became_peered":"2024-04-15T15:31:38.529420+0000","last_unstale":"2024-04-15T15:31:39.494323+0000","last_undegraded":"2024-04-15T15:31:39.494323+0000","last_fullsized":"2024-04-15T15:31:39.494323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:25:04.752470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661111+0000","last_change":"2024-04-15T15:31:34.458302+0000","last_active":"2024-04-15T15:31:41.661111+0000","last_peered":"2024-04-15T15:31:41.661111+0000","last_clean":"2024-04-15T15:31:41.661111+0000","last_became_active":"2024-04-15T15:31:34.455963+0000","last_became_peered":"2024-04-15T15:31:34.455963+0000","last_unstale":"2024-04-15T15:31:41.661111+0000","last_undegraded":"2024-04-15T15:31:41.661111+0000","last_fullsized":"2024-04-15T15:31:41.661111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496735+0000","last_change":"2024-04-15T15:31:33.465392+0000","last_active":"2024-04-15T15:31:39.496735+0000","last_peered":"2024-04-15T15:31:39.496735+0000","last_clean":"2024-04-15T15:31:39.496735+0000","last_became_active":"2024-04-15T15:31:33.462727+0000","last_became_peered":"2024-04-15T15:31:33.462727+0000","last_unstale":"2024-04-15T15:31:39.496735+0000","last_undegraded":"2024-04-15T15:31:39.496735+0000","last_fullsized":"2024-04-15T15:31:39.496735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:31:42.645531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750004+0000","last_change":"2024-04-15T15:31:38.529068+0000","last_active":"2024-04-15T15:31:41.750004+0000","last_peered":"2024-04-15T15:31:41.750004+0000","last_clean":"2024-04-15T15:31:41.750004+0000","last_became_active":"2024-04-15T15:31:38.521736+0000","last_became_peered":"2024-04-15T15:31:38.521736+0000","last_unstale":"2024-04-15T15:31:41.750004+0000","last_undegraded":"2024-04-15T15:31:41.750004+0000","last_fullsized":"2024-04-15T15:31:41.750004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398049+0000","last_change":"2024-04-15T15:31:34.483798+0000","last_active":"2024-04-15T15:31:41.398049+0000","last_peered":"2024-04-15T15:31:41.398049+0000","last_clean":"2024-04-15T15:31:41.398049+0000","last_became_active":"2024-04-15T15:31:34.483476+0000","last_became_peered":"2024-04-15T15:31:34.483476+0000","last_unstale":"2024-04-15T15:31:41.398049+0000","last_undegraded":"2024-04-15T15:31:41.398049+0000","last_fullsized":"2024-04-15T15:31:41.398049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:43.459915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661205+0000","last_change":"2024-04-15T15:31:33.455617+0000","last_active":"2024-04-15T15:31:41.661205+0000","last_peered":"2024-04-15T15:31:41.661205+0000","last_clean":"2024-04-15T15:31:41.661205+0000","last_became_active":"2024-04-15T15:31:33.453330+0000","last_became_peered":"2024-04-15T15:31:33.453330+0000","last_unstale":"2024-04-15T15:31:41.661205+0000","last_undegraded":"2024-04-15T15:31:41.661205+0000","last_fullsized":"2024-04-15T15:31:41.661205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660834+0000","last_change":"2024-04-15T15:31:38.523416+0000","last_active":"2024-04-15T15:31:41.660834+0000","last_peered":"2024-04-15T15:31:41.660834+0000","last_clean":"2024-04-15T15:31:41.660834+0000","last_became_active":"2024-04-15T15:31:38.522902+0000","last_became_peered":"2024-04-15T15:31:38.522902+0000","last_unstale":"2024-04-15T15:31:41.660834+0000","last_undegraded":"2024-04-15T15:31:41.660834+0000","last_fullsized":"2024-04-15T15:31:41.660834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495419+0000","last_change":"2024-04-15T15:31:34.477054+0000","last_active":"2024-04-15T15:31:39.495419+0000","last_peered":"2024-04-15T15:31:39.495419+0000","last_clean":"2024-04-15T15:31:39.495419+0000","last_became_active":"2024-04-15T15:31:34.476543+0000","last_became_peered":"2024-04-15T15:31:34.476543+0000","last_unstale":"2024-04-15T15:31:39.495419+0000","last_undegraded":"2024-04-15T15:31:39.495419+0000","last_fullsized":"2024-04-15T15:31:39.495419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:31.194810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397846+0000","last_change":"2024-04-15T15:31:33.463222+0000","last_active":"2024-04-15T15:31:41.397846+0000","last_peered":"2024-04-15T15:31:41.397846+0000","last_clean":"2024-04-15T15:31:41.397846+0000","last_became_active":"2024-04-15T15:31:33.462885+0000","last_became_peered":"2024-04-15T15:31:33.462885+0000","last_unstale":"2024-04-15T15:31:41.397846+0000","last_undegraded":"2024-04-15T15:31:41.397846+0000","last_fullsized":"2024-04-15T15:31:41.397846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661135+0000","last_change":"2024-04-15T15:31:38.530546+0000","last_active":"2024-04-15T15:31:41.661135+0000","last_peered":"2024-04-15T15:31:41.661135+0000","last_clean":"2024-04-15T15:31:41.661135+0000","last_became_active":"2024-04-15T15:31:38.523847+0000","last_became_peered":"2024-04-15T15:31:38.523847+0000","last_unstale":"2024-04-15T15:31:41.661135+0000","last_undegraded":"2024-04-15T15:31:41.661135+0000","last_fullsized":"2024-04-15T15:31:41.661135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660785+0000","last_change":"2024-04-15T15:31:34.466367+0000","last_active":"2024-04-15T15:31:41.660785+0000","last_peered":"2024-04-15T15:31:41.660785+0000","last_clean":"2024-04-15T15:31:41.660785+0000","last_became_active":"2024-04-15T15:31:34.465456+0000","last_became_peered":"2024-04-15T15:31:34.465456+0000","last_unstale":"2024-04-15T15:31:41.660785+0000","last_undegraded":"2024-04-15T15:31:41.660785+0000","last_fullsized":"2024-04-15T15:31:41.660785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930895+0000","last_change":"2024-04-15T15:31:33.459428+0000","last_active":"2024-04-15T15:31:39.930895+0000","last_peered":"2024-04-15T15:31:39.930895+0000","last_clean":"2024-04-15T15:31:39.930895+0000","last_became_active":"2024-04-15T15:31:33.459061+0000","last_became_peered":"2024-04-15T15:31:33.459061+0000","last_unstale":"2024-04-15T15:31:39.930895+0000","last_undegraded":"2024-04-15T15:31:39.930895+0000","last_fullsized":"2024-04-15T15:31:39.930895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661442+0000","last_change":"2024-04-15T15:31:38.526730+0000","last_active":"2024-04-15T15:31:41.661442+0000","last_peered":"2024-04-15T15:31:41.661442+0000","last_clean":"2024-04-15T15:31:41.661442+0000","last_became_active":"2024-04-15T15:31:38.526377+0000","last_became_peered":"2024-04-15T15:31:38.526377+0000","last_unstale":"2024-04-15T15:31:41.661442+0000","last_undegraded":"2024-04-15T15:31:41.661442+0000","last_fullsized":"2024-04-15T15:31:41.661442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:32.616780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749771+0000","last_change":"2024-04-15T15:31:34.467685+0000","last_active":"2024-04-15T15:31:41.749771+0000","last_peered":"2024-04-15T15:31:41.749771+0000","last_clean":"2024-04-15T15:31:41.749771+0000","last_became_active":"2024-04-15T15:31:34.467225+0000","last_became_peered":"2024-04-15T15:31:34.467225+0000","last_unstale":"2024-04-15T15:31:41.749771+0000","last_undegraded":"2024-04-15T15:31:41.749771+0000","last_fullsized":"2024-04-15T15:31:41.749771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:59:25.080403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494797+0000","last_change":"2024-04-15T15:31:33.468019+0000","last_active":"2024-04-15T15:31:39.494797+0000","last_peered":"2024-04-15T15:31:39.494797+0000","last_clean":"2024-04-15T15:31:39.494797+0000","last_became_active":"2024-04-15T15:31:33.465568+0000","last_became_peered":"2024-04-15T15:31:33.465568+0000","last_unstale":"2024-04-15T15:31:39.494797+0000","last_undegraded":"2024-04-15T15:31:39.494797+0000","last_fullsized":"2024-04-15T15:31:39.494797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750596+0000","last_change":"2024-04-15T15:31:38.510659+0000","last_active":"2024-04-15T15:31:41.750596+0000","last_peered":"2024-04-15T15:31:41.750596+0000","last_clean":"2024-04-15T15:31:41.750596+0000","last_became_active":"2024-04-15T15:31:38.510130+0000","last_became_peered":"2024-04-15T15:31:38.510130+0000","last_unstale":"2024-04-15T15:31:41.750596+0000","last_undegraded":"2024-04-15T15:31:41.750596+0000","last_fullsized":"2024-04-15T15:31:41.750596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:11:14.235709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494622+0000","last_change":"2024-04-15T15:31:34.475942+0000","last_active":"2024-04-15T15:31:39.494622+0000","last_peered":"2024-04-15T15:31:39.494622+0000","last_clean":"2024-04-15T15:31:39.494622+0000","last_became_active":"2024-04-15T15:31:34.475645+0000","last_became_peered":"2024-04-15T15:31:34.475645+0000","last_unstale":"2024-04-15T15:31:39.494622+0000","last_undegraded":"2024-04-15T15:31:39.494622+0000","last_fullsized":"2024-04-15T15:31:39.494622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397687+0000","last_change":"2024-04-15T15:31:33.460934+0000","last_active":"2024-04-15T15:31:41.397687+0000","last_peered":"2024-04-15T15:31:41.397687+0000","last_clean":"2024-04-15T15:31:41.397687+0000","last_became_active":"2024-04-15T15:31:33.460488+0000","last_became_peered":"2024-04-15T15:31:33.460488+0000","last_unstale":"2024-04-15T15:31:41.397687+0000","last_undegraded":"2024-04-15T15:31:41.397687+0000","last_fullsized":"2024-04-15T15:31:41.397687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494896+0000","last_change":"2024-04-15T15:31:23.443687+0000","last_active":"2024-04-15T15:31:39.494896+0000","last_peered":"2024-04-15T15:31:39.494896+0000","last_clean":"2024-04-15T15:31:39.494896+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:31:39.494896+0000","last_undegraded":"2024-04-15T15:31:39.494896+0000","last_fullsized":"2024-04-15T15:31:39.494896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_clean_scrub_stamp":"2024-04-15T15:31:22.092427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:28:43.096549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044263+0000","last_change":"2024-04-15T15:31:38.509517+0000","last_active":"2024-04-15T15:31:41.044263+0000","last_peered":"2024-04-15T15:31:41.044263+0000","last_clean":"2024-04-15T15:31:41.044263+0000","last_became_active":"2024-04-15T15:31:38.509241+0000","last_became_peered":"2024-04-15T15:31:38.509241+0000","last_unstale":"2024-04-15T15:31:41.044263+0000","last_undegraded":"2024-04-15T15:31:41.044263+0000","last_fullsized":"2024-04-15T15:31:41.044263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496472+0000","last_change":"2024-04-15T15:31:34.482434+0000","last_active":"2024-04-15T15:31:39.496472+0000","last_peered":"2024-04-15T15:31:39.496472+0000","last_clean":"2024-04-15T15:31:39.496472+0000","last_became_active":"2024-04-15T15:31:34.481970+0000","last_became_peered":"2024-04-15T15:31:34.481970+0000","last_unstale":"2024-04-15T15:31:39.496472+0000","last_undegraded":"2024-04-15T15:31:39.496472+0000","last_fullsized":"2024-04-15T15:31:39.496472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:55.879743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931168+0000","last_change":"2024-04-15T15:31:33.463661+0000","last_active":"2024-04-15T15:31:39.931168+0000","last_peered":"2024-04-15T15:31:39.931168+0000","last_clean":"2024-04-15T15:31:39.931168+0000","last_became_active":"2024-04-15T15:31:33.463363+0000","last_became_peered":"2024-04-15T15:31:33.463363+0000","last_unstale":"2024-04-15T15:31:39.931168+0000","last_undegraded":"2024-04-15T15:31:39.931168+0000","last_fullsized":"2024-04-15T15:31:39.931168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044102+0000","last_change":"2024-04-15T15:31:38.508644+0000","last_active":"2024-04-15T15:31:41.044102+0000","last_peered":"2024-04-15T15:31:41.044102+0000","last_clean":"2024-04-15T15:31:41.044102+0000","last_became_active":"2024-04-15T15:31:38.508203+0000","last_became_peered":"2024-04-15T15:31:38.508203+0000","last_unstale":"2024-04-15T15:31:41.044102+0000","last_undegraded":"2024-04-15T15:31:41.044102+0000","last_fullsized":"2024-04-15T15:31:41.044102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397921+0000","last_change":"2024-04-15T15:31:34.484117+0000","last_active":"2024-04-15T15:31:41.397921+0000","last_peered":"2024-04-15T15:31:41.397921+0000","last_clean":"2024-04-15T15:31:41.397921+0000","last_became_active":"2024-04-15T15:31:34.483764+0000","last_became_peered":"2024-04-15T15:31:34.483764+0000","last_unstale":"2024-04-15T15:31:41.397921+0000","last_undegraded":"2024-04-15T15:31:41.397921+0000","last_fullsized":"2024-04-15T15:31:41.397921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:55.879743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660358+0000","last_change":"2024-04-15T15:31:33.462350+0000","last_active":"2024-04-15T15:31:41.660358+0000","last_peered":"2024-04-15T15:31:41.660358+0000","last_clean":"2024-04-15T15:31:41.660358+0000","last_became_active":"2024-04-15T15:31:33.462003+0000","last_became_peered":"2024-04-15T15:31:33.462003+0000","last_unstale":"2024-04-15T15:31:41.660358+0000","last_undegraded":"2024-04-15T15:31:41.660358+0000","last_fullsized":"2024-04-15T15:31:41.660358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750132+0000","last_change":"2024-04-15T15:31:38.518872+0000","last_active":"2024-04-15T15:31:41.750132+0000","last_peered":"2024-04-15T15:31:41.750132+0000","last_clean":"2024-04-15T15:31:41.750132+0000","last_became_active":"2024-04-15T15:31:38.517803+0000","last_became_peered":"2024-04-15T15:31:38.517803+0000","last_unstale":"2024-04-15T15:31:41.750132+0000","last_undegraded":"2024-04-15T15:31:41.750132+0000","last_fullsized":"2024-04-15T15:31:41.750132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:20.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.497118+0000","last_change":"2024-04-15T15:31:34.455266+0000","last_active":"2024-04-15T15:31:39.497118+0000","last_peered":"2024-04-15T15:31:39.497118+0000","last_clean":"2024-04-15T15:31:39.497118+0000","last_became_active":"2024-04-15T15:31:34.454909+0000","last_became_peered":"2024-04-15T15:31:34.454909+0000","last_unstale":"2024-04-15T15:31:39.497118+0000","last_undegraded":"2024-04-15T15:31:39.497118+0000","last_fullsized":"2024-04-15T15:31:39.497118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:11:10.192304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931330+0000","last_change":"2024-04-15T15:31:33.459513+0000","last_active":"2024-04-15T15:31:39.931330+0000","last_peered":"2024-04-15T15:31:39.931330+0000","last_clean":"2024-04-15T15:31:39.931330+0000","last_became_active":"2024-04-15T15:31:33.458815+0000","last_became_peered":"2024-04-15T15:31:33.458815+0000","last_unstale":"2024-04-15T15:31:39.931330+0000","last_undegraded":"2024-04-15T15:31:39.931330+0000","last_fullsized":"2024-04-15T15:31:39.931330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397253+0000","last_change":"2024-04-15T15:31:38.502775+0000","last_active":"2024-04-15T15:31:41.397253+0000","last_peered":"2024-04-15T15:31:41.397253+0000","last_clean":"2024-04-15T15:31:41.397253+0000","last_became_active":"2024-04-15T15:31:38.502352+0000","last_became_peered":"2024-04-15T15:31:38.502352+0000","last_unstale":"2024-04-15T15:31:41.397253+0000","last_undegraded":"2024-04-15T15:31:41.397253+0000","last_fullsized":"2024-04-15T15:31:41.397253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:19.820153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496741+0000","last_change":"2024-04-15T15:31:34.460915+0000","last_active":"2024-04-15T15:31:39.496741+0000","last_peered":"2024-04-15T15:31:39.496741+0000","last_clean":"2024-04-15T15:31:39.496741+0000","last_became_active":"2024-04-15T15:31:34.460597+0000","last_became_peered":"2024-04-15T15:31:34.460597+0000","last_unstale":"2024-04-15T15:31:39.496741+0000","last_undegraded":"2024-04-15T15:31:39.496741+0000","last_fullsized":"2024-04-15T15:31:39.496741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:47.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495992+0000","last_change":"2024-04-15T15:31:33.454373+0000","last_active":"2024-04-15T15:31:39.495992+0000","last_peered":"2024-04-15T15:31:39.495992+0000","last_clean":"2024-04-15T15:31:39.495992+0000","last_became_active":"2024-04-15T15:31:33.454125+0000","last_became_peered":"2024-04-15T15:31:33.454125+0000","last_unstale":"2024-04-15T15:31:39.495992+0000","last_undegraded":"2024-04-15T15:31:39.495992+0000","last_fullsized":"2024-04-15T15:31:39.495992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:37:53.773475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496068+0000","last_change":"2024-04-15T15:31:38.511943+0000","last_active":"2024-04-15T15:31:39.496068+0000","last_peered":"2024-04-15T15:31:39.496068+0000","last_clean":"2024-04-15T15:31:39.496068+0000","last_became_active":"2024-04-15T15:31:38.511494+0000","last_became_peered":"2024-04-15T15:31:38.511494+0000","last_unstale":"2024-04-15T15:31:39.496068+0000","last_undegraded":"2024-04-15T15:31:39.496068+0000","last_fullsized":"2024-04-15T15:31:39.496068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495491+0000","last_change":"2024-04-15T15:31:34.446971+0000","last_active":"2024-04-15T15:31:39.495491+0000","last_peered":"2024-04-15T15:31:39.495491+0000","last_clean":"2024-04-15T15:31:39.495491+0000","last_became_active":"2024-04-15T15:31:34.446687+0000","last_became_peered":"2024-04-15T15:31:34.446687+0000","last_unstale":"2024-04-15T15:31:39.495491+0000","last_undegraded":"2024-04-15T15:31:39.495491+0000","last_fullsized":"2024-04-15T15:31:39.495491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930804+0000","last_change":"2024-04-15T15:31:33.450642+0000","last_active":"2024-04-15T15:31:39.930804+0000","last_peered":"2024-04-15T15:31:39.930804+0000","last_clean":"2024-04-15T15:31:39.930804+0000","last_became_active":"2024-04-15T15:31:33.450034+0000","last_became_peered":"2024-04-15T15:31:33.450034+0000","last_unstale":"2024-04-15T15:31:39.930804+0000","last_undegraded":"2024-04-15T15:31:39.930804+0000","last_fullsized":"2024-04-15T15:31:39.930804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:34:26.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750433+0000","last_change":"2024-04-15T15:31:38.516804+0000","last_active":"2024-04-15T15:31:41.750433+0000","last_peered":"2024-04-15T15:31:41.750433+0000","last_clean":"2024-04-15T15:31:41.750433+0000","last_became_active":"2024-04-15T15:31:38.516244+0000","last_became_peered":"2024-04-15T15:31:38.516244+0000","last_unstale":"2024-04-15T15:31:41.750433+0000","last_undegraded":"2024-04-15T15:31:41.750433+0000","last_fullsized":"2024-04-15T15:31:41.750433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:47.503321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043900+0000","last_change":"2024-04-15T15:31:34.473243+0000","last_active":"2024-04-15T15:31:41.043900+0000","last_peered":"2024-04-15T15:31:41.043900+0000","last_clean":"2024-04-15T15:31:41.043900+0000","last_became_active":"2024-04-15T15:31:34.472907+0000","last_became_peered":"2024-04-15T15:31:34.472907+0000","last_unstale":"2024-04-15T15:31:41.043900+0000","last_undegraded":"2024-04-15T15:31:41.043900+0000","last_fullsized":"2024-04-15T15:31:41.043900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043921+0000","last_change":"2024-04-15T15:31:33.455306+0000","last_active":"2024-04-15T15:31:41.043921+0000","last_peered":"2024-04-15T15:31:41.043921+0000","last_clean":"2024-04-15T15:31:41.043921+0000","last_became_active":"2024-04-15T15:31:33.454939+0000","last_became_peered":"2024-04-15T15:31:33.454939+0000","last_unstale":"2024-04-15T15:31:41.043921+0000","last_undegraded":"2024-04-15T15:31:41.043921+0000","last_fullsized":"2024-04-15T15:31:41.043921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495222+0000","last_change":"2024-04-15T15:31:38.530485+0000","last_active":"2024-04-15T15:31:39.495222+0000","last_peered":"2024-04-15T15:31:39.495222+0000","last_clean":"2024-04-15T15:31:39.495222+0000","last_became_active":"2024-04-15T15:31:38.529528+0000","last_became_peered":"2024-04-15T15:31:38.529528+0000","last_unstale":"2024-04-15T15:31:39.495222+0000","last_undegraded":"2024-04-15T15:31:39.495222+0000","last_fullsized":"2024-04-15T15:31:39.495222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:34:18.616473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495712+0000","last_change":"2024-04-15T15:31:34.477711+0000","last_active":"2024-04-15T15:31:39.495712+0000","last_peered":"2024-04-15T15:31:39.495712+0000","last_clean":"2024-04-15T15:31:39.495712+0000","last_became_active":"2024-04-15T15:31:34.477444+0000","last_became_peered":"2024-04-15T15:31:34.477444+0000","last_unstale":"2024-04-15T15:31:39.495712+0000","last_undegraded":"2024-04-15T15:31:39.495712+0000","last_fullsized":"2024-04-15T15:31:39.495712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397755+0000","last_change":"2024-04-15T15:31:33.467098+0000","last_active":"2024-04-15T15:31:41.397755+0000","last_peered":"2024-04-15T15:31:41.397755+0000","last_clean":"2024-04-15T15:31:41.397755+0000","last_became_active":"2024-04-15T15:31:33.466808+0000","last_became_peered":"2024-04-15T15:31:33.466808+0000","last_unstale":"2024-04-15T15:31:41.397755+0000","last_undegraded":"2024-04-15T15:31:41.397755+0000","last_fullsized":"2024-04-15T15:31:41.397755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495267+0000","last_change":"2024-04-15T15:31:38.523143+0000","last_active":"2024-04-15T15:31:39.495267+0000","last_peered":"2024-04-15T15:31:39.495267+0000","last_clean":"2024-04-15T15:31:39.495267+0000","last_became_active":"2024-04-15T15:31:38.522583+0000","last_became_peered":"2024-04-15T15:31:38.522583+0000","last_unstale":"2024-04-15T15:31:39.495267+0000","last_undegraded":"2024-04-15T15:31:39.495267+0000","last_fullsized":"2024-04-15T15:31:39.495267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:55:17.165005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749967+0000","last_change":"2024-04-15T15:31:34.457507+0000","last_active":"2024-04-15T15:31:41.749967+0000","last_peered":"2024-04-15T15:31:41.749967+0000","last_clean":"2024-04-15T15:31:41.749967+0000","last_became_active":"2024-04-15T15:31:34.457210+0000","last_became_peered":"2024-04-15T15:31:34.457210+0000","last_unstale":"2024-04-15T15:31:41.749967+0000","last_undegraded":"2024-04-15T15:31:41.749967+0000","last_fullsized":"2024-04-15T15:31:41.749967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749354+0000","last_change":"2024-04-15T15:31:33.457018+0000","last_active":"2024-04-15T15:31:41.749354+0000","last_peered":"2024-04-15T15:31:41.749354+0000","last_clean":"2024-04-15T15:31:41.749354+0000","last_became_active":"2024-04-15T15:31:33.456421+0000","last_became_peered":"2024-04-15T15:31:33.456421+0000","last_unstale":"2024-04-15T15:31:41.749354+0000","last_undegraded":"2024-04-15T15:31:41.749354+0000","last_fullsized":"2024-04-15T15:31:41.749354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:05.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397989+0000","last_change":"2024-04-15T15:31:38.508761+0000","last_active":"2024-04-15T15:31:41.397989+0000","last_peered":"2024-04-15T15:31:41.397989+0000","last_clean":"2024-04-15T15:31:41.397989+0000","last_became_active":"2024-04-15T15:31:38.508347+0000","last_became_peered":"2024-04-15T15:31:38.508347+0000","last_unstale":"2024-04-15T15:31:41.397989+0000","last_undegraded":"2024-04-15T15:31:41.397989+0000","last_fullsized":"2024-04-15T15:31:41.397989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:55:06.941769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495673+0000","last_change":"2024-04-15T15:31:34.456767+0000","last_active":"2024-04-15T15:31:39.495673+0000","last_peered":"2024-04-15T15:31:39.495673+0000","last_clean":"2024-04-15T15:31:39.495673+0000","last_became_active":"2024-04-15T15:31:34.456363+0000","last_became_peered":"2024-04-15T15:31:34.456363+0000","last_unstale":"2024-04-15T15:31:39.495673+0000","last_undegraded":"2024-04-15T15:31:39.495673+0000","last_fullsized":"2024-04-15T15:31:39.495673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:50.646519+0000","last_change":"2024-04-15T15:31:33.461422+0000","last_active":"2024-04-15T15:31:50.646519+0000","last_peered":"2024-04-15T15:31:50.646519+0000","last_clean":"2024-04-15T15:31:50.646519+0000","last_became_active":"2024-04-15T15:31:33.459911+0000","last_became_peered":"2024-04-15T15:31:33.459911+0000","last_unstale":"2024-04-15T15:31:50.646519+0000","last_undegraded":"2024-04-15T15:31:50.646519+0000","last_fullsized":"2024-04-15T15:31:50.646519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660990+0000","last_change":"2024-04-15T15:31:38.510570+0000","last_active":"2024-04-15T15:31:41.660990+0000","last_peered":"2024-04-15T15:31:41.660990+0000","last_clean":"2024-04-15T15:31:41.660990+0000","last_became_active":"2024-04-15T15:31:38.510025+0000","last_became_peered":"2024-04-15T15:31:38.510025+0000","last_unstale":"2024-04-15T15:31:41.660990+0000","last_undegraded":"2024-04-15T15:31:41.660990+0000","last_fullsized":"2024-04-15T15:31:41.660990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495834+0000","last_change":"2024-04-15T15:31:34.446494+0000","last_active":"2024-04-15T15:31:39.495834+0000","last_peered":"2024-04-15T15:31:39.495834+0000","last_clean":"2024-04-15T15:31:39.495834+0000","last_became_active":"2024-04-15T15:31:34.446162+0000","last_became_peered":"2024-04-15T15:31:34.446162+0000","last_unstale":"2024-04-15T15:31:39.495834+0000","last_undegraded":"2024-04-15T15:31:39.495834+0000","last_fullsized":"2024-04-15T15:31:39.495834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:31:43.652130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660356+0000","last_change":"2024-04-15T15:31:33.464177+0000","last_active":"2024-04-15T15:31:41.660356+0000","last_peered":"2024-04-15T15:31:41.660356+0000","last_clean":"2024-04-15T15:31:41.660356+0000","last_became_active":"2024-04-15T15:31:33.463834+0000","last_became_peered":"2024-04-15T15:31:33.463834+0000","last_unstale":"2024-04-15T15:31:41.660356+0000","last_undegraded":"2024-04-15T15:31:41.660356+0000","last_fullsized":"2024-04-15T15:31:41.660356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494954+0000","last_change":"2024-04-15T15:31:38.513560+0000","last_active":"2024-04-15T15:31:39.494954+0000","last_peered":"2024-04-15T15:31:39.494954+0000","last_clean":"2024-04-15T15:31:39.494954+0000","last_became_active":"2024-04-15T15:31:38.512922+0000","last_became_peered":"2024-04-15T15:31:38.512922+0000","last_unstale":"2024-04-15T15:31:39.494954+0000","last_undegraded":"2024-04-15T15:31:39.494954+0000","last_fullsized":"2024-04-15T15:31:39.494954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:53.510244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750535+0000","last_change":"2024-04-15T15:31:34.486802+0000","last_active":"2024-04-15T15:31:41.750535+0000","last_peered":"2024-04-15T15:31:41.750535+0000","last_clean":"2024-04-15T15:31:41.750535+0000","last_became_active":"2024-04-15T15:31:34.481349+0000","last_became_peered":"2024-04-15T15:31:34.481349+0000","last_unstale":"2024-04-15T15:31:41.750535+0000","last_undegraded":"2024-04-15T15:31:41.750535+0000","last_fullsized":"2024-04-15T15:31:41.750535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398116+0000","last_change":"2024-04-15T15:31:33.470322+0000","last_active":"2024-04-15T15:31:41.398116+0000","last_peered":"2024-04-15T15:31:41.398116+0000","last_clean":"2024-04-15T15:31:41.398116+0000","last_became_active":"2024-04-15T15:31:33.470042+0000","last_became_peered":"2024-04-15T15:31:33.470042+0000","last_unstale":"2024-04-15T15:31:41.398116+0000","last_undegraded":"2024-04-15T15:31:41.398116+0000","last_fullsized":"2024-04-15T15:31:41.398116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494537+0000","last_change":"2024-04-15T15:31:38.515979+0000","last_active":"2024-04-15T15:31:39.494537+0000","last_peered":"2024-04-15T15:31:39.494537+0000","last_clean":"2024-04-15T15:31:39.494537+0000","last_became_active":"2024-04-15T15:31:38.510943+0000","last_became_peered":"2024-04-15T15:31:38.510943+0000","last_unstale":"2024-04-15T15:31:39.494537+0000","last_undegraded":"2024-04-15T15:31:39.494537+0000","last_fullsized":"2024-04-15T15:31:39.494537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:02:06.275540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398007+0000","last_change":"2024-04-15T15:31:34.468743+0000","last_active":"2024-04-15T15:31:41.398007+0000","last_peered":"2024-04-15T15:31:41.398007+0000","last_clean":"2024-04-15T15:31:41.398007+0000","last_became_active":"2024-04-15T15:31:34.468018+0000","last_became_peered":"2024-04-15T15:31:34.468018+0000","last_unstale":"2024-04-15T15:31:41.398007+0000","last_undegraded":"2024-04-15T15:31:41.398007+0000","last_fullsized":"2024-04-15T15:31:41.398007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:47.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044426+0000","last_change":"2024-04-15T15:31:33.473593+0000","last_active":"2024-04-15T15:31:41.044426+0000","last_peered":"2024-04-15T15:31:41.044426+0000","last_clean":"2024-04-15T15:31:41.044426+0000","last_became_active":"2024-04-15T15:31:33.473287+0000","last_became_peered":"2024-04-15T15:31:33.473287+0000","last_unstale":"2024-04-15T15:31:41.044426+0000","last_undegraded":"2024-04-15T15:31:41.044426+0000","last_fullsized":"2024-04-15T15:31:41.044426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494451+0000","last_change":"2024-04-15T15:31:38.507657+0000","last_active":"2024-04-15T15:31:39.494451+0000","last_peered":"2024-04-15T15:31:39.494451+0000","last_clean":"2024-04-15T15:31:39.494451+0000","last_became_active":"2024-04-15T15:31:38.507217+0000","last_became_peered":"2024-04-15T15:31:38.507217+0000","last_unstale":"2024-04-15T15:31:39.494451+0000","last_undegraded":"2024-04-15T15:31:39.494451+0000","last_fullsized":"2024-04-15T15:31:39.494451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:55:06.941769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750410+0000","last_change":"2024-04-15T15:31:38.521076+0000","last_active":"2024-04-15T15:31:41.750410+0000","last_peered":"2024-04-15T15:31:41.750410+0000","last_clean":"2024-04-15T15:31:41.750410+0000","last_became_active":"2024-04-15T15:31:38.518118+0000","last_became_peered":"2024-04-15T15:31:38.518118+0000","last_unstale":"2024-04-15T15:31:41.750410+0000","last_undegraded":"2024-04-15T15:31:41.750410+0000","last_fullsized":"2024-04-15T15:31:41.750410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:32.616780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660696+0000","last_change":"2024-04-15T15:31:34.460784+0000","last_active":"2024-04-15T15:31:41.660696+0000","last_peered":"2024-04-15T15:31:41.660696+0000","last_clean":"2024-04-15T15:31:41.660696+0000","last_became_active":"2024-04-15T15:31:34.460525+0000","last_became_peered":"2024-04-15T15:31:34.460525+0000","last_unstale":"2024-04-15T15:31:41.660696+0000","last_undegraded":"2024-04-15T15:31:41.660696+0000","last_fullsized":"2024-04-15T15:31:41.660696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397400+0000","last_change":"2024-04-15T15:31:33.462485+0000","last_active":"2024-04-15T15:31:41.397400+0000","last_peered":"2024-04-15T15:31:41.397400+0000","last_clean":"2024-04-15T15:31:41.397400+0000","last_became_active":"2024-04-15T15:31:33.461597+0000","last_became_peered":"2024-04-15T15:31:33.461597+0000","last_unstale":"2024-04-15T15:31:41.397400+0000","last_undegraded":"2024-04-15T15:31:41.397400+0000","last_fullsized":"2024-04-15T15:31:41.397400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044372+0000","last_change":"2024-04-15T15:31:38.513345+0000","last_active":"2024-04-15T15:31:41.044372+0000","last_peered":"2024-04-15T15:31:41.044372+0000","last_clean":"2024-04-15T15:31:41.044372+0000","last_became_active":"2024-04-15T15:31:38.512662+0000","last_became_peered":"2024-04-15T15:31:38.512662+0000","last_unstale":"2024-04-15T15:31:41.044372+0000","last_undegraded":"2024-04-15T15:31:41.044372+0000","last_fullsized":"2024-04-15T15:31:41.044372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494621+0000","last_change":"2024-04-15T15:31:34.483839+0000","last_active":"2024-04-15T15:31:39.494621+0000","last_peered":"2024-04-15T15:31:39.494621+0000","last_clean":"2024-04-15T15:31:39.494621+0000","last_became_active":"2024-04-15T15:31:34.483548+0000","last_became_peered":"2024-04-15T15:31:34.483548+0000","last_unstale":"2024-04-15T15:31:39.494621+0000","last_undegraded":"2024-04-15T15:31:39.494621+0000","last_fullsized":"2024-04-15T15:31:39.494621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494604+0000","last_change":"2024-04-15T15:31:33.466699+0000","last_active":"2024-04-15T15:31:39.494604+0000","last_peered":"2024-04-15T15:31:39.494604+0000","last_clean":"2024-04-15T15:31:39.494604+0000","last_became_active":"2024-04-15T15:31:33.466439+0000","last_became_peered":"2024-04-15T15:31:33.466439+0000","last_unstale":"2024-04-15T15:31:39.494604+0000","last_undegraded":"2024-04-15T15:31:39.494604+0000","last_fullsized":"2024-04-15T15:31:39.494604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044029+0000","last_change":"2024-04-15T15:31:33.464633+0000","last_active":"2024-04-15T15:31:41.044029+0000","last_peered":"2024-04-15T15:31:41.044029+0000","last_clean":"2024-04-15T15:31:41.044029+0000","last_became_active":"2024-04-15T15:31:33.463248+0000","last_became_peered":"2024-04-15T15:31:33.463248+0000","last_unstale":"2024-04-15T15:31:41.044029+0000","last_undegraded":"2024-04-15T15:31:41.044029+0000","last_fullsized":"2024-04-15T15:31:41.044029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750204+0000","last_change":"2024-04-15T15:31:34.483410+0000","last_active":"2024-04-15T15:31:41.750204+0000","last_peered":"2024-04-15T15:31:41.750204+0000","last_clean":"2024-04-15T15:31:41.750204+0000","last_became_active":"2024-04-15T15:31:34.482918+0000","last_became_peered":"2024-04-15T15:31:34.482918+0000","last_unstale":"2024-04-15T15:31:41.750204+0000","last_undegraded":"2024-04-15T15:31:41.750204+0000","last_fullsized":"2024-04-15T15:31:41.750204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931146+0000","last_change":"2024-04-15T15:31:38.511098+0000","last_active":"2024-04-15T15:31:39.931146+0000","last_peered":"2024-04-15T15:31:39.931146+0000","last_clean":"2024-04-15T15:31:39.931146+0000","last_became_active":"2024-04-15T15:31:38.510675+0000","last_became_peered":"2024-04-15T15:31:38.510675+0000","last_unstale":"2024-04-15T15:31:39.931146+0000","last_undegraded":"2024-04-15T15:31:39.931146+0000","last_fullsized":"2024-04-15T15:31:39.931146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:30:57.364887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494713+0000","last_change":"2024-04-15T15:31:33.460701+0000","last_active":"2024-04-15T15:31:39.494713+0000","last_peered":"2024-04-15T15:31:39.494713+0000","last_clean":"2024-04-15T15:31:39.494713+0000","last_became_active":"2024-04-15T15:31:33.460470+0000","last_became_peered":"2024-04-15T15:31:33.460470+0000","last_unstale":"2024-04-15T15:31:39.494713+0000","last_undegraded":"2024-04-15T15:31:39.494713+0000","last_fullsized":"2024-04-15T15:31:39.494713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:34:26.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495245+0000","last_change":"2024-04-15T15:31:34.448451+0000","last_active":"2024-04-15T15:31:39.495245+0000","last_peered":"2024-04-15T15:31:39.495245+0000","last_clean":"2024-04-15T15:31:39.495245+0000","last_became_active":"2024-04-15T15:31:34.448097+0000","last_became_peered":"2024-04-15T15:31:34.448097+0000","last_unstale":"2024-04-15T15:31:39.495245+0000","last_undegraded":"2024-04-15T15:31:39.495245+0000","last_fullsized":"2024-04-15T15:31:39.495245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:33.531988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495355+0000","last_change":"2024-04-15T15:31:38.531110+0000","last_active":"2024-04-15T15:31:39.495355+0000","last_peered":"2024-04-15T15:31:39.495355+0000","last_clean":"2024-04-15T15:31:39.495355+0000","last_became_active":"2024-04-15T15:31:38.530696+0000","last_became_peered":"2024-04-15T15:31:38.530696+0000","last_unstale":"2024-04-15T15:31:39.495355+0000","last_undegraded":"2024-04-15T15:31:39.495355+0000","last_fullsized":"2024-04-15T15:31:39.495355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:26:32.017433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043703+0000","last_change":"2024-04-15T15:31:34.473155+0000","last_active":"2024-04-15T15:31:41.043703+0000","last_peered":"2024-04-15T15:31:41.043703+0000","last_clean":"2024-04-15T15:31:41.043703+0000","last_became_active":"2024-04-15T15:31:34.472849+0000","last_became_peered":"2024-04-15T15:31:34.472849+0000","last_unstale":"2024-04-15T15:31:41.043703+0000","last_undegraded":"2024-04-15T15:31:41.043703+0000","last_fullsized":"2024-04-15T15:31:41.043703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930891+0000","last_change":"2024-04-15T15:31:34.477349+0000","last_active":"2024-04-15T15:31:39.930891+0000","last_peered":"2024-04-15T15:31:39.930891+0000","last_clean":"2024-04-15T15:31:39.930891+0000","last_became_active":"2024-04-15T15:31:34.476656+0000","last_became_peered":"2024-04-15T15:31:34.476656+0000","last_unstale":"2024-04-15T15:31:39.930891+0000","last_undegraded":"2024-04-15T15:31:39.930891+0000","last_fullsized":"2024-04-15T15:31:39.930891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:31.194810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397685+0000","last_change":"2024-04-15T15:31:34.483891+0000","last_active":"2024-04-15T15:31:41.397685+0000","last_peered":"2024-04-15T15:31:41.397685+0000","last_clean":"2024-04-15T15:31:41.397685+0000","last_became_active":"2024-04-15T15:31:34.483555+0000","last_became_peered":"2024-04-15T15:31:34.483555+0000","last_unstale":"2024-04-15T15:31:41.397685+0000","last_undegraded":"2024-04-15T15:31:41.397685+0000","last_fullsized":"2024-04-15T15:31:41.397685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750122+0000","last_change":"2024-04-15T15:31:34.483847+0000","last_active":"2024-04-15T15:31:41.750122+0000","last_peered":"2024-04-15T15:31:41.750122+0000","last_clean":"2024-04-15T15:31:41.750122+0000","last_became_active":"2024-04-15T15:31:34.483415+0000","last_became_peered":"2024-04-15T15:31:34.483415+0000","last_unstale":"2024-04-15T15:31:41.750122+0000","last_undegraded":"2024-04-15T15:31:41.750122+0000","last_fullsized":"2024-04-15T15:31:41.750122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495343+0000","last_change":"2024-04-15T15:31:34.483771+0000","last_active":"2024-04-15T15:31:39.495343+0000","last_peered":"2024-04-15T15:31:39.495343+0000","last_clean":"2024-04-15T15:31:39.495343+0000","last_became_active":"2024-04-15T15:31:34.483472+0000","last_became_peered":"2024-04-15T15:31:34.483472+0000","last_unstale":"2024-04-15T15:31:39.495343+0000","last_undegraded":"2024-04-15T15:31:39.495343+0000","last_fullsized":"2024-04-15T15:31:39.495343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661067+0000","last_change":"2024-04-15T15:31:34.460695+0000","last_active":"2024-04-15T15:31:41.661067+0000","last_peered":"2024-04-15T15:31:41.661067+0000","last_clean":"2024-04-15T15:31:41.661067+0000","last_became_active":"2024-04-15T15:31:34.460352+0000","last_became_peered":"2024-04-15T15:31:34.460352+0000","last_unstale":"2024-04-15T15:31:41.661067+0000","last_undegraded":"2024-04-15T15:31:41.661067+0000","last_fullsized":"2024-04-15T15:31:41.661067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044449+0000","last_change":"2024-04-15T15:31:34.463653+0000","last_active":"2024-04-15T15:31:41.044449+0000","last_peered":"2024-04-15T15:31:41.044449+0000","last_clean":"2024-04-15T15:31:41.044449+0000","last_became_active":"2024-04-15T15:31:34.463359+0000","last_became_peered":"2024-04-15T15:31:34.463359+0000","last_unstale":"2024-04-15T15:31:41.044449+0000","last_undegraded":"2024-04-15T15:31:41.044449+0000","last_fullsized":"2024-04-15T15:31:41.044449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495133+0000","last_change":"2024-04-15T15:31:34.479994+0000","last_active":"2024-04-15T15:31:39.495133+0000","last_peered":"2024-04-15T15:31:39.495133+0000","last_clean":"2024-04-15T15:31:39.495133+0000","last_became_active":"2024-04-15T15:31:34.479723+0000","last_became_peered":"2024-04-15T15:31:34.479723+0000","last_unstale":"2024-04-15T15:31:39.495133+0000","last_undegraded":"2024-04-15T15:31:39.495133+0000","last_fullsized":"2024-04-15T15:31:39.495133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397390+0000","last_change":"2024-04-15T15:31:34.479946+0000","last_active":"2024-04-15T15:31:41.397390+0000","last_peered":"2024-04-15T15:31:41.397390+0000","last_clean":"2024-04-15T15:31:41.397390+0000","last_became_active":"2024-04-15T15:31:34.479601+0000","last_became_peered":"2024-04-15T15:31:34.479601+0000","last_unstale":"2024-04-15T15:31:41.397390+0000","last_undegraded":"2024-04-15T15:31:41.397390+0000","last_fullsized":"2024-04-15T15:31:41.397390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494489+0000","last_change":"2024-04-15T15:31:34.475999+0000","last_active":"2024-04-15T15:31:39.494489+0000","last_peered":"2024-04-15T15:31:39.494489+0000","last_clean":"2024-04-15T15:31:39.494489+0000","last_became_active":"2024-04-15T15:31:34.475713+0000","last_became_peered":"2024-04-15T15:31:34.475713+0000","last_unstale":"2024-04-15T15:31:39.494489+0000","last_undegraded":"2024-04-15T15:31:39.494489+0000","last_fullsized":"2024-04-15T15:31:39.494489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397629+0000","last_change":"2024-04-15T15:31:34.466771+0000","last_active":"2024-04-15T15:31:41.397629+0000","last_peered":"2024-04-15T15:31:41.397629+0000","last_clean":"2024-04-15T15:31:41.397629+0000","last_became_active":"2024-04-15T15:31:34.465716+0000","last_became_peered":"2024-04-15T15:31:34.465716+0000","last_unstale":"2024-04-15T15:31:41.397629+0000","last_undegraded":"2024-04-15T15:31:41.397629+0000","last_fullsized":"2024-04-15T15:31:41.397629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749975+0000","last_change":"2024-04-15T15:31:34.468936+0000","last_active":"2024-04-15T15:31:41.749975+0000","last_peered":"2024-04-15T15:31:41.749975+0000","last_clean":"2024-04-15T15:31:41.749975+0000","last_became_active":"2024-04-15T15:31:34.467355+0000","last_became_peered":"2024-04-15T15:31:34.467355+0000","last_unstale":"2024-04-15T15:31:41.749975+0000","last_undegraded":"2024-04-15T15:31:41.749975+0000","last_fullsized":"2024-04-15T15:31:41.749975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044624+0000","last_change":"2024-04-15T15:31:34.469868+0000","last_active":"2024-04-15T15:31:41.044624+0000","last_peered":"2024-04-15T15:31:41.044624+0000","last_clean":"2024-04-15T15:31:41.044624+0000","last_became_active":"2024-04-15T15:31:34.469606+0000","last_became_peered":"2024-04-15T15:31:34.469606+0000","last_unstale":"2024-04-15T15:31:41.044624+0000","last_undegraded":"2024-04-15T15:31:41.044624+0000","last_fullsized":"2024-04-15T15:31:41.044624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496599+0000","last_change":"2024-04-15T15:31:34.456774+0000","last_active":"2024-04-15T15:31:39.496599+0000","last_peered":"2024-04-15T15:31:39.496599+0000","last_clean":"2024-04-15T15:31:39.496599+0000","last_became_active":"2024-04-15T15:31:34.456377+0000","last_became_peered":"2024-04-15T15:31:34.456377+0000","last_unstale":"2024-04-15T15:31:39.496599+0000","last_undegraded":"2024-04-15T15:31:39.496599+0000","last_fullsized":"2024-04-15T15:31:39.496599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:43.459915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931279+0000","last_change":"2024-04-15T15:31:34.459078+0000","last_active":"2024-04-15T15:31:39.931279+0000","last_peered":"2024-04-15T15:31:39.931279+0000","last_clean":"2024-04-15T15:31:39.931279+0000","last_became_active":"2024-04-15T15:31:34.458498+0000","last_became_peered":"2024-04-15T15:31:34.458498+0000","last_unstale":"2024-04-15T15:31:39.931279+0000","last_undegraded":"2024-04-15T15:31:39.931279+0000","last_fullsized":"2024-04-15T15:31:39.931279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:34.951963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398285+0000","last_change":"2024-04-15T15:31:34.472749+0000","last_active":"2024-04-15T15:31:41.398285+0000","last_peered":"2024-04-15T15:31:41.398285+0000","last_clean":"2024-04-15T15:31:41.398285+0000","last_became_active":"2024-04-15T15:31:34.472465+0000","last_became_peered":"2024-04-15T15:31:34.472465+0000","last_unstale":"2024-04-15T15:31:41.398285+0000","last_undegraded":"2024-04-15T15:31:41.398285+0000","last_fullsized":"2024-04-15T15:31:41.398285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:16.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397279+0000","last_change":"2024-04-15T15:31:34.472038+0000","last_active":"2024-04-15T15:31:41.397279+0000","last_peered":"2024-04-15T15:31:41.397279+0000","last_clean":"2024-04-15T15:31:41.397279+0000","last_became_active":"2024-04-15T15:31:34.471764+0000","last_became_peered":"2024-04-15T15:31:34.471764+0000","last_unstale":"2024-04-15T15:31:41.397279+0000","last_undegraded":"2024-04-15T15:31:41.397279+0000","last_fullsized":"2024-04-15T15:31:41.397279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660748+0000","last_change":"2024-04-15T15:31:34.458770+0000","last_active":"2024-04-15T15:31:41.660748+0000","last_peered":"2024-04-15T15:31:41.660748+0000","last_clean":"2024-04-15T15:31:41.660748+0000","last_became_active":"2024-04-15T15:31:34.457006+0000","last_became_peered":"2024-04-15T15:31:34.457006+0000","last_unstale":"2024-04-15T15:31:41.660748+0000","last_undegraded":"2024-04-15T15:31:41.660748+0000","last_fullsized":"2024-04-15T15:31:41.660748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749969+0000","last_change":"2024-04-15T15:31:34.461367+0000","last_active":"2024-04-15T15:31:41.749969+0000","last_peered":"2024-04-15T15:31:41.749969+0000","last_clean":"2024-04-15T15:31:41.749969+0000","last_became_active":"2024-04-15T15:31:34.461047+0000","last_became_peered":"2024-04-15T15:31:34.461047+0000","last_unstale":"2024-04-15T15:31:41.749969+0000","last_undegraded":"2024-04-15T15:31:41.749969+0000","last_fullsized":"2024-04-15T15:31:41.749969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:23.572024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494956+0000","last_change":"2024-04-15T15:31:34.469034+0000","last_active":"2024-04-15T15:31:39.494956+0000","last_peered":"2024-04-15T15:31:39.494956+0000","last_clean":"2024-04-15T15:31:39.494956+0000","last_became_active":"2024-04-15T15:31:34.468672+0000","last_became_peered":"2024-04-15T15:31:34.468672+0000","last_unstale":"2024-04-15T15:31:39.494956+0000","last_undegraded":"2024-04-15T15:31:39.494956+0000","last_fullsized":"2024-04-15T15:31:39.494956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495762+0000","last_change":"2024-04-15T15:31:34.468002+0000","last_active":"2024-04-15T15:31:39.495762+0000","last_peered":"2024-04-15T15:31:39.495762+0000","last_clean":"2024-04-15T15:31:39.495762+0000","last_became_active":"2024-04-15T15:31:34.467722+0000","last_became_peered":"2024-04-15T15:31:34.467722+0000","last_unstale":"2024-04-15T15:31:39.495762+0000","last_undegraded":"2024-04-15T15:31:39.495762+0000","last_fullsized":"2024-04-15T15:31:39.495762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:32.225234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044380+0000","last_change":"2024-04-15T15:31:34.480518+0000","last_active":"2024-04-15T15:31:41.044380+0000","last_peered":"2024-04-15T15:31:41.044380+0000","last_clean":"2024-04-15T15:31:41.044380+0000","last_became_active":"2024-04-15T15:31:34.480217+0000","last_became_peered":"2024-04-15T15:31:34.480217+0000","last_unstale":"2024-04-15T15:31:41.044380+0000","last_undegraded":"2024-04-15T15:31:41.044380+0000","last_fullsized":"2024-04-15T15:31:41.044380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044414+0000","last_change":"2024-04-15T15:31:34.476865+0000","last_active":"2024-04-15T15:31:41.044414+0000","last_peered":"2024-04-15T15:31:41.044414+0000","last_clean":"2024-04-15T15:31:41.044414+0000","last_became_active":"2024-04-15T15:31:34.476592+0000","last_became_peered":"2024-04-15T15:31:34.476592+0000","last_unstale":"2024-04-15T15:31:41.044414+0000","last_undegraded":"2024-04-15T15:31:41.044414+0000","last_fullsized":"2024-04-15T15:31:41.044414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.497050+0000","last_change":"2024-04-15T15:31:34.470331+0000","last_active":"2024-04-15T15:31:39.497050+0000","last_peered":"2024-04-15T15:31:39.497050+0000","last_clean":"2024-04-15T15:31:39.497050+0000","last_became_active":"2024-04-15T15:31:34.469766+0000","last_became_peered":"2024-04-15T15:31:34.469766+0000","last_unstale":"2024-04-15T15:31:39.497050+0000","last_undegraded":"2024-04-15T15:31:39.497050+0000","last_fullsized":"2024-04-15T15:31:39.497050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:28.573374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494297+0000","last_change":"2024-04-15T15:31:34.477666+0000","last_active":"2024-04-15T15:31:39.494297+0000","last_peered":"2024-04-15T15:31:39.494297+0000","last_clean":"2024-04-15T15:31:39.494297+0000","last_became_active":"2024-04-15T15:31:34.477474+0000","last_became_peered":"2024-04-15T15:31:34.477474+0000","last_unstale":"2024-04-15T15:31:39.494297+0000","last_undegraded":"2024-04-15T15:31:39.494297+0000","last_fullsized":"2024-04-15T15:31:39.494297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495353+0000","last_change":"2024-04-15T15:31:34.464289+0000","last_active":"2024-04-15T15:31:39.495353+0000","last_peered":"2024-04-15T15:31:39.495353+0000","last_clean":"2024-04-15T15:31:39.495353+0000","last_became_active":"2024-04-15T15:31:34.463192+0000","last_became_peered":"2024-04-15T15:31:34.463192+0000","last_unstale":"2024-04-15T15:31:39.495353+0000","last_undegraded":"2024-04-15T15:31:39.495353+0000","last_fullsized":"2024-04-15T15:31:39.495353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397536+0000","last_change":"2024-04-15T15:31:34.468251+0000","last_active":"2024-04-15T15:31:41.397536+0000","last_peered":"2024-04-15T15:31:41.397536+0000","last_clean":"2024-04-15T15:31:41.397536+0000","last_became_active":"2024-04-15T15:31:34.466070+0000","last_became_peered":"2024-04-15T15:31:34.466070+0000","last_unstale":"2024-04-15T15:31:41.397536+0000","last_undegraded":"2024-04-15T15:31:41.397536+0000","last_fullsized":"2024-04-15T15:31:41.397536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495574+0000","last_change":"2024-04-15T15:31:34.455934+0000","last_active":"2024-04-15T15:31:39.495574+0000","last_peered":"2024-04-15T15:31:39.495574+0000","last_clean":"2024-04-15T15:31:39.495574+0000","last_became_active":"2024-04-15T15:31:34.455599+0000","last_became_peered":"2024-04-15T15:31:34.455599+0000","last_unstale":"2024-04-15T15:31:39.495574+0000","last_undegraded":"2024-04-15T15:31:39.495574+0000","last_fullsized":"2024-04-15T15:31:39.495574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397749+0000","last_change":"2024-04-15T15:31:34.484026+0000","last_active":"2024-04-15T15:31:41.397749+0000","last_peered":"2024-04-15T15:31:41.397749+0000","last_clean":"2024-04-15T15:31:41.397749+0000","last_became_active":"2024-04-15T15:31:34.483383+0000","last_became_peered":"2024-04-15T15:31:34.483383+0000","last_unstale":"2024-04-15T15:31:41.397749+0000","last_undegraded":"2024-04-15T15:31:41.397749+0000","last_fullsized":"2024-04-15T15:31:41.397749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750318+0000","last_change":"2024-04-15T15:31:34.470556+0000","last_active":"2024-04-15T15:31:41.750318+0000","last_peered":"2024-04-15T15:31:41.750318+0000","last_clean":"2024-04-15T15:31:41.750318+0000","last_became_active":"2024-04-15T15:31:34.467292+0000","last_became_peered":"2024-04-15T15:31:34.467292+0000","last_unstale":"2024-04-15T15:31:41.750318+0000","last_undegraded":"2024-04-15T15:31:41.750318+0000","last_fullsized":"2024-04-15T15:31:41.750318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661305+0000","last_change":"2024-04-15T15:31:34.470522+0000","last_active":"2024-04-15T15:31:41.661305+0000","last_peered":"2024-04-15T15:31:41.661305+0000","last_clean":"2024-04-15T15:31:41.661305+0000","last_became_active":"2024-04-15T15:31:34.470091+0000","last_became_peered":"2024-04-15T15:31:34.470091+0000","last_unstale":"2024-04-15T15:31:41.661305+0000","last_undegraded":"2024-04-15T15:31:41.661305+0000","last_fullsized":"2024-04-15T15:31:41.661305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496926+0000","last_change":"2024-04-15T15:31:34.460838+0000","last_active":"2024-04-15T15:31:39.496926+0000","last_peered":"2024-04-15T15:31:39.496926+0000","last_clean":"2024-04-15T15:31:39.496926+0000","last_became_active":"2024-04-15T15:31:34.460557+0000","last_became_peered":"2024-04-15T15:31:34.460557+0000","last_unstale":"2024-04-15T15:31:39.496926+0000","last_undegraded":"2024-04-15T15:31:39.496926+0000","last_fullsized":"2024-04-15T15:31:39.496926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:16.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:31:58.638 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:31:58.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.809+0000 7f60d4800640 1 Processor -- start 2024-04-15T15:31:58.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.809+0000 7f60d4800640 1 -- start start 2024-04-15T15:31:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.809+0000 7f60d4800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f60cc15b5d0 0x7f60cc15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.809+0000 7f60d4800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 0x7f60cc0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.809+0000 7f60d4800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60cc070160 con 0x7f60cc0b25f0 2024-04-15T15:31:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.809+0000 7f60d4800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f60cc15b9b0 con 0x7f60cc15b5d0 2024-04-15T15:31:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.809+0000 7f60d4800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc15f1f0 con 0x7f60cc0b3e30 2024-04-15T15:31:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f60cc15b5d0 0x7f60cc15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 0x7f60cc0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 0x7f60cc0b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:34752/0 (socket says 172.21.15.73:34752) 2024-04-15T15:31:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f60cc15b5d0 0x7f60cc15fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:50644/0 (socket says 172.21.15.73:50644) 2024-04-15T15:31:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1400640 1 -- 172.21.15.73:0/2224117812 learned_addr learned my addr 172.21.15.73:0/2224117812 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:58.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1400640 1 -- 172.21.15.73:0/2224117812 >> v2:172.21.15.118:3300/0 conn(0x7f60cc15b5d0 msgr2=0x7f60cc15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:58.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1400640 1 --2- 172.21.15.73:0/2224117812 >> v2:172.21.15.118:3300/0 conn(0x7f60cc15b5d0 0x7f60cc15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1400640 1 -- 172.21.15.73:0/2224117812 >> v1:172.21.15.118:6789/0 conn(0x7f60cc0b25f0 legacy=0x7f60cc0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1400640 1 -- 172.21.15.73:0/2224117812 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc06fe80 con 0x7f60cc0b3e30 2024-04-15T15:31:58.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d0a00640 1 -- 172.21.15.73:0/2224117812 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858089195 0 0) 0x7f60cc070160 con 0x7f60cc0b25f0 2024-04-15T15:31:58.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1e00640 1 --2- 172.21.15.73:0/2224117812 >> v2:172.21.15.118:3300/0 conn(0x7f60cc15b5d0 0x7f60cc15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:31:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.813+0000 7f60d1400640 1 --2- 172.21.15.73:0/2224117812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 0x7f60cc0b20b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009870 tx=0x7f60bc01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57bbb94cec1757d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d0a00640 1 -- 172.21.15.73:0/2224117812 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0b0070 con 0x7f60cc0b3e30 2024-04-15T15:31:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d0a00640 1 -- 172.21.15.73:0/2224117812 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60bc0ab600 con 0x7f60cc0b3e30 2024-04-15T15:31:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d0a00640 1 -- 172.21.15.73:0/2224117812 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0ab9d0 con 0x7f60cc0b3e30 2024-04-15T15:31:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 -- 172.21.15.73:0/2224117812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 msgr2=0x7f60cc0b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 --2- 172.21.15.73:0/2224117812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 0x7f60cc0b20b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009870 tx=0x7f60bc01c410 comp rx=0 tx=0).stop 2024-04-15T15:31:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 -- 172.21.15.73:0/2224117812 shutdown_connections 2024-04-15T15:31:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 --2- 172.21.15.73:0/2224117812 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 0x7f60cc0b20b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 --2- 172.21.15.73:0/2224117812 >> v2:172.21.15.118:3300/0 conn(0x7f60cc15b5d0 0x7f60cc15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 -- 172.21.15.73:0/2224117812 >> 172.21.15.73:0/2224117812 conn(0x7f60cc067dd0 msgr2=0x7f60cc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 -- 172.21.15.73:0/2224117812 shutdown_connections 2024-04-15T15:31:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 -- 172.21.15.73:0/2224117812 wait complete. 2024-04-15T15:31:58.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 Processor -- start 2024-04-15T15:31:58.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 -- start start 2024-04-15T15:31:58.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc0b25f0 0x7f60cc0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 0x7f60cc0ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60cc15b5d0 0x7f60cc0aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc06faa0 con 0x7f60cc0b25f0 2024-04-15T15:31:58.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc0cfd00 con 0x7f60cc15b5d0 2024-04-15T15:31:58.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d4800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc06fc20 con 0x7f60cc0b3e30 2024-04-15T15:31:58.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d1e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc0b25f0 0x7f60cc0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d1e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc0b25f0 0x7f60cc0b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58800/0 (socket says 172.21.15.73:58800) 2024-04-15T15:31:58.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d1e00640 1 -- 172.21.15.73:0/1388853028 learned_addr learned my addr 172.21.15.73:0/1388853028 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:58.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d1400640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 0x7f60cc0ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.817+0000 7f60d2800640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60cc15b5d0 0x7f60cc0aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60d1e00640 1 -- 172.21.15.73:0/1388853028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 msgr2=0x7f60cc0ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60d1e00640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 0x7f60cc0ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60d1e00640 1 -- 172.21.15.73:0/1388853028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60cc15b5d0 msgr2=0x7f60cc0aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60d1e00640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60cc15b5d0 0x7f60cc0aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60d1e00640 1 -- 172.21.15.73:0/1388853028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc14e4c0 con 0x7f60cc0b25f0 2024-04-15T15:31:58.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60d1e00640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc0b25f0 0x7f60cc0b1250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f60c000ebe0 tx=0x7f60c000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60c6000640 1 -- 172.21.15.73:0/1388853028 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0017070 con 0x7f60cc0b25f0 2024-04-15T15:31:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60c6000640 1 -- 172.21.15.73:0/1388853028 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c000cc30 con 0x7f60cc0b25f0 2024-04-15T15:31:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60c6000640 1 -- 172.21.15.73:0/1388853028 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0013470 con 0x7f60cc0b25f0 2024-04-15T15:31:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60d4800640 1 -- 172.21.15.73:0/1388853028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60cc0adb20 con 0x7f60cc0b25f0 2024-04-15T15:31:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60d4800640 1 -- 172.21.15.73:0/1388853028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60cc0ae0e0 con 0x7f60cc0b25f0 2024-04-15T15:31:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60d4800640 1 -- 172.21.15.73:0/1388853028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60cc068ab0 con 0x7f60cc0b25f0 2024-04-15T15:31:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60c6000640 1 -- 172.21.15.73:0/1388853028 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f60c001a070 con 0x7f60cc0b25f0 2024-04-15T15:31:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60c6000640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f60b0068380 0x7f60b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60c6000640 1 -- 172.21.15.73:0/1388853028 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f60c0086f70 con 0x7f60cc0b25f0 2024-04-15T15:31:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.821+0000 7f60d1400640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f60b0068380 0x7f60b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.825+0000 7f60d1400640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f60b0068380 0x7f60b006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0ad000 tx=0x7f60bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:58.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.825+0000 7f60c6000640 1 -- 172.21.15.73:0/1388853028 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60c0056b90 con 0x7f60cc0b25f0 2024-04-15T15:31:58.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.981+0000 7f60d4800640 1 -- 172.21.15.73:0/1388853028 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60cc06f370 con 0x7f60b0068380 2024-04-15T15:31:58.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.989+0000 7f60c6000640 1 -- 172.21.15.73:0/1388853028 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332538 (secure 0 0 0) 0x7f60cc06f370 con 0x7f60b0068380 2024-04-15T15:31:58.995 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:58.997 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:31:58.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 -- 172.21.15.73:0/1388853028 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f60b0068380 msgr2=0x7f60b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f60b0068380 0x7f60b006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0ad000 tx=0x7f60bc008040 comp rx=0 tx=0).stop 2024-04-15T15:31:58.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 -- 172.21.15.73:0/1388853028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc0b25f0 msgr2=0x7f60cc0b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:58.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc0b25f0 0x7f60cc0b1250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f60c000ebe0 tx=0x7f60c000c520 comp rx=0 tx=0).stop 2024-04-15T15:31:58.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 -- 172.21.15.73:0/1388853028 shutdown_connections 2024-04-15T15:31:58.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60cc15b5d0 0x7f60cc0aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f60b0068380 0x7f60b006a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc0b3e30 0x7f60cc0ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 --2- 172.21.15.73:0/1388853028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60cc0b25f0 0x7f60cc0b1250 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:58.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 -- 172.21.15.73:0/1388853028 >> 172.21.15.73:0/1388853028 conn(0x7f60cc067dd0 msgr2=0x7f60cc06de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:58.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 -- 172.21.15.73:0/1388853028 shutdown_connections 2024-04-15T15:31:58.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:58.993+0000 7f60d4800640 1 -- 172.21.15.73:0/1388853028 wait complete. 2024-04-15T15:31:59.016 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-15T15:31:57.360864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223632,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751088,"statfs":{"total":773094113280,"available":772865114112,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002612"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749471+0000","last_change":"2024-04-15T15:31:33.445529+0000","last_active":"2024-04-15T15:31:41.749471+0000","last_peered":"2024-04-15T15:31:41.749471+0000","last_clean":"2024-04-15T15:31:41.749471+0000","last_became_active":"2024-04-15T15:31:33.444843+0000","last_became_peered":"2024-04-15T15:31:33.444843+0000","last_unstale":"2024-04-15T15:31:41.749471+0000","last_undegraded":"2024-04-15T15:31:41.749471+0000","last_fullsized":"2024-04-15T15:31:41.749471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:55:28.751007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494876+0000","last_change":"2024-04-15T15:31:34.469462+0000","last_active":"2024-04-15T15:31:39.494876+0000","last_peered":"2024-04-15T15:31:39.494876+0000","last_clean":"2024-04-15T15:31:39.494876+0000","last_became_active":"2024-04-15T15:31:34.468636+0000","last_became_peered":"2024-04-15T15:31:34.468636+0000","last_unstale":"2024-04-15T15:31:39.494876+0000","last_undegraded":"2024-04-15T15:31:39.494876+0000","last_fullsized":"2024-04-15T15:31:39.494876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494365+0000","last_change":"2024-04-15T15:31:38.508287+0000","last_active":"2024-04-15T15:31:39.494365+0000","last_peered":"2024-04-15T15:31:39.494365+0000","last_clean":"2024-04-15T15:31:39.494365+0000","last_became_active":"2024-04-15T15:31:38.507377+0000","last_became_peered":"2024-04-15T15:31:38.507377+0000","last_unstale":"2024-04-15T15:31:39.494365+0000","last_undegraded":"2024-04-15T15:31:39.494365+0000","last_fullsized":"2024-04-15T15:31:39.494365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:19.820153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495019+0000","last_change":"2024-04-15T15:31:33.461774+0000","last_active":"2024-04-15T15:31:39.495019+0000","last_peered":"2024-04-15T15:31:39.495019+0000","last_clean":"2024-04-15T15:31:39.495019+0000","last_became_active":"2024-04-15T15:31:33.461439+0000","last_became_peered":"2024-04-15T15:31:33.461439+0000","last_unstale":"2024-04-15T15:31:39.495019+0000","last_undegraded":"2024-04-15T15:31:39.495019+0000","last_fullsized":"2024-04-15T15:31:39.495019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750446+0000","last_change":"2024-04-15T15:31:34.482829+0000","last_active":"2024-04-15T15:31:41.750446+0000","last_peered":"2024-04-15T15:31:41.750446+0000","last_clean":"2024-04-15T15:31:41.750446+0000","last_became_active":"2024-04-15T15:31:34.481691+0000","last_became_peered":"2024-04-15T15:31:34.481691+0000","last_unstale":"2024-04-15T15:31:41.750446+0000","last_undegraded":"2024-04-15T15:31:41.750446+0000","last_fullsized":"2024-04-15T15:31:41.750446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494732+0000","last_change":"2024-04-15T15:31:38.509783+0000","last_active":"2024-04-15T15:31:39.494732+0000","last_peered":"2024-04-15T15:31:39.494732+0000","last_clean":"2024-04-15T15:31:39.494732+0000","last_became_active":"2024-04-15T15:31:38.509318+0000","last_became_peered":"2024-04-15T15:31:38.509318+0000","last_unstale":"2024-04-15T15:31:39.494732+0000","last_undegraded":"2024-04-15T15:31:39.494732+0000","last_fullsized":"2024-04-15T15:31:39.494732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:41.291523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496578+0000","last_change":"2024-04-15T15:31:33.469801+0000","last_active":"2024-04-15T15:31:39.496578+0000","last_peered":"2024-04-15T15:31:39.496578+0000","last_clean":"2024-04-15T15:31:39.496578+0000","last_became_active":"2024-04-15T15:31:33.469406+0000","last_became_peered":"2024-04-15T15:31:33.469406+0000","last_unstale":"2024-04-15T15:31:39.496578+0000","last_undegraded":"2024-04-15T15:31:39.496578+0000","last_fullsized":"2024-04-15T15:31:39.496578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397887+0000","last_change":"2024-04-15T15:31:34.480152+0000","last_active":"2024-04-15T15:31:41.397887+0000","last_peered":"2024-04-15T15:31:41.397887+0000","last_clean":"2024-04-15T15:31:41.397887+0000","last_became_active":"2024-04-15T15:31:34.479857+0000","last_became_peered":"2024-04-15T15:31:34.479857+0000","last_unstale":"2024-04-15T15:31:41.397887+0000","last_undegraded":"2024-04-15T15:31:41.397887+0000","last_fullsized":"2024-04-15T15:31:41.397887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495216+0000","last_change":"2024-04-15T15:31:38.513301+0000","last_active":"2024-04-15T15:31:39.495216+0000","last_peered":"2024-04-15T15:31:39.495216+0000","last_clean":"2024-04-15T15:31:39.495216+0000","last_became_active":"2024-04-15T15:31:38.512294+0000","last_became_peered":"2024-04-15T15:31:38.512294+0000","last_unstale":"2024-04-15T15:31:39.495216+0000","last_undegraded":"2024-04-15T15:31:39.495216+0000","last_fullsized":"2024-04-15T15:31:39.495216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:58.375388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495343+0000","last_change":"2024-04-15T15:31:33.468436+0000","last_active":"2024-04-15T15:31:39.495343+0000","last_peered":"2024-04-15T15:31:39.495343+0000","last_clean":"2024-04-15T15:31:39.495343+0000","last_became_active":"2024-04-15T15:31:33.468066+0000","last_became_peered":"2024-04-15T15:31:33.468066+0000","last_unstale":"2024-04-15T15:31:39.495343+0000","last_undegraded":"2024-04-15T15:31:39.495343+0000","last_fullsized":"2024-04-15T15:31:39.495343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397924+0000","last_change":"2024-04-15T15:31:34.478455+0000","last_active":"2024-04-15T15:31:41.397924+0000","last_peered":"2024-04-15T15:31:41.397924+0000","last_clean":"2024-04-15T15:31:41.397924+0000","last_became_active":"2024-04-15T15:31:34.477083+0000","last_became_peered":"2024-04-15T15:31:34.477083+0000","last_unstale":"2024-04-15T15:31:41.397924+0000","last_undegraded":"2024-04-15T15:31:41.397924+0000","last_fullsized":"2024-04-15T15:31:41.397924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:28.573374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495022+0000","last_change":"2024-04-15T15:31:38.513693+0000","last_active":"2024-04-15T15:31:39.495022+0000","last_peered":"2024-04-15T15:31:39.495022+0000","last_clean":"2024-04-15T15:31:39.495022+0000","last_became_active":"2024-04-15T15:31:38.508340+0000","last_became_peered":"2024-04-15T15:31:38.508340+0000","last_unstale":"2024-04-15T15:31:39.495022+0000","last_undegraded":"2024-04-15T15:31:39.495022+0000","last_fullsized":"2024-04-15T15:31:39.495022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:40:02.295646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043775+0000","last_change":"2024-04-15T15:31:34.470639+0000","last_active":"2024-04-15T15:31:41.043775+0000","last_peered":"2024-04-15T15:31:41.043775+0000","last_clean":"2024-04-15T15:31:41.043775+0000","last_became_active":"2024-04-15T15:31:34.470352+0000","last_became_peered":"2024-04-15T15:31:34.470352+0000","last_unstale":"2024-04-15T15:31:41.043775+0000","last_undegraded":"2024-04-15T15:31:41.043775+0000","last_fullsized":"2024-04-15T15:31:41.043775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495785+0000","last_change":"2024-04-15T15:31:33.468093+0000","last_active":"2024-04-15T15:31:39.495785+0000","last_peered":"2024-04-15T15:31:39.495785+0000","last_clean":"2024-04-15T15:31:39.495785+0000","last_became_active":"2024-04-15T15:31:33.464597+0000","last_became_peered":"2024-04-15T15:31:33.464597+0000","last_unstale":"2024-04-15T15:31:39.495785+0000","last_undegraded":"2024-04-15T15:31:39.495785+0000","last_fullsized":"2024-04-15T15:31:39.495785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:31.218635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495353+0000","last_change":"2024-04-15T15:31:38.508916+0000","last_active":"2024-04-15T15:31:39.495353+0000","last_peered":"2024-04-15T15:31:39.495353+0000","last_clean":"2024-04-15T15:31:39.495353+0000","last_became_active":"2024-04-15T15:31:38.507396+0000","last_became_peered":"2024-04-15T15:31:38.507396+0000","last_unstale":"2024-04-15T15:31:39.495353+0000","last_undegraded":"2024-04-15T15:31:39.495353+0000","last_fullsized":"2024-04-15T15:31:39.495353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:16.026259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494597+0000","last_change":"2024-04-15T15:31:34.478907+0000","last_active":"2024-04-15T15:31:39.494597+0000","last_peered":"2024-04-15T15:31:39.494597+0000","last_clean":"2024-04-15T15:31:39.494597+0000","last_became_active":"2024-04-15T15:31:34.478612+0000","last_became_peered":"2024-04-15T15:31:34.478612+0000","last_unstale":"2024-04-15T15:31:39.494597+0000","last_undegraded":"2024-04-15T15:31:39.494597+0000","last_fullsized":"2024-04-15T15:31:39.494597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660317+0000","last_change":"2024-04-15T15:31:33.464608+0000","last_active":"2024-04-15T15:31:41.660317+0000","last_peered":"2024-04-15T15:31:41.660317+0000","last_clean":"2024-04-15T15:31:41.660317+0000","last_became_active":"2024-04-15T15:31:33.463697+0000","last_became_peered":"2024-04-15T15:31:33.463697+0000","last_unstale":"2024-04-15T15:31:41.660317+0000","last_undegraded":"2024-04-15T15:31:41.660317+0000","last_fullsized":"2024-04-15T15:31:41.660317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495009+0000","last_change":"2024-04-15T15:31:38.512929+0000","last_active":"2024-04-15T15:31:39.495009+0000","last_peered":"2024-04-15T15:31:39.495009+0000","last_clean":"2024-04-15T15:31:39.495009+0000","last_became_active":"2024-04-15T15:31:38.512502+0000","last_became_peered":"2024-04-15T15:31:38.512502+0000","last_unstale":"2024-04-15T15:31:39.495009+0000","last_undegraded":"2024-04-15T15:31:39.495009+0000","last_fullsized":"2024-04-15T15:31:39.495009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:07.300884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494687+0000","last_change":"2024-04-15T15:31:34.475733+0000","last_active":"2024-04-15T15:31:39.494687+0000","last_peered":"2024-04-15T15:31:39.494687+0000","last_clean":"2024-04-15T15:31:39.494687+0000","last_became_active":"2024-04-15T15:31:34.475366+0000","last_became_peered":"2024-04-15T15:31:34.475366+0000","last_unstale":"2024-04-15T15:31:39.494687+0000","last_undegraded":"2024-04-15T15:31:39.494687+0000","last_fullsized":"2024-04-15T15:31:39.494687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660301+0000","last_change":"2024-04-15T15:31:33.471618+0000","last_active":"2024-04-15T15:31:41.660301+0000","last_peered":"2024-04-15T15:31:41.660301+0000","last_clean":"2024-04-15T15:31:41.660301+0000","last_became_active":"2024-04-15T15:31:33.471405+0000","last_became_peered":"2024-04-15T15:31:33.471405+0000","last_unstale":"2024-04-15T15:31:41.660301+0000","last_undegraded":"2024-04-15T15:31:41.660301+0000","last_fullsized":"2024-04-15T15:31:41.660301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661411+0000","last_change":"2024-04-15T15:31:38.525886+0000","last_active":"2024-04-15T15:31:41.661411+0000","last_peered":"2024-04-15T15:31:41.661411+0000","last_clean":"2024-04-15T15:31:41.661411+0000","last_became_active":"2024-04-15T15:31:38.525493+0000","last_became_peered":"2024-04-15T15:31:38.525493+0000","last_unstale":"2024-04-15T15:31:41.661411+0000","last_undegraded":"2024-04-15T15:31:41.661411+0000","last_fullsized":"2024-04-15T15:31:41.661411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:20.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496343+0000","last_change":"2024-04-15T15:31:34.458960+0000","last_active":"2024-04-15T15:31:39.496343+0000","last_peered":"2024-04-15T15:31:39.496343+0000","last_clean":"2024-04-15T15:31:39.496343+0000","last_became_active":"2024-04-15T15:31:34.457972+0000","last_became_peered":"2024-04-15T15:31:34.457972+0000","last_unstale":"2024-04-15T15:31:39.496343+0000","last_undegraded":"2024-04-15T15:31:39.496343+0000","last_fullsized":"2024-04-15T15:31:39.496343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:34.951963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494692+0000","last_change":"2024-04-15T15:31:33.461302+0000","last_active":"2024-04-15T15:31:39.494692+0000","last_peered":"2024-04-15T15:31:39.494692+0000","last_clean":"2024-04-15T15:31:39.494692+0000","last_became_active":"2024-04-15T15:31:33.458813+0000","last_became_peered":"2024-04-15T15:31:33.458813+0000","last_unstale":"2024-04-15T15:31:39.494692+0000","last_undegraded":"2024-04-15T15:31:39.494692+0000","last_fullsized":"2024-04-15T15:31:39.494692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495913+0000","last_change":"2024-04-15T15:31:38.514622+0000","last_active":"2024-04-15T15:31:39.495913+0000","last_peered":"2024-04-15T15:31:39.495913+0000","last_clean":"2024-04-15T15:31:39.495913+0000","last_became_active":"2024-04-15T15:31:38.513418+0000","last_became_peered":"2024-04-15T15:31:38.513418+0000","last_unstale":"2024-04-15T15:31:39.495913+0000","last_undegraded":"2024-04-15T15:31:39.495913+0000","last_fullsized":"2024-04-15T15:31:39.495913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750568+0000","last_change":"2024-04-15T15:31:34.468186+0000","last_active":"2024-04-15T15:31:41.750568+0000","last_peered":"2024-04-15T15:31:41.750568+0000","last_clean":"2024-04-15T15:31:41.750568+0000","last_became_active":"2024-04-15T15:31:34.467908+0000","last_became_peered":"2024-04-15T15:31:34.467908+0000","last_unstale":"2024-04-15T15:31:41.750568+0000","last_undegraded":"2024-04-15T15:31:41.750568+0000","last_fullsized":"2024-04-15T15:31:41.750568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044539+0000","last_change":"2024-04-15T15:31:33.467227+0000","last_active":"2024-04-15T15:31:41.044539+0000","last_peered":"2024-04-15T15:31:41.044539+0000","last_clean":"2024-04-15T15:31:41.044539+0000","last_became_active":"2024-04-15T15:31:33.466947+0000","last_became_peered":"2024-04-15T15:31:33.466947+0000","last_unstale":"2024-04-15T15:31:41.044539+0000","last_undegraded":"2024-04-15T15:31:41.044539+0000","last_fullsized":"2024-04-15T15:31:41.044539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496140+0000","last_change":"2024-04-15T15:31:38.508721+0000","last_active":"2024-04-15T15:31:39.496140+0000","last_peered":"2024-04-15T15:31:39.496140+0000","last_clean":"2024-04-15T15:31:39.496140+0000","last_became_active":"2024-04-15T15:31:38.508183+0000","last_became_peered":"2024-04-15T15:31:38.508183+0000","last_unstale":"2024-04-15T15:31:39.496140+0000","last_undegraded":"2024-04-15T15:31:39.496140+0000","last_fullsized":"2024-04-15T15:31:39.496140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495271+0000","last_change":"2024-04-15T15:31:34.479989+0000","last_active":"2024-04-15T15:31:39.495271+0000","last_peered":"2024-04-15T15:31:39.495271+0000","last_clean":"2024-04-15T15:31:39.495271+0000","last_became_active":"2024-04-15T15:31:34.479662+0000","last_became_peered":"2024-04-15T15:31:34.479662+0000","last_unstale":"2024-04-15T15:31:39.495271+0000","last_undegraded":"2024-04-15T15:31:39.495271+0000","last_fullsized":"2024-04-15T15:31:39.495271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660411+0000","last_change":"2024-04-15T15:31:33.470912+0000","last_active":"2024-04-15T15:31:41.660411+0000","last_peered":"2024-04-15T15:31:41.660411+0000","last_clean":"2024-04-15T15:31:41.660411+0000","last_became_active":"2024-04-15T15:31:33.470665+0000","last_became_peered":"2024-04-15T15:31:33.470665+0000","last_unstale":"2024-04-15T15:31:41.660411+0000","last_undegraded":"2024-04-15T15:31:41.660411+0000","last_fullsized":"2024-04-15T15:31:41.660411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494323+0000","last_change":"2024-04-15T15:31:38.530139+0000","last_active":"2024-04-15T15:31:39.494323+0000","last_peered":"2024-04-15T15:31:39.494323+0000","last_clean":"2024-04-15T15:31:39.494323+0000","last_became_active":"2024-04-15T15:31:38.529420+0000","last_became_peered":"2024-04-15T15:31:38.529420+0000","last_unstale":"2024-04-15T15:31:39.494323+0000","last_undegraded":"2024-04-15T15:31:39.494323+0000","last_fullsized":"2024-04-15T15:31:39.494323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:25:04.752470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661111+0000","last_change":"2024-04-15T15:31:34.458302+0000","last_active":"2024-04-15T15:31:41.661111+0000","last_peered":"2024-04-15T15:31:41.661111+0000","last_clean":"2024-04-15T15:31:41.661111+0000","last_became_active":"2024-04-15T15:31:34.455963+0000","last_became_peered":"2024-04-15T15:31:34.455963+0000","last_unstale":"2024-04-15T15:31:41.661111+0000","last_undegraded":"2024-04-15T15:31:41.661111+0000","last_fullsized":"2024-04-15T15:31:41.661111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496735+0000","last_change":"2024-04-15T15:31:33.465392+0000","last_active":"2024-04-15T15:31:39.496735+0000","last_peered":"2024-04-15T15:31:39.496735+0000","last_clean":"2024-04-15T15:31:39.496735+0000","last_became_active":"2024-04-15T15:31:33.462727+0000","last_became_peered":"2024-04-15T15:31:33.462727+0000","last_unstale":"2024-04-15T15:31:39.496735+0000","last_undegraded":"2024-04-15T15:31:39.496735+0000","last_fullsized":"2024-04-15T15:31:39.496735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:31:42.645531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750004+0000","last_change":"2024-04-15T15:31:38.529068+0000","last_active":"2024-04-15T15:31:41.750004+0000","last_peered":"2024-04-15T15:31:41.750004+0000","last_clean":"2024-04-15T15:31:41.750004+0000","last_became_active":"2024-04-15T15:31:38.521736+0000","last_became_peered":"2024-04-15T15:31:38.521736+0000","last_unstale":"2024-04-15T15:31:41.750004+0000","last_undegraded":"2024-04-15T15:31:41.750004+0000","last_fullsized":"2024-04-15T15:31:41.750004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398049+0000","last_change":"2024-04-15T15:31:34.483798+0000","last_active":"2024-04-15T15:31:41.398049+0000","last_peered":"2024-04-15T15:31:41.398049+0000","last_clean":"2024-04-15T15:31:41.398049+0000","last_became_active":"2024-04-15T15:31:34.483476+0000","last_became_peered":"2024-04-15T15:31:34.483476+0000","last_unstale":"2024-04-15T15:31:41.398049+0000","last_undegraded":"2024-04-15T15:31:41.398049+0000","last_fullsized":"2024-04-15T15:31:41.398049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:43.459915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661205+0000","last_change":"2024-04-15T15:31:33.455617+0000","last_active":"2024-04-15T15:31:41.661205+0000","last_peered":"2024-04-15T15:31:41.661205+0000","last_clean":"2024-04-15T15:31:41.661205+0000","last_became_active":"2024-04-15T15:31:33.453330+0000","last_became_peered":"2024-04-15T15:31:33.453330+0000","last_unstale":"2024-04-15T15:31:41.661205+0000","last_undegraded":"2024-04-15T15:31:41.661205+0000","last_fullsized":"2024-04-15T15:31:41.661205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660834+0000","last_change":"2024-04-15T15:31:38.523416+0000","last_active":"2024-04-15T15:31:41.660834+0000","last_peered":"2024-04-15T15:31:41.660834+0000","last_clean":"2024-04-15T15:31:41.660834+0000","last_became_active":"2024-04-15T15:31:38.522902+0000","last_became_peered":"2024-04-15T15:31:38.522902+0000","last_unstale":"2024-04-15T15:31:41.660834+0000","last_undegraded":"2024-04-15T15:31:41.660834+0000","last_fullsized":"2024-04-15T15:31:41.660834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495419+0000","last_change":"2024-04-15T15:31:34.477054+0000","last_active":"2024-04-15T15:31:39.495419+0000","last_peered":"2024-04-15T15:31:39.495419+0000","last_clean":"2024-04-15T15:31:39.495419+0000","last_became_active":"2024-04-15T15:31:34.476543+0000","last_became_peered":"2024-04-15T15:31:34.476543+0000","last_unstale":"2024-04-15T15:31:39.495419+0000","last_undegraded":"2024-04-15T15:31:39.495419+0000","last_fullsized":"2024-04-15T15:31:39.495419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:31.194810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397846+0000","last_change":"2024-04-15T15:31:33.463222+0000","last_active":"2024-04-15T15:31:41.397846+0000","last_peered":"2024-04-15T15:31:41.397846+0000","last_clean":"2024-04-15T15:31:41.397846+0000","last_became_active":"2024-04-15T15:31:33.462885+0000","last_became_peered":"2024-04-15T15:31:33.462885+0000","last_unstale":"2024-04-15T15:31:41.397846+0000","last_undegraded":"2024-04-15T15:31:41.397846+0000","last_fullsized":"2024-04-15T15:31:41.397846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661135+0000","last_change":"2024-04-15T15:31:38.530546+0000","last_active":"2024-04-15T15:31:41.661135+0000","last_peered":"2024-04-15T15:31:41.661135+0000","last_clean":"2024-04-15T15:31:41.661135+0000","last_became_active":"2024-04-15T15:31:38.523847+0000","last_became_peered":"2024-04-15T15:31:38.523847+0000","last_unstale":"2024-04-15T15:31:41.661135+0000","last_undegraded":"2024-04-15T15:31:41.661135+0000","last_fullsized":"2024-04-15T15:31:41.661135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660785+0000","last_change":"2024-04-15T15:31:34.466367+0000","last_active":"2024-04-15T15:31:41.660785+0000","last_peered":"2024-04-15T15:31:41.660785+0000","last_clean":"2024-04-15T15:31:41.660785+0000","last_became_active":"2024-04-15T15:31:34.465456+0000","last_became_peered":"2024-04-15T15:31:34.465456+0000","last_unstale":"2024-04-15T15:31:41.660785+0000","last_undegraded":"2024-04-15T15:31:41.660785+0000","last_fullsized":"2024-04-15T15:31:41.660785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930895+0000","last_change":"2024-04-15T15:31:33.459428+0000","last_active":"2024-04-15T15:31:39.930895+0000","last_peered":"2024-04-15T15:31:39.930895+0000","last_clean":"2024-04-15T15:31:39.930895+0000","last_became_active":"2024-04-15T15:31:33.459061+0000","last_became_peered":"2024-04-15T15:31:33.459061+0000","last_unstale":"2024-04-15T15:31:39.930895+0000","last_undegraded":"2024-04-15T15:31:39.930895+0000","last_fullsized":"2024-04-15T15:31:39.930895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661442+0000","last_change":"2024-04-15T15:31:38.526730+0000","last_active":"2024-04-15T15:31:41.661442+0000","last_peered":"2024-04-15T15:31:41.661442+0000","last_clean":"2024-04-15T15:31:41.661442+0000","last_became_active":"2024-04-15T15:31:38.526377+0000","last_became_peered":"2024-04-15T15:31:38.526377+0000","last_unstale":"2024-04-15T15:31:41.661442+0000","last_undegraded":"2024-04-15T15:31:41.661442+0000","last_fullsized":"2024-04-15T15:31:41.661442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:32.616780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749771+0000","last_change":"2024-04-15T15:31:34.467685+0000","last_active":"2024-04-15T15:31:41.749771+0000","last_peered":"2024-04-15T15:31:41.749771+0000","last_clean":"2024-04-15T15:31:41.749771+0000","last_became_active":"2024-04-15T15:31:34.467225+0000","last_became_peered":"2024-04-15T15:31:34.467225+0000","last_unstale":"2024-04-15T15:31:41.749771+0000","last_undegraded":"2024-04-15T15:31:41.749771+0000","last_fullsized":"2024-04-15T15:31:41.749771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:59:25.080403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494797+0000","last_change":"2024-04-15T15:31:33.468019+0000","last_active":"2024-04-15T15:31:39.494797+0000","last_peered":"2024-04-15T15:31:39.494797+0000","last_clean":"2024-04-15T15:31:39.494797+0000","last_became_active":"2024-04-15T15:31:33.465568+0000","last_became_peered":"2024-04-15T15:31:33.465568+0000","last_unstale":"2024-04-15T15:31:39.494797+0000","last_undegraded":"2024-04-15T15:31:39.494797+0000","last_fullsized":"2024-04-15T15:31:39.494797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750596+0000","last_change":"2024-04-15T15:31:38.510659+0000","last_active":"2024-04-15T15:31:41.750596+0000","last_peered":"2024-04-15T15:31:41.750596+0000","last_clean":"2024-04-15T15:31:41.750596+0000","last_became_active":"2024-04-15T15:31:38.510130+0000","last_became_peered":"2024-04-15T15:31:38.510130+0000","last_unstale":"2024-04-15T15:31:41.750596+0000","last_undegraded":"2024-04-15T15:31:41.750596+0000","last_fullsized":"2024-04-15T15:31:41.750596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:11:14.235709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494622+0000","last_change":"2024-04-15T15:31:34.475942+0000","last_active":"2024-04-15T15:31:39.494622+0000","last_peered":"2024-04-15T15:31:39.494622+0000","last_clean":"2024-04-15T15:31:39.494622+0000","last_became_active":"2024-04-15T15:31:34.475645+0000","last_became_peered":"2024-04-15T15:31:34.475645+0000","last_unstale":"2024-04-15T15:31:39.494622+0000","last_undegraded":"2024-04-15T15:31:39.494622+0000","last_fullsized":"2024-04-15T15:31:39.494622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397687+0000","last_change":"2024-04-15T15:31:33.460934+0000","last_active":"2024-04-15T15:31:41.397687+0000","last_peered":"2024-04-15T15:31:41.397687+0000","last_clean":"2024-04-15T15:31:41.397687+0000","last_became_active":"2024-04-15T15:31:33.460488+0000","last_became_peered":"2024-04-15T15:31:33.460488+0000","last_unstale":"2024-04-15T15:31:41.397687+0000","last_undegraded":"2024-04-15T15:31:41.397687+0000","last_fullsized":"2024-04-15T15:31:41.397687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494896+0000","last_change":"2024-04-15T15:31:23.443687+0000","last_active":"2024-04-15T15:31:39.494896+0000","last_peered":"2024-04-15T15:31:39.494896+0000","last_clean":"2024-04-15T15:31:39.494896+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:31:39.494896+0000","last_undegraded":"2024-04-15T15:31:39.494896+0000","last_fullsized":"2024-04-15T15:31:39.494896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_clean_scrub_stamp":"2024-04-15T15:31:22.092427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:28:43.096549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044263+0000","last_change":"2024-04-15T15:31:38.509517+0000","last_active":"2024-04-15T15:31:41.044263+0000","last_peered":"2024-04-15T15:31:41.044263+0000","last_clean":"2024-04-15T15:31:41.044263+0000","last_became_active":"2024-04-15T15:31:38.509241+0000","last_became_peered":"2024-04-15T15:31:38.509241+0000","last_unstale":"2024-04-15T15:31:41.044263+0000","last_undegraded":"2024-04-15T15:31:41.044263+0000","last_fullsized":"2024-04-15T15:31:41.044263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496472+0000","last_change":"2024-04-15T15:31:34.482434+0000","last_active":"2024-04-15T15:31:39.496472+0000","last_peered":"2024-04-15T15:31:39.496472+0000","last_clean":"2024-04-15T15:31:39.496472+0000","last_became_active":"2024-04-15T15:31:34.481970+0000","last_became_peered":"2024-04-15T15:31:34.481970+0000","last_unstale":"2024-04-15T15:31:39.496472+0000","last_undegraded":"2024-04-15T15:31:39.496472+0000","last_fullsized":"2024-04-15T15:31:39.496472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:55.879743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931168+0000","last_change":"2024-04-15T15:31:33.463661+0000","last_active":"2024-04-15T15:31:39.931168+0000","last_peered":"2024-04-15T15:31:39.931168+0000","last_clean":"2024-04-15T15:31:39.931168+0000","last_became_active":"2024-04-15T15:31:33.463363+0000","last_became_peered":"2024-04-15T15:31:33.463363+0000","last_unstale":"2024-04-15T15:31:39.931168+0000","last_undegraded":"2024-04-15T15:31:39.931168+0000","last_fullsized":"2024-04-15T15:31:39.931168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044102+0000","last_change":"2024-04-15T15:31:38.508644+0000","last_active":"2024-04-15T15:31:41.044102+0000","last_peered":"2024-04-15T15:31:41.044102+0000","last_clean":"2024-04-15T15:31:41.044102+0000","last_became_active":"2024-04-15T15:31:38.508203+0000","last_became_peered":"2024-04-15T15:31:38.508203+0000","last_unstale":"2024-04-15T15:31:41.044102+0000","last_undegraded":"2024-04-15T15:31:41.044102+0000","last_fullsized":"2024-04-15T15:31:41.044102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:59.083086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397921+0000","last_change":"2024-04-15T15:31:34.484117+0000","last_active":"2024-04-15T15:31:41.397921+0000","last_peered":"2024-04-15T15:31:41.397921+0000","last_clean":"2024-04-15T15:31:41.397921+0000","last_became_active":"2024-04-15T15:31:34.483764+0000","last_became_peered":"2024-04-15T15:31:34.483764+0000","last_unstale":"2024-04-15T15:31:41.397921+0000","last_undegraded":"2024-04-15T15:31:41.397921+0000","last_fullsized":"2024-04-15T15:31:41.397921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:55.879743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660358+0000","last_change":"2024-04-15T15:31:33.462350+0000","last_active":"2024-04-15T15:31:41.660358+0000","last_peered":"2024-04-15T15:31:41.660358+0000","last_clean":"2024-04-15T15:31:41.660358+0000","last_became_active":"2024-04-15T15:31:33.462003+0000","last_became_peered":"2024-04-15T15:31:33.462003+0000","last_unstale":"2024-04-15T15:31:41.660358+0000","last_undegraded":"2024-04-15T15:31:41.660358+0000","last_fullsized":"2024-04-15T15:31:41.660358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750132+0000","last_change":"2024-04-15T15:31:38.518872+0000","last_active":"2024-04-15T15:31:41.750132+0000","last_peered":"2024-04-15T15:31:41.750132+0000","last_clean":"2024-04-15T15:31:41.750132+0000","last_became_active":"2024-04-15T15:31:38.517803+0000","last_became_peered":"2024-04-15T15:31:38.517803+0000","last_unstale":"2024-04-15T15:31:41.750132+0000","last_undegraded":"2024-04-15T15:31:41.750132+0000","last_fullsized":"2024-04-15T15:31:41.750132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:20.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.497118+0000","last_change":"2024-04-15T15:31:34.455266+0000","last_active":"2024-04-15T15:31:39.497118+0000","last_peered":"2024-04-15T15:31:39.497118+0000","last_clean":"2024-04-15T15:31:39.497118+0000","last_became_active":"2024-04-15T15:31:34.454909+0000","last_became_peered":"2024-04-15T15:31:34.454909+0000","last_unstale":"2024-04-15T15:31:39.497118+0000","last_undegraded":"2024-04-15T15:31:39.497118+0000","last_fullsized":"2024-04-15T15:31:39.497118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:11:10.192304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931330+0000","last_change":"2024-04-15T15:31:33.459513+0000","last_active":"2024-04-15T15:31:39.931330+0000","last_peered":"2024-04-15T15:31:39.931330+0000","last_clean":"2024-04-15T15:31:39.931330+0000","last_became_active":"2024-04-15T15:31:33.458815+0000","last_became_peered":"2024-04-15T15:31:33.458815+0000","last_unstale":"2024-04-15T15:31:39.931330+0000","last_undegraded":"2024-04-15T15:31:39.931330+0000","last_fullsized":"2024-04-15T15:31:39.931330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397253+0000","last_change":"2024-04-15T15:31:38.502775+0000","last_active":"2024-04-15T15:31:41.397253+0000","last_peered":"2024-04-15T15:31:41.397253+0000","last_clean":"2024-04-15T15:31:41.397253+0000","last_became_active":"2024-04-15T15:31:38.502352+0000","last_became_peered":"2024-04-15T15:31:38.502352+0000","last_unstale":"2024-04-15T15:31:41.397253+0000","last_undegraded":"2024-04-15T15:31:41.397253+0000","last_fullsized":"2024-04-15T15:31:41.397253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:19.820153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496741+0000","last_change":"2024-04-15T15:31:34.460915+0000","last_active":"2024-04-15T15:31:39.496741+0000","last_peered":"2024-04-15T15:31:39.496741+0000","last_clean":"2024-04-15T15:31:39.496741+0000","last_became_active":"2024-04-15T15:31:34.460597+0000","last_became_peered":"2024-04-15T15:31:34.460597+0000","last_unstale":"2024-04-15T15:31:39.496741+0000","last_undegraded":"2024-04-15T15:31:39.496741+0000","last_fullsized":"2024-04-15T15:31:39.496741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:47.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495992+0000","last_change":"2024-04-15T15:31:33.454373+0000","last_active":"2024-04-15T15:31:39.495992+0000","last_peered":"2024-04-15T15:31:39.495992+0000","last_clean":"2024-04-15T15:31:39.495992+0000","last_became_active":"2024-04-15T15:31:33.454125+0000","last_became_peered":"2024-04-15T15:31:33.454125+0000","last_unstale":"2024-04-15T15:31:39.495992+0000","last_undegraded":"2024-04-15T15:31:39.495992+0000","last_fullsized":"2024-04-15T15:31:39.495992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:37:53.773475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496068+0000","last_change":"2024-04-15T15:31:38.511943+0000","last_active":"2024-04-15T15:31:39.496068+0000","last_peered":"2024-04-15T15:31:39.496068+0000","last_clean":"2024-04-15T15:31:39.496068+0000","last_became_active":"2024-04-15T15:31:38.511494+0000","last_became_peered":"2024-04-15T15:31:38.511494+0000","last_unstale":"2024-04-15T15:31:39.496068+0000","last_undegraded":"2024-04-15T15:31:39.496068+0000","last_fullsized":"2024-04-15T15:31:39.496068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495491+0000","last_change":"2024-04-15T15:31:34.446971+0000","last_active":"2024-04-15T15:31:39.495491+0000","last_peered":"2024-04-15T15:31:39.495491+0000","last_clean":"2024-04-15T15:31:39.495491+0000","last_became_active":"2024-04-15T15:31:34.446687+0000","last_became_peered":"2024-04-15T15:31:34.446687+0000","last_unstale":"2024-04-15T15:31:39.495491+0000","last_undegraded":"2024-04-15T15:31:39.495491+0000","last_fullsized":"2024-04-15T15:31:39.495491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930804+0000","last_change":"2024-04-15T15:31:33.450642+0000","last_active":"2024-04-15T15:31:39.930804+0000","last_peered":"2024-04-15T15:31:39.930804+0000","last_clean":"2024-04-15T15:31:39.930804+0000","last_became_active":"2024-04-15T15:31:33.450034+0000","last_became_peered":"2024-04-15T15:31:33.450034+0000","last_unstale":"2024-04-15T15:31:39.930804+0000","last_undegraded":"2024-04-15T15:31:39.930804+0000","last_fullsized":"2024-04-15T15:31:39.930804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:34:26.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750433+0000","last_change":"2024-04-15T15:31:38.516804+0000","last_active":"2024-04-15T15:31:41.750433+0000","last_peered":"2024-04-15T15:31:41.750433+0000","last_clean":"2024-04-15T15:31:41.750433+0000","last_became_active":"2024-04-15T15:31:38.516244+0000","last_became_peered":"2024-04-15T15:31:38.516244+0000","last_unstale":"2024-04-15T15:31:41.750433+0000","last_undegraded":"2024-04-15T15:31:41.750433+0000","last_fullsized":"2024-04-15T15:31:41.750433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:47.503321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043900+0000","last_change":"2024-04-15T15:31:34.473243+0000","last_active":"2024-04-15T15:31:41.043900+0000","last_peered":"2024-04-15T15:31:41.043900+0000","last_clean":"2024-04-15T15:31:41.043900+0000","last_became_active":"2024-04-15T15:31:34.472907+0000","last_became_peered":"2024-04-15T15:31:34.472907+0000","last_unstale":"2024-04-15T15:31:41.043900+0000","last_undegraded":"2024-04-15T15:31:41.043900+0000","last_fullsized":"2024-04-15T15:31:41.043900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043921+0000","last_change":"2024-04-15T15:31:33.455306+0000","last_active":"2024-04-15T15:31:41.043921+0000","last_peered":"2024-04-15T15:31:41.043921+0000","last_clean":"2024-04-15T15:31:41.043921+0000","last_became_active":"2024-04-15T15:31:33.454939+0000","last_became_peered":"2024-04-15T15:31:33.454939+0000","last_unstale":"2024-04-15T15:31:41.043921+0000","last_undegraded":"2024-04-15T15:31:41.043921+0000","last_fullsized":"2024-04-15T15:31:41.043921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495222+0000","last_change":"2024-04-15T15:31:38.530485+0000","last_active":"2024-04-15T15:31:39.495222+0000","last_peered":"2024-04-15T15:31:39.495222+0000","last_clean":"2024-04-15T15:31:39.495222+0000","last_became_active":"2024-04-15T15:31:38.529528+0000","last_became_peered":"2024-04-15T15:31:38.529528+0000","last_unstale":"2024-04-15T15:31:39.495222+0000","last_undegraded":"2024-04-15T15:31:39.495222+0000","last_fullsized":"2024-04-15T15:31:39.495222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:34:18.616473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495712+0000","last_change":"2024-04-15T15:31:34.477711+0000","last_active":"2024-04-15T15:31:39.495712+0000","last_peered":"2024-04-15T15:31:39.495712+0000","last_clean":"2024-04-15T15:31:39.495712+0000","last_became_active":"2024-04-15T15:31:34.477444+0000","last_became_peered":"2024-04-15T15:31:34.477444+0000","last_unstale":"2024-04-15T15:31:39.495712+0000","last_undegraded":"2024-04-15T15:31:39.495712+0000","last_fullsized":"2024-04-15T15:31:39.495712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397755+0000","last_change":"2024-04-15T15:31:33.467098+0000","last_active":"2024-04-15T15:31:41.397755+0000","last_peered":"2024-04-15T15:31:41.397755+0000","last_clean":"2024-04-15T15:31:41.397755+0000","last_became_active":"2024-04-15T15:31:33.466808+0000","last_became_peered":"2024-04-15T15:31:33.466808+0000","last_unstale":"2024-04-15T15:31:41.397755+0000","last_undegraded":"2024-04-15T15:31:41.397755+0000","last_fullsized":"2024-04-15T15:31:41.397755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:45:22.939076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495267+0000","last_change":"2024-04-15T15:31:38.523143+0000","last_active":"2024-04-15T15:31:39.495267+0000","last_peered":"2024-04-15T15:31:39.495267+0000","last_clean":"2024-04-15T15:31:39.495267+0000","last_became_active":"2024-04-15T15:31:38.522583+0000","last_became_peered":"2024-04-15T15:31:38.522583+0000","last_unstale":"2024-04-15T15:31:39.495267+0000","last_undegraded":"2024-04-15T15:31:39.495267+0000","last_fullsized":"2024-04-15T15:31:39.495267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:55:17.165005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749967+0000","last_change":"2024-04-15T15:31:34.457507+0000","last_active":"2024-04-15T15:31:41.749967+0000","last_peered":"2024-04-15T15:31:41.749967+0000","last_clean":"2024-04-15T15:31:41.749967+0000","last_became_active":"2024-04-15T15:31:34.457210+0000","last_became_peered":"2024-04-15T15:31:34.457210+0000","last_unstale":"2024-04-15T15:31:41.749967+0000","last_undegraded":"2024-04-15T15:31:41.749967+0000","last_fullsized":"2024-04-15T15:31:41.749967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749354+0000","last_change":"2024-04-15T15:31:33.457018+0000","last_active":"2024-04-15T15:31:41.749354+0000","last_peered":"2024-04-15T15:31:41.749354+0000","last_clean":"2024-04-15T15:31:41.749354+0000","last_became_active":"2024-04-15T15:31:33.456421+0000","last_became_peered":"2024-04-15T15:31:33.456421+0000","last_unstale":"2024-04-15T15:31:41.749354+0000","last_undegraded":"2024-04-15T15:31:41.749354+0000","last_fullsized":"2024-04-15T15:31:41.749354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:05.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397989+0000","last_change":"2024-04-15T15:31:38.508761+0000","last_active":"2024-04-15T15:31:41.397989+0000","last_peered":"2024-04-15T15:31:41.397989+0000","last_clean":"2024-04-15T15:31:41.397989+0000","last_became_active":"2024-04-15T15:31:38.508347+0000","last_became_peered":"2024-04-15T15:31:38.508347+0000","last_unstale":"2024-04-15T15:31:41.397989+0000","last_undegraded":"2024-04-15T15:31:41.397989+0000","last_fullsized":"2024-04-15T15:31:41.397989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:55:06.941769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495673+0000","last_change":"2024-04-15T15:31:34.456767+0000","last_active":"2024-04-15T15:31:39.495673+0000","last_peered":"2024-04-15T15:31:39.495673+0000","last_clean":"2024-04-15T15:31:39.495673+0000","last_became_active":"2024-04-15T15:31:34.456363+0000","last_became_peered":"2024-04-15T15:31:34.456363+0000","last_unstale":"2024-04-15T15:31:39.495673+0000","last_undegraded":"2024-04-15T15:31:39.495673+0000","last_fullsized":"2024-04-15T15:31:39.495673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:50.646519+0000","last_change":"2024-04-15T15:31:33.461422+0000","last_active":"2024-04-15T15:31:50.646519+0000","last_peered":"2024-04-15T15:31:50.646519+0000","last_clean":"2024-04-15T15:31:50.646519+0000","last_became_active":"2024-04-15T15:31:33.459911+0000","last_became_peered":"2024-04-15T15:31:33.459911+0000","last_unstale":"2024-04-15T15:31:50.646519+0000","last_undegraded":"2024-04-15T15:31:50.646519+0000","last_fullsized":"2024-04-15T15:31:50.646519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660990+0000","last_change":"2024-04-15T15:31:38.510570+0000","last_active":"2024-04-15T15:31:41.660990+0000","last_peered":"2024-04-15T15:31:41.660990+0000","last_clean":"2024-04-15T15:31:41.660990+0000","last_became_active":"2024-04-15T15:31:38.510025+0000","last_became_peered":"2024-04-15T15:31:38.510025+0000","last_unstale":"2024-04-15T15:31:41.660990+0000","last_undegraded":"2024-04-15T15:31:41.660990+0000","last_fullsized":"2024-04-15T15:31:41.660990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:29:59.923148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495834+0000","last_change":"2024-04-15T15:31:34.446494+0000","last_active":"2024-04-15T15:31:39.495834+0000","last_peered":"2024-04-15T15:31:39.495834+0000","last_clean":"2024-04-15T15:31:39.495834+0000","last_became_active":"2024-04-15T15:31:34.446162+0000","last_became_peered":"2024-04-15T15:31:34.446162+0000","last_unstale":"2024-04-15T15:31:39.495834+0000","last_undegraded":"2024-04-15T15:31:39.495834+0000","last_fullsized":"2024-04-15T15:31:39.495834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:31:43.652130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660356+0000","last_change":"2024-04-15T15:31:33.464177+0000","last_active":"2024-04-15T15:31:41.660356+0000","last_peered":"2024-04-15T15:31:41.660356+0000","last_clean":"2024-04-15T15:31:41.660356+0000","last_became_active":"2024-04-15T15:31:33.463834+0000","last_became_peered":"2024-04-15T15:31:33.463834+0000","last_unstale":"2024-04-15T15:31:41.660356+0000","last_undegraded":"2024-04-15T15:31:41.660356+0000","last_fullsized":"2024-04-15T15:31:41.660356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494954+0000","last_change":"2024-04-15T15:31:38.513560+0000","last_active":"2024-04-15T15:31:39.494954+0000","last_peered":"2024-04-15T15:31:39.494954+0000","last_clean":"2024-04-15T15:31:39.494954+0000","last_became_active":"2024-04-15T15:31:38.512922+0000","last_became_peered":"2024-04-15T15:31:38.512922+0000","last_unstale":"2024-04-15T15:31:39.494954+0000","last_undegraded":"2024-04-15T15:31:39.494954+0000","last_fullsized":"2024-04-15T15:31:39.494954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:53.510244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750535+0000","last_change":"2024-04-15T15:31:34.486802+0000","last_active":"2024-04-15T15:31:41.750535+0000","last_peered":"2024-04-15T15:31:41.750535+0000","last_clean":"2024-04-15T15:31:41.750535+0000","last_became_active":"2024-04-15T15:31:34.481349+0000","last_became_peered":"2024-04-15T15:31:34.481349+0000","last_unstale":"2024-04-15T15:31:41.750535+0000","last_undegraded":"2024-04-15T15:31:41.750535+0000","last_fullsized":"2024-04-15T15:31:41.750535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398116+0000","last_change":"2024-04-15T15:31:33.470322+0000","last_active":"2024-04-15T15:31:41.398116+0000","last_peered":"2024-04-15T15:31:41.398116+0000","last_clean":"2024-04-15T15:31:41.398116+0000","last_became_active":"2024-04-15T15:31:33.470042+0000","last_became_peered":"2024-04-15T15:31:33.470042+0000","last_unstale":"2024-04-15T15:31:41.398116+0000","last_undegraded":"2024-04-15T15:31:41.398116+0000","last_fullsized":"2024-04-15T15:31:41.398116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:33.945365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494537+0000","last_change":"2024-04-15T15:31:38.515979+0000","last_active":"2024-04-15T15:31:39.494537+0000","last_peered":"2024-04-15T15:31:39.494537+0000","last_clean":"2024-04-15T15:31:39.494537+0000","last_became_active":"2024-04-15T15:31:38.510943+0000","last_became_peered":"2024-04-15T15:31:38.510943+0000","last_unstale":"2024-04-15T15:31:39.494537+0000","last_undegraded":"2024-04-15T15:31:39.494537+0000","last_fullsized":"2024-04-15T15:31:39.494537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:02:06.275540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398007+0000","last_change":"2024-04-15T15:31:34.468743+0000","last_active":"2024-04-15T15:31:41.398007+0000","last_peered":"2024-04-15T15:31:41.398007+0000","last_clean":"2024-04-15T15:31:41.398007+0000","last_became_active":"2024-04-15T15:31:34.468018+0000","last_became_peered":"2024-04-15T15:31:34.468018+0000","last_unstale":"2024-04-15T15:31:41.398007+0000","last_undegraded":"2024-04-15T15:31:41.398007+0000","last_fullsized":"2024-04-15T15:31:41.398007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:47.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044426+0000","last_change":"2024-04-15T15:31:33.473593+0000","last_active":"2024-04-15T15:31:41.044426+0000","last_peered":"2024-04-15T15:31:41.044426+0000","last_clean":"2024-04-15T15:31:41.044426+0000","last_became_active":"2024-04-15T15:31:33.473287+0000","last_became_peered":"2024-04-15T15:31:33.473287+0000","last_unstale":"2024-04-15T15:31:41.044426+0000","last_undegraded":"2024-04-15T15:31:41.044426+0000","last_fullsized":"2024-04-15T15:31:41.044426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:54.094826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494451+0000","last_change":"2024-04-15T15:31:38.507657+0000","last_active":"2024-04-15T15:31:39.494451+0000","last_peered":"2024-04-15T15:31:39.494451+0000","last_clean":"2024-04-15T15:31:39.494451+0000","last_became_active":"2024-04-15T15:31:38.507217+0000","last_became_peered":"2024-04-15T15:31:38.507217+0000","last_unstale":"2024-04-15T15:31:39.494451+0000","last_undegraded":"2024-04-15T15:31:39.494451+0000","last_fullsized":"2024-04-15T15:31:39.494451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:55:06.941769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750410+0000","last_change":"2024-04-15T15:31:38.521076+0000","last_active":"2024-04-15T15:31:41.750410+0000","last_peered":"2024-04-15T15:31:41.750410+0000","last_clean":"2024-04-15T15:31:41.750410+0000","last_became_active":"2024-04-15T15:31:38.518118+0000","last_became_peered":"2024-04-15T15:31:38.518118+0000","last_unstale":"2024-04-15T15:31:41.750410+0000","last_undegraded":"2024-04-15T15:31:41.750410+0000","last_fullsized":"2024-04-15T15:31:41.750410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:32.616780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660696+0000","last_change":"2024-04-15T15:31:34.460784+0000","last_active":"2024-04-15T15:31:41.660696+0000","last_peered":"2024-04-15T15:31:41.660696+0000","last_clean":"2024-04-15T15:31:41.660696+0000","last_became_active":"2024-04-15T15:31:34.460525+0000","last_became_peered":"2024-04-15T15:31:34.460525+0000","last_unstale":"2024-04-15T15:31:41.660696+0000","last_undegraded":"2024-04-15T15:31:41.660696+0000","last_fullsized":"2024-04-15T15:31:41.660696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397400+0000","last_change":"2024-04-15T15:31:33.462485+0000","last_active":"2024-04-15T15:31:41.397400+0000","last_peered":"2024-04-15T15:31:41.397400+0000","last_clean":"2024-04-15T15:31:41.397400+0000","last_became_active":"2024-04-15T15:31:33.461597+0000","last_became_peered":"2024-04-15T15:31:33.461597+0000","last_unstale":"2024-04-15T15:31:41.397400+0000","last_undegraded":"2024-04-15T15:31:41.397400+0000","last_fullsized":"2024-04-15T15:31:41.397400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:30.188212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044372+0000","last_change":"2024-04-15T15:31:38.513345+0000","last_active":"2024-04-15T15:31:41.044372+0000","last_peered":"2024-04-15T15:31:41.044372+0000","last_clean":"2024-04-15T15:31:41.044372+0000","last_became_active":"2024-04-15T15:31:38.512662+0000","last_became_peered":"2024-04-15T15:31:38.512662+0000","last_unstale":"2024-04-15T15:31:41.044372+0000","last_undegraded":"2024-04-15T15:31:41.044372+0000","last_fullsized":"2024-04-15T15:31:41.044372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:30:51.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494621+0000","last_change":"2024-04-15T15:31:34.483839+0000","last_active":"2024-04-15T15:31:39.494621+0000","last_peered":"2024-04-15T15:31:39.494621+0000","last_clean":"2024-04-15T15:31:39.494621+0000","last_became_active":"2024-04-15T15:31:34.483548+0000","last_became_peered":"2024-04-15T15:31:34.483548+0000","last_unstale":"2024-04-15T15:31:39.494621+0000","last_undegraded":"2024-04-15T15:31:39.494621+0000","last_fullsized":"2024-04-15T15:31:39.494621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494604+0000","last_change":"2024-04-15T15:31:33.466699+0000","last_active":"2024-04-15T15:31:39.494604+0000","last_peered":"2024-04-15T15:31:39.494604+0000","last_clean":"2024-04-15T15:31:39.494604+0000","last_became_active":"2024-04-15T15:31:33.466439+0000","last_became_peered":"2024-04-15T15:31:33.466439+0000","last_unstale":"2024-04-15T15:31:39.494604+0000","last_undegraded":"2024-04-15T15:31:39.494604+0000","last_fullsized":"2024-04-15T15:31:39.494604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:19.522593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044029+0000","last_change":"2024-04-15T15:31:33.464633+0000","last_active":"2024-04-15T15:31:41.044029+0000","last_peered":"2024-04-15T15:31:41.044029+0000","last_clean":"2024-04-15T15:31:41.044029+0000","last_became_active":"2024-04-15T15:31:33.463248+0000","last_became_peered":"2024-04-15T15:31:33.463248+0000","last_unstale":"2024-04-15T15:31:41.044029+0000","last_undegraded":"2024-04-15T15:31:41.044029+0000","last_fullsized":"2024-04-15T15:31:41.044029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:32.525390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750204+0000","last_change":"2024-04-15T15:31:34.483410+0000","last_active":"2024-04-15T15:31:41.750204+0000","last_peered":"2024-04-15T15:31:41.750204+0000","last_clean":"2024-04-15T15:31:41.750204+0000","last_became_active":"2024-04-15T15:31:34.482918+0000","last_became_peered":"2024-04-15T15:31:34.482918+0000","last_unstale":"2024-04-15T15:31:41.750204+0000","last_undegraded":"2024-04-15T15:31:41.750204+0000","last_fullsized":"2024-04-15T15:31:41.750204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931146+0000","last_change":"2024-04-15T15:31:38.511098+0000","last_active":"2024-04-15T15:31:39.931146+0000","last_peered":"2024-04-15T15:31:39.931146+0000","last_clean":"2024-04-15T15:31:39.931146+0000","last_became_active":"2024-04-15T15:31:38.510675+0000","last_became_peered":"2024-04-15T15:31:38.510675+0000","last_unstale":"2024-04-15T15:31:39.931146+0000","last_undegraded":"2024-04-15T15:31:39.931146+0000","last_fullsized":"2024-04-15T15:31:39.931146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:30:57.364887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494713+0000","last_change":"2024-04-15T15:31:33.460701+0000","last_active":"2024-04-15T15:31:39.494713+0000","last_peered":"2024-04-15T15:31:39.494713+0000","last_clean":"2024-04-15T15:31:39.494713+0000","last_became_active":"2024-04-15T15:31:33.460470+0000","last_became_peered":"2024-04-15T15:31:33.460470+0000","last_unstale":"2024-04-15T15:31:39.494713+0000","last_undegraded":"2024-04-15T15:31:39.494713+0000","last_fullsized":"2024-04-15T15:31:39.494713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:32.422295+0000","last_clean_scrub_stamp":"2024-04-15T15:31:32.422295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:34:26.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495245+0000","last_change":"2024-04-15T15:31:34.448451+0000","last_active":"2024-04-15T15:31:39.495245+0000","last_peered":"2024-04-15T15:31:39.495245+0000","last_clean":"2024-04-15T15:31:39.495245+0000","last_became_active":"2024-04-15T15:31:34.448097+0000","last_became_peered":"2024-04-15T15:31:34.448097+0000","last_unstale":"2024-04-15T15:31:39.495245+0000","last_undegraded":"2024-04-15T15:31:39.495245+0000","last_fullsized":"2024-04-15T15:31:39.495245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:52:33.531988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495355+0000","last_change":"2024-04-15T15:31:38.531110+0000","last_active":"2024-04-15T15:31:39.495355+0000","last_peered":"2024-04-15T15:31:39.495355+0000","last_clean":"2024-04-15T15:31:39.495355+0000","last_became_active":"2024-04-15T15:31:38.530696+0000","last_became_peered":"2024-04-15T15:31:38.530696+0000","last_unstale":"2024-04-15T15:31:39.495355+0000","last_undegraded":"2024-04-15T15:31:39.495355+0000","last_fullsized":"2024-04-15T15:31:39.495355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:37.472299+0000","last_clean_scrub_stamp":"2024-04-15T15:31:37.472299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:26:32.017433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.043703+0000","last_change":"2024-04-15T15:31:34.473155+0000","last_active":"2024-04-15T15:31:41.043703+0000","last_peered":"2024-04-15T15:31:41.043703+0000","last_clean":"2024-04-15T15:31:41.043703+0000","last_became_active":"2024-04-15T15:31:34.472849+0000","last_became_peered":"2024-04-15T15:31:34.472849+0000","last_unstale":"2024-04-15T15:31:41.043703+0000","last_undegraded":"2024-04-15T15:31:41.043703+0000","last_fullsized":"2024-04-15T15:31:41.043703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.930891+0000","last_change":"2024-04-15T15:31:34.477349+0000","last_active":"2024-04-15T15:31:39.930891+0000","last_peered":"2024-04-15T15:31:39.930891+0000","last_clean":"2024-04-15T15:31:39.930891+0000","last_became_active":"2024-04-15T15:31:34.476656+0000","last_became_peered":"2024-04-15T15:31:34.476656+0000","last_unstale":"2024-04-15T15:31:39.930891+0000","last_undegraded":"2024-04-15T15:31:39.930891+0000","last_fullsized":"2024-04-15T15:31:39.930891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:00:31.194810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397685+0000","last_change":"2024-04-15T15:31:34.483891+0000","last_active":"2024-04-15T15:31:41.397685+0000","last_peered":"2024-04-15T15:31:41.397685+0000","last_clean":"2024-04-15T15:31:41.397685+0000","last_became_active":"2024-04-15T15:31:34.483555+0000","last_became_peered":"2024-04-15T15:31:34.483555+0000","last_unstale":"2024-04-15T15:31:41.397685+0000","last_undegraded":"2024-04-15T15:31:41.397685+0000","last_fullsized":"2024-04-15T15:31:41.397685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750122+0000","last_change":"2024-04-15T15:31:34.483847+0000","last_active":"2024-04-15T15:31:41.750122+0000","last_peered":"2024-04-15T15:31:41.750122+0000","last_clean":"2024-04-15T15:31:41.750122+0000","last_became_active":"2024-04-15T15:31:34.483415+0000","last_became_peered":"2024-04-15T15:31:34.483415+0000","last_unstale":"2024-04-15T15:31:41.750122+0000","last_undegraded":"2024-04-15T15:31:41.750122+0000","last_fullsized":"2024-04-15T15:31:41.750122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495343+0000","last_change":"2024-04-15T15:31:34.483771+0000","last_active":"2024-04-15T15:31:39.495343+0000","last_peered":"2024-04-15T15:31:39.495343+0000","last_clean":"2024-04-15T15:31:39.495343+0000","last_became_active":"2024-04-15T15:31:34.483472+0000","last_became_peered":"2024-04-15T15:31:34.483472+0000","last_unstale":"2024-04-15T15:31:39.495343+0000","last_undegraded":"2024-04-15T15:31:39.495343+0000","last_fullsized":"2024-04-15T15:31:39.495343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:04:54.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661067+0000","last_change":"2024-04-15T15:31:34.460695+0000","last_active":"2024-04-15T15:31:41.661067+0000","last_peered":"2024-04-15T15:31:41.661067+0000","last_clean":"2024-04-15T15:31:41.661067+0000","last_became_active":"2024-04-15T15:31:34.460352+0000","last_became_peered":"2024-04-15T15:31:34.460352+0000","last_unstale":"2024-04-15T15:31:41.661067+0000","last_undegraded":"2024-04-15T15:31:41.661067+0000","last_fullsized":"2024-04-15T15:31:41.661067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044449+0000","last_change":"2024-04-15T15:31:34.463653+0000","last_active":"2024-04-15T15:31:41.044449+0000","last_peered":"2024-04-15T15:31:41.044449+0000","last_clean":"2024-04-15T15:31:41.044449+0000","last_became_active":"2024-04-15T15:31:34.463359+0000","last_became_peered":"2024-04-15T15:31:34.463359+0000","last_unstale":"2024-04-15T15:31:41.044449+0000","last_undegraded":"2024-04-15T15:31:41.044449+0000","last_fullsized":"2024-04-15T15:31:41.044449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495133+0000","last_change":"2024-04-15T15:31:34.479994+0000","last_active":"2024-04-15T15:31:39.495133+0000","last_peered":"2024-04-15T15:31:39.495133+0000","last_clean":"2024-04-15T15:31:39.495133+0000","last_became_active":"2024-04-15T15:31:34.479723+0000","last_became_peered":"2024-04-15T15:31:34.479723+0000","last_unstale":"2024-04-15T15:31:39.495133+0000","last_undegraded":"2024-04-15T15:31:39.495133+0000","last_fullsized":"2024-04-15T15:31:39.495133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397390+0000","last_change":"2024-04-15T15:31:34.479946+0000","last_active":"2024-04-15T15:31:41.397390+0000","last_peered":"2024-04-15T15:31:41.397390+0000","last_clean":"2024-04-15T15:31:41.397390+0000","last_became_active":"2024-04-15T15:31:34.479601+0000","last_became_peered":"2024-04-15T15:31:34.479601+0000","last_unstale":"2024-04-15T15:31:41.397390+0000","last_undegraded":"2024-04-15T15:31:41.397390+0000","last_fullsized":"2024-04-15T15:31:41.397390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494489+0000","last_change":"2024-04-15T15:31:34.475999+0000","last_active":"2024-04-15T15:31:39.494489+0000","last_peered":"2024-04-15T15:31:39.494489+0000","last_clean":"2024-04-15T15:31:39.494489+0000","last_became_active":"2024-04-15T15:31:34.475713+0000","last_became_peered":"2024-04-15T15:31:34.475713+0000","last_unstale":"2024-04-15T15:31:39.494489+0000","last_undegraded":"2024-04-15T15:31:39.494489+0000","last_fullsized":"2024-04-15T15:31:39.494489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397629+0000","last_change":"2024-04-15T15:31:34.466771+0000","last_active":"2024-04-15T15:31:41.397629+0000","last_peered":"2024-04-15T15:31:41.397629+0000","last_clean":"2024-04-15T15:31:41.397629+0000","last_became_active":"2024-04-15T15:31:34.465716+0000","last_became_peered":"2024-04-15T15:31:34.465716+0000","last_unstale":"2024-04-15T15:31:41.397629+0000","last_undegraded":"2024-04-15T15:31:41.397629+0000","last_fullsized":"2024-04-15T15:31:41.397629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:39:58.252240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749975+0000","last_change":"2024-04-15T15:31:34.468936+0000","last_active":"2024-04-15T15:31:41.749975+0000","last_peered":"2024-04-15T15:31:41.749975+0000","last_clean":"2024-04-15T15:31:41.749975+0000","last_became_active":"2024-04-15T15:31:34.467355+0000","last_became_peered":"2024-04-15T15:31:34.467355+0000","last_unstale":"2024-04-15T15:31:41.749975+0000","last_undegraded":"2024-04-15T15:31:41.749975+0000","last_fullsized":"2024-04-15T15:31:41.749975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044624+0000","last_change":"2024-04-15T15:31:34.469868+0000","last_active":"2024-04-15T15:31:41.044624+0000","last_peered":"2024-04-15T15:31:41.044624+0000","last_clean":"2024-04-15T15:31:41.044624+0000","last_became_active":"2024-04-15T15:31:34.469606+0000","last_became_peered":"2024-04-15T15:31:34.469606+0000","last_unstale":"2024-04-15T15:31:41.044624+0000","last_undegraded":"2024-04-15T15:31:41.044624+0000","last_fullsized":"2024-04-15T15:31:41.044624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496599+0000","last_change":"2024-04-15T15:31:34.456774+0000","last_active":"2024-04-15T15:31:39.496599+0000","last_peered":"2024-04-15T15:31:39.496599+0000","last_clean":"2024-04-15T15:31:39.496599+0000","last_became_active":"2024-04-15T15:31:34.456377+0000","last_became_peered":"2024-04-15T15:31:34.456377+0000","last_unstale":"2024-04-15T15:31:39.496599+0000","last_undegraded":"2024-04-15T15:31:39.496599+0000","last_fullsized":"2024-04-15T15:31:39.496599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:54:43.459915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.931279+0000","last_change":"2024-04-15T15:31:34.459078+0000","last_active":"2024-04-15T15:31:39.931279+0000","last_peered":"2024-04-15T15:31:39.931279+0000","last_clean":"2024-04-15T15:31:39.931279+0000","last_became_active":"2024-04-15T15:31:34.458498+0000","last_became_peered":"2024-04-15T15:31:34.458498+0000","last_unstale":"2024-04-15T15:31:39.931279+0000","last_undegraded":"2024-04-15T15:31:39.931279+0000","last_fullsized":"2024-04-15T15:31:39.931279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:08:34.951963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.398285+0000","last_change":"2024-04-15T15:31:34.472749+0000","last_active":"2024-04-15T15:31:41.398285+0000","last_peered":"2024-04-15T15:31:41.398285+0000","last_clean":"2024-04-15T15:31:41.398285+0000","last_became_active":"2024-04-15T15:31:34.472465+0000","last_became_peered":"2024-04-15T15:31:34.472465+0000","last_unstale":"2024-04-15T15:31:41.398285+0000","last_undegraded":"2024-04-15T15:31:41.398285+0000","last_fullsized":"2024-04-15T15:31:41.398285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:16.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397279+0000","last_change":"2024-04-15T15:31:34.472038+0000","last_active":"2024-04-15T15:31:41.397279+0000","last_peered":"2024-04-15T15:31:41.397279+0000","last_clean":"2024-04-15T15:31:41.397279+0000","last_became_active":"2024-04-15T15:31:34.471764+0000","last_became_peered":"2024-04-15T15:31:34.471764+0000","last_unstale":"2024-04-15T15:31:41.397279+0000","last_undegraded":"2024-04-15T15:31:41.397279+0000","last_fullsized":"2024-04-15T15:31:41.397279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:37.248117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.660748+0000","last_change":"2024-04-15T15:31:34.458770+0000","last_active":"2024-04-15T15:31:41.660748+0000","last_peered":"2024-04-15T15:31:41.660748+0000","last_clean":"2024-04-15T15:31:41.660748+0000","last_became_active":"2024-04-15T15:31:34.457006+0000","last_became_peered":"2024-04-15T15:31:34.457006+0000","last_unstale":"2024-04-15T15:31:41.660748+0000","last_undegraded":"2024-04-15T15:31:41.660748+0000","last_fullsized":"2024-04-15T15:31:41.660748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:39:27.709535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.749969+0000","last_change":"2024-04-15T15:31:34.461367+0000","last_active":"2024-04-15T15:31:41.749969+0000","last_peered":"2024-04-15T15:31:41.749969+0000","last_clean":"2024-04-15T15:31:41.749969+0000","last_became_active":"2024-04-15T15:31:34.461047+0000","last_became_peered":"2024-04-15T15:31:34.461047+0000","last_unstale":"2024-04-15T15:31:41.749969+0000","last_undegraded":"2024-04-15T15:31:41.749969+0000","last_fullsized":"2024-04-15T15:31:41.749969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:02:23.572024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494956+0000","last_change":"2024-04-15T15:31:34.469034+0000","last_active":"2024-04-15T15:31:39.494956+0000","last_peered":"2024-04-15T15:31:39.494956+0000","last_clean":"2024-04-15T15:31:39.494956+0000","last_became_active":"2024-04-15T15:31:34.468672+0000","last_became_peered":"2024-04-15T15:31:34.468672+0000","last_unstale":"2024-04-15T15:31:39.494956+0000","last_undegraded":"2024-04-15T15:31:39.494956+0000","last_fullsized":"2024-04-15T15:31:39.494956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:49.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495762+0000","last_change":"2024-04-15T15:31:34.468002+0000","last_active":"2024-04-15T15:31:39.495762+0000","last_peered":"2024-04-15T15:31:39.495762+0000","last_clean":"2024-04-15T15:31:39.495762+0000","last_became_active":"2024-04-15T15:31:34.467722+0000","last_became_peered":"2024-04-15T15:31:34.467722+0000","last_unstale":"2024-04-15T15:31:39.495762+0000","last_undegraded":"2024-04-15T15:31:39.495762+0000","last_fullsized":"2024-04-15T15:31:39.495762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:32.225234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044380+0000","last_change":"2024-04-15T15:31:34.480518+0000","last_active":"2024-04-15T15:31:41.044380+0000","last_peered":"2024-04-15T15:31:41.044380+0000","last_clean":"2024-04-15T15:31:41.044380+0000","last_became_active":"2024-04-15T15:31:34.480217+0000","last_became_peered":"2024-04-15T15:31:34.480217+0000","last_unstale":"2024-04-15T15:31:41.044380+0000","last_undegraded":"2024-04-15T15:31:41.044380+0000","last_fullsized":"2024-04-15T15:31:41.044380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:08:33.806415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.044414+0000","last_change":"2024-04-15T15:31:34.476865+0000","last_active":"2024-04-15T15:31:41.044414+0000","last_peered":"2024-04-15T15:31:41.044414+0000","last_clean":"2024-04-15T15:31:41.044414+0000","last_became_active":"2024-04-15T15:31:34.476592+0000","last_became_peered":"2024-04-15T15:31:34.476592+0000","last_unstale":"2024-04-15T15:31:41.044414+0000","last_undegraded":"2024-04-15T15:31:41.044414+0000","last_fullsized":"2024-04-15T15:31:41.044414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:54:08.238874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.497050+0000","last_change":"2024-04-15T15:31:34.470331+0000","last_active":"2024-04-15T15:31:39.497050+0000","last_peered":"2024-04-15T15:31:39.497050+0000","last_clean":"2024-04-15T15:31:39.497050+0000","last_became_active":"2024-04-15T15:31:34.469766+0000","last_became_peered":"2024-04-15T15:31:34.469766+0000","last_unstale":"2024-04-15T15:31:39.497050+0000","last_undegraded":"2024-04-15T15:31:39.497050+0000","last_fullsized":"2024-04-15T15:31:39.497050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:58:28.573374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.494297+0000","last_change":"2024-04-15T15:31:34.477666+0000","last_active":"2024-04-15T15:31:39.494297+0000","last_peered":"2024-04-15T15:31:39.494297+0000","last_clean":"2024-04-15T15:31:39.494297+0000","last_became_active":"2024-04-15T15:31:34.477474+0000","last_became_peered":"2024-04-15T15:31:34.477474+0000","last_unstale":"2024-04-15T15:31:39.494297+0000","last_undegraded":"2024-04-15T15:31:39.494297+0000","last_fullsized":"2024-04-15T15:31:39.494297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:31.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495353+0000","last_change":"2024-04-15T15:31:34.464289+0000","last_active":"2024-04-15T15:31:39.495353+0000","last_peered":"2024-04-15T15:31:39.495353+0000","last_clean":"2024-04-15T15:31:39.495353+0000","last_became_active":"2024-04-15T15:31:34.463192+0000","last_became_peered":"2024-04-15T15:31:34.463192+0000","last_unstale":"2024-04-15T15:31:39.495353+0000","last_undegraded":"2024-04-15T15:31:39.495353+0000","last_fullsized":"2024-04-15T15:31:39.495353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397536+0000","last_change":"2024-04-15T15:31:34.468251+0000","last_active":"2024-04-15T15:31:41.397536+0000","last_peered":"2024-04-15T15:31:41.397536+0000","last_clean":"2024-04-15T15:31:41.397536+0000","last_became_active":"2024-04-15T15:31:34.466070+0000","last_became_peered":"2024-04-15T15:31:34.466070+0000","last_unstale":"2024-04-15T15:31:41.397536+0000","last_undegraded":"2024-04-15T15:31:41.397536+0000","last_fullsized":"2024-04-15T15:31:41.397536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:03.257478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.495574+0000","last_change":"2024-04-15T15:31:34.455934+0000","last_active":"2024-04-15T15:31:39.495574+0000","last_peered":"2024-04-15T15:31:39.495574+0000","last_clean":"2024-04-15T15:31:39.495574+0000","last_became_active":"2024-04-15T15:31:34.455599+0000","last_became_peered":"2024-04-15T15:31:34.455599+0000","last_unstale":"2024-04-15T15:31:39.495574+0000","last_undegraded":"2024-04-15T15:31:39.495574+0000","last_fullsized":"2024-04-15T15:31:39.495574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:26:11.982853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.397749+0000","last_change":"2024-04-15T15:31:34.484026+0000","last_active":"2024-04-15T15:31:41.397749+0000","last_peered":"2024-04-15T15:31:41.397749+0000","last_clean":"2024-04-15T15:31:41.397749+0000","last_became_active":"2024-04-15T15:31:34.483383+0000","last_became_peered":"2024-04-15T15:31:34.483383+0000","last_unstale":"2024-04-15T15:31:41.397749+0000","last_undegraded":"2024-04-15T15:31:41.397749+0000","last_fullsized":"2024-04-15T15:31:41.397749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:01:55.039680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.750318+0000","last_change":"2024-04-15T15:31:34.470556+0000","last_active":"2024-04-15T15:31:41.750318+0000","last_peered":"2024-04-15T15:31:41.750318+0000","last_clean":"2024-04-15T15:31:41.750318+0000","last_became_active":"2024-04-15T15:31:34.467292+0000","last_became_peered":"2024-04-15T15:31:34.467292+0000","last_unstale":"2024-04-15T15:31:41.750318+0000","last_undegraded":"2024-04-15T15:31:41.750318+0000","last_fullsized":"2024-04-15T15:31:41.750318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:33.893965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:41.661305+0000","last_change":"2024-04-15T15:31:34.470522+0000","last_active":"2024-04-15T15:31:41.661305+0000","last_peered":"2024-04-15T15:31:41.661305+0000","last_clean":"2024-04-15T15:31:41.661305+0000","last_became_active":"2024-04-15T15:31:34.470091+0000","last_became_peered":"2024-04-15T15:31:34.470091+0000","last_unstale":"2024-04-15T15:31:41.661305+0000","last_undegraded":"2024-04-15T15:31:41.661305+0000","last_fullsized":"2024-04-15T15:31:41.661305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:24:33.564658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T15:31:39.496926+0000","last_change":"2024-04-15T15:31:34.460838+0000","last_active":"2024-04-15T15:31:39.496926+0000","last_peered":"2024-04-15T15:31:39.496926+0000","last_clean":"2024-04-15T15:31:39.496926+0000","last_became_active":"2024-04-15T15:31:34.460557+0000","last_became_peered":"2024-04-15T15:31:34.460557+0000","last_unstale":"2024-04-15T15:31:39.496926+0000","last_undegraded":"2024-04-15T15:31:39.496926+0000","last_fullsized":"2024-04-15T15:31:39.496926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:33.428893+0000","last_clean_scrub_stamp":"2024-04-15T15:31:33.428893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:08:16.390861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:31:59.021 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T15:31:59.021 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-15T15:31:59.021 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-15T15:31:59.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-15T15:31:59.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb65ca00640 1 Processor -- start 2024-04-15T15:31:59.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb65ca00640 1 -- start start 2024-04-15T15:31:59.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb65ca00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 0x7fb65815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb65ca00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6580cd3a0 con 0x7fb658146110 2024-04-15T15:31:59.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb65ca00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6580b29c0 con 0x7fb6580b20b0 2024-04-15T15:31:59.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb65ca00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb6580b5160 con 0x7fb6580b2530 2024-04-15T15:31:59.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb655e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb658146110 0x7fb6580cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53142/0 (socket says 172.21.15.73:53142) 2024-04-15T15:31:59.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb655e00640 1 -- 172.21.15.73:0/4212708352 learned_addr learned my addr 172.21.15.73:0/4212708352 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:59.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb656800640 1 --2- 172.21.15.73:0/4212708352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 0x7fb65815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb654a00640 1 -- 172.21.15.73:0/4212708352 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186289605 0 0) 0x7fb6580cd3a0 con 0x7fb658146110 2024-04-15T15:31:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb654a00640 1 -- 172.21.15.73:0/4212708352 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb63c003530 con 0x7fb658146110 2024-04-15T15:31:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb656800640 1 -- 172.21.15.73:0/4212708352 >> v1:172.21.15.118:6789/0 conn(0x7fb6580b20b0 legacy=0x7fb65815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb654a00640 1 -- 172.21.15.73:0/4212708352 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2361676193 0 0) 0x7fb6580b29c0 con 0x7fb6580b20b0 2024-04-15T15:31:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb656800640 1 -- 172.21.15.73:0/4212708352 >> v1:172.21.15.73:6789/0 conn(0x7fb658146110 legacy=0x7fb6580cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.189+0000 7fb656800640 1 -- 172.21.15.73:0/4212708352 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6580b40c0 con 0x7fb6580b2530 2024-04-15T15:31:59.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb656800640 1 --2- 172.21.15.73:0/4212708352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 0x7fb65815d2e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb6500097f0 tx=0x7fb65001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddced6bd75b07f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb654a00640 1 -- 172.21.15.73:0/4212708352 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6500aa610 con 0x7fb6580b2530 2024-04-15T15:31:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb654a00640 1 -- 172.21.15.73:0/4212708352 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6500af070 con 0x7fb6580b2530 2024-04-15T15:31:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb654a00640 1 -- 172.21.15.73:0/4212708352 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6500aa9d0 con 0x7fb6580b2530 2024-04-15T15:31:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb65ca00640 1 -- 172.21.15.73:0/4212708352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 msgr2=0x7fb65815d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb65ca00640 1 --2- 172.21.15.73:0/4212708352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 0x7fb65815d2e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb6500097f0 tx=0x7fb65001c4b0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb65ca00640 1 -- 172.21.15.73:0/4212708352 shutdown_connections 2024-04-15T15:31:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb65ca00640 1 --2- 172.21.15.73:0/4212708352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 0x7fb65815d2e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb65ca00640 1 -- 172.21.15.73:0/4212708352 >> 172.21.15.73:0/4212708352 conn(0x7fb658067dd0 msgr2=0x7fb6580d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb65ca00640 1 -- 172.21.15.73:0/4212708352 shutdown_connections 2024-04-15T15:31:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.193+0000 7fb65ca00640 1 -- 172.21.15.73:0/4212708352 wait complete. 2024-04-15T15:31:59.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb65ca00640 1 Processor -- start 2024-04-15T15:31:59.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb65ca00640 1 -- start start 2024-04-15T15:31:59.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb65ca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6580b20b0 0x7fb658158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb65ca00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 0x7fb65815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb65ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb658146110 0x7fb65813c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb65ca00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb6580b3d70 con 0x7fb6580b20b0 2024-04-15T15:31:59.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb65ca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb6580b4c40 con 0x7fb658146110 2024-04-15T15:31:59.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb65ca00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb65815dc30 con 0x7fb6580b2530 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb655e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6580b20b0 0x7fb658158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb655e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6580b20b0 0x7fb658158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58816/0 (socket says 172.21.15.73:58816) 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb655e00640 1 -- 172.21.15.73:0/2920258828 learned_addr learned my addr 172.21.15.73:0/2920258828 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb656800640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb658146110 0x7fb65813c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb655400640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 0x7fb65815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb655e00640 1 -- 172.21.15.73:0/2920258828 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 msgr2=0x7fb65815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb655e00640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 0x7fb65815c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb655e00640 1 -- 172.21.15.73:0/2920258828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb658146110 msgr2=0x7fb65813c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb655e00640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb658146110 0x7fb65813c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb655e00640 1 -- 172.21.15.73:0/2920258828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65815ad50 con 0x7fb6580b20b0 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb655e00640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6580b20b0 0x7fb658158cf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb64800cb70 tx=0x7fb64800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:59.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb64e000640 1 -- 172.21.15.73:0/2920258828 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648017070 con 0x7fb6580b20b0 2024-04-15T15:31:59.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb64e000640 1 -- 172.21.15.73:0/2920258828 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb64800ad40 con 0x7fb6580b20b0 2024-04-15T15:31:59.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb64e000640 1 -- 172.21.15.73:0/2920258828 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648012620 con 0x7fb6580b20b0 2024-04-15T15:31:59.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb65ca00640 1 -- 172.21.15.73:0/2920258828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65815b030 con 0x7fb6580b20b0 2024-04-15T15:31:59.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.197+0000 7fb65ca00640 1 -- 172.21.15.73:0/2920258828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65815b5f0 con 0x7fb6580b20b0 2024-04-15T15:31:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.201+0000 7fb65ca00640 1 -- 172.21.15.73:0/2920258828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb658068ab0 con 0x7fb6580b20b0 2024-04-15T15:31:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.201+0000 7fb64e000640 1 -- 172.21.15.73:0/2920258828 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb64801a070 con 0x7fb6580b20b0 2024-04-15T15:31:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.201+0000 7fb64e000640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb638068380 0x7fb63806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.201+0000 7fb64e000640 1 -- 172.21.15.73:0/2920258828 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb648086be0 con 0x7fb6580b20b0 2024-04-15T15:31:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.201+0000 7fb655400640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb638068380 0x7fb63806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.201+0000 7fb655400640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb638068380 0x7fb63806a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb6581f8440 tx=0x7fb644009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:59.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.205+0000 7fb64e000640 1 -- 172.21.15.73:0/2920258828 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb648056dc0 con 0x7fb6580b20b0 2024-04-15T15:31:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 -- 172.21.15.73:0/2920258828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb6580d0420 con 0x7fb6580b20b0 2024-04-15T15:31:59.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb64e000640 1 -- 172.21.15.73:0/2920258828 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb6480566c0 con 0x7fb6580b20b0 2024-04-15T15:31:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:59.402 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-15T15:31:59.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 -- 172.21.15.73:0/2920258828 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb638068380 msgr2=0x7fb63806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb638068380 0x7fb63806a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb6581f8440 tx=0x7fb644009040 comp rx=0 tx=0).stop 2024-04-15T15:31:59.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 -- 172.21.15.73:0/2920258828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6580b20b0 msgr2=0x7fb658158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6580b20b0 0x7fb658158cf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb64800cb70 tx=0x7fb64800a430 comp rx=0 tx=0).stop 2024-04-15T15:31:59.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 -- 172.21.15.73:0/2920258828 shutdown_connections 2024-04-15T15:31:59.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb658146110 0x7fb65813c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb638068380 0x7fb63806a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6580b2530 0x7fb65815c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 --2- 172.21.15.73:0/2920258828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6580b20b0 0x7fb658158cf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 -- 172.21.15.73:0/2920258828 >> 172.21.15.73:0/2920258828 conn(0x7fb658067dd0 msgr2=0x7fb6580b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:59.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 -- 172.21.15.73:0/2920258828 shutdown_connections 2024-04-15T15:31:59.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.401+0000 7fb65ca00640 1 -- 172.21.15.73:0/2920258828 wait complete. 2024-04-15T15:31:59.423 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-15T15:31:59.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:31:59.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.557+0000 7f1ef6000640 1 Processor -- start 2024-04-15T15:31:59.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.557+0000 7f1ef6000640 1 -- start start 2024-04-15T15:31:59.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.557+0000 7f1ef6000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1ef006d170 0x7f1ef0073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.557+0000 7f1ef6000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ef0070130 0x7f1ef006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.557+0000 7f1ef6000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef00b4810 con 0x7f1ef015e760 2024-04-15T15:31:59.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.557+0000 7f1ef6000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef00cd2f0 con 0x7f1ef0070130 2024-04-15T15:31:59.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.557+0000 7f1ef6000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef00b45c0 con 0x7f1ef006d170 2024-04-15T15:31:59.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.557+0000 7f1eef400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1ef015e760 0x7f1ef006ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53146/0 (socket says 172.21.15.73:53146) 2024-04-15T15:31:59.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.557+0000 7f1eef400640 1 -- 172.21.15.73:0/2146793227 learned_addr learned my addr 172.21.15.73:0/2146793227 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:59.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.557+0000 7f1eefe00640 1 --2- 172.21.15.73:0/2146793227 >> v2:172.21.15.73:3300/0 conn(0x7f1ef0070130 0x7f1ef006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.561+0000 7f1eeea00640 1 --2- 172.21.15.73:0/2146793227 >> v2:172.21.15.118:3300/0 conn(0x7f1ef006d170 0x7f1ef0073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.561+0000 7f1eefe00640 1 -- 172.21.15.73:0/2146793227 >> v2:172.21.15.118:3300/0 conn(0x7f1ef006d170 msgr2=0x7f1ef0073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:59.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.561+0000 7f1eefe00640 1 --2- 172.21.15.73:0/2146793227 >> v2:172.21.15.118:3300/0 conn(0x7f1ef006d170 0x7f1ef0073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.561+0000 7f1eee000640 1 -- 172.21.15.73:0/2146793227 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172981939 0 0) 0x7f1ef00b4810 con 0x7f1ef015e760 2024-04-15T15:31:59.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.561+0000 7f1eefe00640 1 -- 172.21.15.73:0/2146793227 >> v1:172.21.15.73:6789/0 conn(0x7f1ef015e760 legacy=0x7f1ef006ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.561+0000 7f1eefe00640 1 -- 172.21.15.73:0/2146793227 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef00b4af0 con 0x7f1ef0070130 2024-04-15T15:31:59.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.561+0000 7f1eefe00640 1 --2- 172.21.15.73:0/2146793227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 0x7f1ef006e740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00b5f80 tx=0x7f1ee801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1669cde69ef3542 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:59.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.561+0000 7f1eee000640 1 -- 172.21.15.73:0/2146793227 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80b2070 con 0x7f1ef0070130 2024-04-15T15:31:59.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.561+0000 7f1eee000640 1 -- 172.21.15.73:0/2146793227 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee80a5930 con 0x7f1ef0070130 2024-04-15T15:31:59.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.561+0000 7f1eee000640 1 -- 172.21.15.73:0/2146793227 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80a5d00 con 0x7f1ef0070130 2024-04-15T15:31:59.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 -- 172.21.15.73:0/2146793227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 msgr2=0x7f1ef006e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 --2- 172.21.15.73:0/2146793227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 0x7f1ef006e740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00b5f80 tx=0x7f1ee801c870 comp rx=0 tx=0).stop 2024-04-15T15:31:59.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 -- 172.21.15.73:0/2146793227 shutdown_connections 2024-04-15T15:31:59.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 --2- 172.21.15.73:0/2146793227 >> v2:172.21.15.118:3300/0 conn(0x7f1ef006d170 0x7f1ef0073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 --2- 172.21.15.73:0/2146793227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 0x7f1ef006e740 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 -- 172.21.15.73:0/2146793227 >> 172.21.15.73:0/2146793227 conn(0x7f1ef0072590 msgr2=0x7f1ef0072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:59.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 -- 172.21.15.73:0/2146793227 shutdown_connections 2024-04-15T15:31:59.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 -- 172.21.15.73:0/2146793227 wait complete. 2024-04-15T15:31:59.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 Processor -- start 2024-04-15T15:31:59.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 -- start start 2024-04-15T15:31:59.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ef006d170 0x7f1ef014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 0x7f1ef00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ef015e760 0x7f1ef014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef006f490 con 0x7f1ef0070130 2024-04-15T15:31:59.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef015ed50 con 0x7f1ef015e760 2024-04-15T15:31:59.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1ef6000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef006f610 con 0x7f1ef006d170 2024-04-15T15:31:59.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eeea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 0x7f1ef00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eeea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 0x7f1ef00cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58834/0 (socket says 172.21.15.73:58834) 2024-04-15T15:31:59.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eeea00640 1 -- 172.21.15.73:0/3140135333 learned_addr learned my addr 172.21.15.73:0/3140135333 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eef400640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ef006d170 0x7f1ef014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eefe00640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ef015e760 0x7f1ef014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eeea00640 1 -- 172.21.15.73:0/3140135333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ef006d170 msgr2=0x7f1ef014ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eeea00640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ef006d170 0x7f1ef014ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eeea00640 1 -- 172.21.15.73:0/3140135333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ef015e760 msgr2=0x7f1ef014f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eeea00640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ef015e760 0x7f1ef014f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eeea00640 1 -- 172.21.15.73:0/3140135333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef00aec20 con 0x7f1ef0070130 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eef400640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ef006d170 0x7f1ef014ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.565+0000 7f1eeea00640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 0x7f1ef00cfc10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000d800 tx=0x7f1ee000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1ee7400640 1 -- 172.21.15.73:0/3140135333 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee000b6c0 con 0x7f1ef0070130 2024-04-15T15:31:59.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1ee7400640 1 -- 172.21.15.73:0/3140135333 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee0019070 con 0x7f1ef0070130 2024-04-15T15:31:59.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1ee7400640 1 -- 172.21.15.73:0/3140135333 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee000ba60 con 0x7f1ef0070130 2024-04-15T15:31:59.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1ef6000640 1 -- 172.21.15.73:0/3140135333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef00aef00 con 0x7f1ef0070130 2024-04-15T15:31:59.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1ef6000640 1 -- 172.21.15.73:0/3140135333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef00cd620 con 0x7f1ef0070130 2024-04-15T15:31:59.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1ef6000640 1 -- 172.21.15.73:0/3140135333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef0068ab0 con 0x7f1ef0070130 2024-04-15T15:31:59.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1ee7400640 1 -- 172.21.15.73:0/3140135333 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ee000bc00 con 0x7f1ef0070130 2024-04-15T15:31:59.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1ee7400640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ecc068380 0x7f1ecc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1ee7400640 1 -- 172.21.15.73:0/3140135333 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1ee0087140 con 0x7f1ef0070130 2024-04-15T15:31:59.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1eef400640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ecc068380 0x7f1ecc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.569+0000 7f1eef400640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ecc068380 0x7f1ecc06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8000f70 tx=0x7f1ed8007cb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:59.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.573+0000 7f1ee7400640 1 -- 172.21.15.73:0/3140135333 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ee00573b0 con 0x7f1ef0070130 2024-04-15T15:31:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.729+0000 7f1ef6000640 1 -- 172.21.15.73:0/3140135333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ef0073260 con 0x7f1ef0070130 2024-04-15T15:31:59.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ee7400640 1 -- 172.21.15.73:0/3140135333 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f1ee0056cb0 con 0x7f1ef0070130 2024-04-15T15:31:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:31:59.733 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:31:59.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 -- 172.21.15.73:0/3140135333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ecc068380 msgr2=0x7f1ecc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ecc068380 0x7f1ecc06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8000f70 tx=0x7f1ed8007cb0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 -- 172.21.15.73:0/3140135333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 msgr2=0x7f1ef00cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 0x7f1ef00cfc10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000d800 tx=0x7f1ee000dcc0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 -- 172.21.15.73:0/3140135333 shutdown_connections 2024-04-15T15:31:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ef015e760 0x7f1ef014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ef0070130 0x7f1ef00cfc10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ecc068380 0x7f1ecc06a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 --2- 172.21.15.73:0/3140135333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ef006d170 0x7f1ef014ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 -- 172.21.15.73:0/3140135333 >> 172.21.15.73:0/3140135333 conn(0x7f1ef0072590 msgr2=0x7f1ef015d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 -- 172.21.15.73:0/3140135333 shutdown_connections 2024-04-15T15:31:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.733+0000 7f1ef6000640 1 -- 172.21.15.73:0/3140135333 wait complete. 2024-04-15T15:31:59.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:31:59.755 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:31:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf89000640 1 Processor -- start 2024-04-15T15:31:59.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf89000640 1 -- start start 2024-04-15T15:31:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf89000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdf840b2530 0x7fdf8415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf89000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf840cd3a0 con 0x7fdf840b20b0 2024-04-15T15:31:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf89000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf840b5160 con 0x7fdf84146110 2024-04-15T15:31:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf89000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fdf840b40c0 con 0x7fdf840b2530 2024-04-15T15:31:59.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf82800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdf840b2530 0x7fdf8415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf81400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdf840b20b0 0x7fdf8415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53148/0 (socket says 172.21.15.73:53148) 2024-04-15T15:31:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf81400640 1 -- 172.21.15.73:0/3300451001 learned_addr learned my addr 172.21.15.73:0/3300451001 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:31:59.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf82800640 1 -- 172.21.15.73:0/3300451001 >> v1:172.21.15.118:6789/0 conn(0x7fdf84146110 legacy=0x7fdf840cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:31:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf82800640 1 -- 172.21.15.73:0/3300451001 >> v1:172.21.15.73:6789/0 conn(0x7fdf840b20b0 legacy=0x7fdf8415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf82800640 1 -- 172.21.15.73:0/3300451001 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf840b43a0 con 0x7fdf840b2530 2024-04-15T15:31:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.893+0000 7fdf80a00640 1 -- 172.21.15.73:0/3300451001 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482364803 0 0) 0x7fdf840cd3a0 con 0x7fdf840b20b0 2024-04-15T15:31:59.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf82800640 1 --2- 172.21.15.73:0/3300451001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b2530 0x7fdf8415d2e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf840cf010 tx=0x7fdf7c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114e2e8a826aa6f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:59.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf80a00640 1 -- 172.21.15.73:0/3300451001 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0b2070 con 0x7fdf840b2530 2024-04-15T15:31:59.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf80a00640 1 -- 172.21.15.73:0/3300451001 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0a5980 con 0x7fdf840b2530 2024-04-15T15:31:59.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf80a00640 1 -- 172.21.15.73:0/3300451001 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0a5d50 con 0x7fdf840b2530 2024-04-15T15:31:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf89000640 1 -- 172.21.15.73:0/3300451001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b2530 msgr2=0x7fdf8415d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf89000640 1 --2- 172.21.15.73:0/3300451001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b2530 0x7fdf8415d2e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf840cf010 tx=0x7fdf7c01c8c0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf89000640 1 -- 172.21.15.73:0/3300451001 shutdown_connections 2024-04-15T15:31:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf89000640 1 --2- 172.21.15.73:0/3300451001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b2530 0x7fdf8415d2e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf89000640 1 -- 172.21.15.73:0/3300451001 >> 172.21.15.73:0/3300451001 conn(0x7fdf84067dd0 msgr2=0x7fdf840d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:31:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf89000640 1 -- 172.21.15.73:0/3300451001 shutdown_connections 2024-04-15T15:31:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf89000640 1 -- 172.21.15.73:0/3300451001 wait complete. 2024-04-15T15:31:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf89000640 1 Processor -- start 2024-04-15T15:31:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.897+0000 7fdf89000640 1 -- start start 2024-04-15T15:31:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf89000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b20b0 0x7fdf841401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf89000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf840b2530 0x7fdf8415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf89000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf84146110 0x7fdf8415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf89000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdf840b3d70 con 0x7fdf840b20b0 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf89000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdf840b2980 con 0x7fdf840b2530 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf89000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8415dc30 con 0x7fdf84146110 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf81e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b20b0 0x7fdf841401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf81e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b20b0 0x7fdf841401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58852/0 (socket says 172.21.15.73:58852) 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf81e00640 1 -- 172.21.15.73:0/1525331180 learned_addr learned my addr 172.21.15.73:0/1525331180 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf81400640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf840b2530 0x7fdf8415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf82800640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf84146110 0x7fdf8415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf81e00640 1 -- 172.21.15.73:0/1525331180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf84146110 msgr2=0x7fdf8415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf81e00640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf84146110 0x7fdf8415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf81e00640 1 -- 172.21.15.73:0/1525331180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf840b2530 msgr2=0x7fdf8415ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:31:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf81e00640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf840b2530 0x7fdf8415ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:31:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf81e00640 1 -- 172.21.15.73:0/1525331180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf841438f0 con 0x7fdf840b20b0 2024-04-15T15:31:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf81e00640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b20b0 0x7fdf841401b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400b410 tx=0x7fdf7400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf7a000640 1 -- 172.21.15.73:0/1525331180 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf74015030 con 0x7fdf840b20b0 2024-04-15T15:31:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf7a000640 1 -- 172.21.15.73:0/1525331180 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf74004020 con 0x7fdf840b20b0 2024-04-15T15:31:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf7a000640 1 -- 172.21.15.73:0/1525331180 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf74004450 con 0x7fdf840b20b0 2024-04-15T15:31:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf89000640 1 -- 172.21.15.73:0/1525331180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf840b17e0 con 0x7fdf840b20b0 2024-04-15T15:31:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf89000640 1 -- 172.21.15.73:0/1525331180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf840b1da0 con 0x7fdf840b20b0 2024-04-15T15:31:59.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf89000640 1 -- 172.21.15.73:0/1525331180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf84068ab0 con 0x7fdf840b20b0 2024-04-15T15:31:59.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.901+0000 7fdf7a000640 1 -- 172.21.15.73:0/1525331180 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdf74018070 con 0x7fdf840b20b0 2024-04-15T15:31:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.905+0000 7fdf7a000640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdf640683b0 0x7fdf6406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:31:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.905+0000 7fdf7a000640 1 -- 172.21.15.73:0/1525331180 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdf740868c0 con 0x7fdf840b20b0 2024-04-15T15:31:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.905+0000 7fdf81400640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdf640683b0 0x7fdf6406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:31:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.905+0000 7fdf81400640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdf640683b0 0x7fdf6406a870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf840b2080 tx=0x7fdf70007b60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:31:59.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:31:59.909+0000 7fdf7a000640 1 -- 172.21.15.73:0/1525331180 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdf74056aa0 con 0x7fdf840b20b0 2024-04-15T15:32:00.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.069+0000 7fdf89000640 1 -- 172.21.15.73:0/1525331180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf84072840 con 0x7fdf840b20b0 2024-04-15T15:32:00.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.069+0000 7fdf7a000640 1 -- 172.21.15.73:0/1525331180 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fdf740563a0 con 0x7fdf840b20b0 2024-04-15T15:32:00.072 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:00.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 -- 172.21.15.73:0/1525331180 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdf640683b0 msgr2=0x7fdf6406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdf640683b0 0x7fdf6406a870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf840b2080 tx=0x7fdf70007b60 comp rx=0 tx=0).stop 2024-04-15T15:32:00.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 -- 172.21.15.73:0/1525331180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b20b0 msgr2=0x7fdf841401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b20b0 0x7fdf841401b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400b410 tx=0x7fdf7400b8d0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 -- 172.21.15.73:0/1525331180 shutdown_connections 2024-04-15T15:32:00.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdf640683b0 0x7fdf6406a870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf84146110 0x7fdf8415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf840b2530 0x7fdf8415ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 --2- 172.21.15.73:0/1525331180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf840b20b0 0x7fdf841401b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 -- 172.21.15.73:0/1525331180 >> 172.21.15.73:0/1525331180 conn(0x7fdf84067dd0 msgr2=0x7fdf84143f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:00.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 -- 172.21.15.73:0/1525331180 shutdown_connections 2024-04-15T15:32:00.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.073+0000 7fdf89000640 1 -- 172.21.15.73:0/1525331180 wait complete. 2024-04-15T15:32:00.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f3285400640 1 Processor -- start 2024-04-15T15:32:00.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f3285400640 1 -- start start 2024-04-15T15:32:00.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f3285400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 0x7f32800d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f3285400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f32800b23e0 0x7f32800b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f3285400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32800cd1c0 con 0x7f32800b18a0 2024-04-15T15:32:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f3285400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f32800b1410 con 0x7f32800b23e0 2024-04-15T15:32:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f3285400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f32800d0c50 con 0x7f32800ccde0 2024-04-15T15:32:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327e800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 0x7f32800d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327f200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f32800b23e0 0x7f32800b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327de00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f32800b18a0 0x7f3280162f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:55790/0 (socket says 172.21.15.73:55790) 2024-04-15T15:32:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327de00640 1 -- 172.21.15.73:0/3079120795 learned_addr learned my addr 172.21.15.73:0/3079120795 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327d400640 1 -- 172.21.15.73:0/3079120795 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2369804074 0 0) 0x7f32800cd1c0 con 0x7f32800b18a0 2024-04-15T15:32:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327d400640 1 -- 172.21.15.73:0/3079120795 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3264003530 con 0x7f32800b18a0 2024-04-15T15:32:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327e800640 1 -- 172.21.15.73:0/3079120795 >> v2:172.21.15.118:3300/0 conn(0x7f32800b23e0 msgr2=0x7f32800b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327e800640 1 --2- 172.21.15.73:0/3079120795 >> v2:172.21.15.118:3300/0 conn(0x7f32800b23e0 0x7f32800b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327e800640 1 -- 172.21.15.73:0/3079120795 >> v1:172.21.15.118:6789/0 conn(0x7f32800b18a0 legacy=0x7f3280162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327e800640 1 -- 172.21.15.73:0/3079120795 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32800d0ea0 con 0x7f32800ccde0 2024-04-15T15:32:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.233+0000 7f327f200640 1 --2- 172.21.15.73:0/3079120795 >> v2:172.21.15.118:3300/0 conn(0x7f32800b23e0 0x7f32800b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f327e800640 1 --2- 172.21.15.73:0/3079120795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 0x7f32800d0710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32700097c0 tx=0x7f327001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31f5e0a44307d399 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f327d400640 1 -- 172.21.15.73:0/3079120795 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700b0070 con 0x7f32800ccde0 2024-04-15T15:32:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f327d400640 1 -- 172.21.15.73:0/3079120795 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700ab600 con 0x7f32800ccde0 2024-04-15T15:32:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f327d400640 1 -- 172.21.15.73:0/3079120795 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700ab9b0 con 0x7f32800ccde0 2024-04-15T15:32:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f3285400640 1 -- 172.21.15.73:0/3079120795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 msgr2=0x7f32800d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f3285400640 1 --2- 172.21.15.73:0/3079120795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 0x7f32800d0710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32700097c0 tx=0x7f327001c4a0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f3285400640 1 -- 172.21.15.73:0/3079120795 shutdown_connections 2024-04-15T15:32:00.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f3285400640 1 --2- 172.21.15.73:0/3079120795 >> v2:172.21.15.118:3300/0 conn(0x7f32800b23e0 0x7f32800b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f3285400640 1 --2- 172.21.15.73:0/3079120795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 0x7f32800d0710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f3285400640 1 -- 172.21.15.73:0/3079120795 >> 172.21.15.73:0/3079120795 conn(0x7f328009aa60 msgr2=0x7f32800d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:00.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f3285400640 1 -- 172.21.15.73:0/3079120795 shutdown_connections 2024-04-15T15:32:00.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.237+0000 7f3285400640 1 -- 172.21.15.73:0/3079120795 wait complete. 2024-04-15T15:32:00.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 Processor -- start 2024-04-15T15:32:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 -- start start 2024-04-15T15:32:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32800b18a0 0x7f3280148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32800b23e0 0x7f32800c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 0x7f32800c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f32800cc510 con 0x7f32800b23e0 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f32800cc390 con 0x7f32800b18a0 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f32800cc690 con 0x7f32800ccde0 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32800b23e0 0x7f32800c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32800b18a0 0x7f3280148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32800b23e0 0x7f32800c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58854/0 (socket says 172.21.15.73:58854) 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327de00640 1 -- 172.21.15.73:0/3876051972 learned_addr learned my addr 172.21.15.73:0/3876051972 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327f200640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 0x7f32800c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327e800640 1 -- 172.21.15.73:0/3876051972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 msgr2=0x7f32800c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327e800640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 0x7f32800c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327e800640 1 -- 172.21.15.73:0/3876051972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32800b23e0 msgr2=0x7f32800c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327e800640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32800b23e0 0x7f32800c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327e800640 1 -- 172.21.15.73:0/3876051972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32800b46b0 con 0x7f32800b18a0 2024-04-15T15:32:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327de00640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32800b23e0 0x7f32800c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f327e800640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32800b18a0 0x7f3280148800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f32700ab000 tx=0x7f3270019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3276a00640 1 -- 172.21.15.73:0/3876051972 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700b0040 con 0x7f32800b18a0 2024-04-15T15:32:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3276a00640 1 -- 172.21.15.73:0/3876051972 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700ab7b0 con 0x7f32800b18a0 2024-04-15T15:32:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3276a00640 1 -- 172.21.15.73:0/3876051972 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700abb80 con 0x7f32800b18a0 2024-04-15T15:32:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 -- 172.21.15.73:0/3876051972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32800caea0 con 0x7f32800b18a0 2024-04-15T15:32:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 -- 172.21.15.73:0/3876051972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32800c8b00 con 0x7f32800b18a0 2024-04-15T15:32:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.241+0000 7f3285400640 1 -- 172.21.15.73:0/3876051972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32800cb3c0 con 0x7f32800b18a0 2024-04-15T15:32:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.245+0000 7f3276a00640 1 -- 172.21.15.73:0/3876051972 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f32700bd020 con 0x7f32800b18a0 2024-04-15T15:32:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.245+0000 7f3276a00640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32600683b0 0x7f326006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.245+0000 7f3276a00640 1 -- 172.21.15.73:0/3876051972 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3270120350 con 0x7f32800b18a0 2024-04-15T15:32:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.245+0000 7f327de00640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32600683b0 0x7f326006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.245+0000 7f327de00640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32600683b0 0x7f326006a870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f328015be20 tx=0x7f326c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.249+0000 7f3276a00640 1 -- 172.21.15.73:0/3876051972 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f32800cb3c0 con 0x7f32800b18a0 2024-04-15T15:32:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.409+0000 7f3285400640 1 -- 172.21.15.73:0/3876051972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3280068ab0 con 0x7f32800b18a0 2024-04-15T15:32:00.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.409+0000 7f3276a00640 1 -- 172.21.15.73:0/3876051972 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f32700c4020 con 0x7f32800b18a0 2024-04-15T15:32:00.413 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 -- 172.21.15.73:0/3876051972 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32600683b0 msgr2=0x7f326006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32600683b0 0x7f326006a870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f328015be20 tx=0x7f326c009040 comp rx=0 tx=0).stop 2024-04-15T15:32:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 -- 172.21.15.73:0/3876051972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32800b18a0 msgr2=0x7f3280148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32800b18a0 0x7f3280148800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f32700ab000 tx=0x7f3270019240 comp rx=0 tx=0).stop 2024-04-15T15:32:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 -- 172.21.15.73:0/3876051972 shutdown_connections 2024-04-15T15:32:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f32600683b0 0x7f326006a870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32800ccde0 0x7f32800c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32800b23e0 0x7f32800c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 --2- 172.21.15.73:0/3876051972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32800b18a0 0x7f3280148800 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 -- 172.21.15.73:0/3876051972 >> 172.21.15.73:0/3876051972 conn(0x7f328009aa60 msgr2=0x7f328006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 -- 172.21.15.73:0/3876051972 shutdown_connections 2024-04-15T15:32:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.413+0000 7f3285400640 1 -- 172.21.15.73:0/3876051972 wait complete. 2024-04-15T15:32:00.434 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce75c00640 1 Processor -- start 2024-04-15T15:32:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce75c00640 1 -- start start 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce75c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce700d08b0 0x7fce7009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce75c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce7009afa0 0x7fce7015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce75c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce700d1000 con 0x7fce700b17a0 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce75c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fce700d12e0 con 0x7fce7009afa0 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce75c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fce700d15c0 con 0x7fce700d08b0 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce6f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce7009afa0 0x7fce7015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce6f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce7009afa0 0x7fce7015e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58864/0 (socket says 172.21.15.73:58864) 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce6f400640 1 -- 172.21.15.73:0/3138595506 learned_addr learned my addr 172.21.15.73:0/3138595506 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.573+0000 7fce67e00640 1 --2- 172.21.15.73:0/3138595506 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce700d08b0 0x7fce7009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce6f400640 1 -- 172.21.15.73:0/3138595506 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce700d08b0 msgr2=0x7fce7009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce6f400640 1 --2- 172.21.15.73:0/3138595506 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce700d08b0 0x7fce7009aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce6f400640 1 -- 172.21.15.73:0/3138595506 >> v1:172.21.15.118:6789/0 conn(0x7fce700b17a0 legacy=0x7fce7006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce6f400640 1 -- 172.21.15.73:0/3138595506 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce700d18a0 con 0x7fce7009afa0 2024-04-15T15:32:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce6f400640 1 --2- 172.21.15.73:0/3138595506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce7009afa0 0x7fce7015e160 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fce68009e50 tx=0x7fce6801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76328061824cc22b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce6e000640 1 -- 172.21.15.73:0/3138595506 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce680a5750 con 0x7fce7009afa0 2024-04-15T15:32:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce6e000640 1 -- 172.21.15.73:0/3138595506 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce680a58f0 con 0x7fce7009afa0 2024-04-15T15:32:00.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce6e000640 1 -- 172.21.15.73:0/3138595506 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce680a5cc0 con 0x7fce7009afa0 2024-04-15T15:32:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce75c00640 1 -- 172.21.15.73:0/3138595506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce7009afa0 msgr2=0x7fce7015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce75c00640 1 --2- 172.21.15.73:0/3138595506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce7009afa0 0x7fce7015e160 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fce68009e50 tx=0x7fce6801ca30 comp rx=0 tx=0).stop 2024-04-15T15:32:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce75c00640 1 -- 172.21.15.73:0/3138595506 shutdown_connections 2024-04-15T15:32:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce75c00640 1 --2- 172.21.15.73:0/3138595506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce7009afa0 0x7fce7015e160 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce75c00640 1 --2- 172.21.15.73:0/3138595506 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce700d08b0 0x7fce7009aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce75c00640 1 -- 172.21.15.73:0/3138595506 >> 172.21.15.73:0/3138595506 conn(0x7fce700b3fe0 msgr2=0x7fce700b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce75c00640 1 -- 172.21.15.73:0/3138595506 shutdown_connections 2024-04-15T15:32:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.577+0000 7fce75c00640 1 -- 172.21.15.73:0/3138595506 wait complete. 2024-04-15T15:32:00.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce75c00640 1 Processor -- start 2024-04-15T15:32:00.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce75c00640 1 -- start start 2024-04-15T15:32:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce75c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce7009afa0 0x7fce700c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce75c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce700b17a0 0x7fce70161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce75c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce700d08b0 0x7fce70070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce75c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fce7006fed0 con 0x7fce700d08b0 2024-04-15T15:32:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce75c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce700b1d90 con 0x7fce700b17a0 2024-04-15T15:32:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce75c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fce70070050 con 0x7fce7009afa0 2024-04-15T15:32:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce6f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce700d08b0 0x7fce70070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce67e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce700b17a0 0x7fce70161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce6ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce7009afa0 0x7fce700c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce6f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce700d08b0 0x7fce70070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58870/0 (socket says 172.21.15.73:58870) 2024-04-15T15:32:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce6f400640 1 -- 172.21.15.73:0/2350121976 learned_addr learned my addr 172.21.15.73:0/2350121976 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce6f400640 1 -- 172.21.15.73:0/2350121976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce7009afa0 msgr2=0x7fce700c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce6f400640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce7009afa0 0x7fce700c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce6f400640 1 -- 172.21.15.73:0/2350121976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce700b17a0 msgr2=0x7fce70161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce6f400640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce700b17a0 0x7fce70161250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce6f400640 1 -- 172.21.15.73:0/2350121976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce70071ab0 con 0x7fce700d08b0 2024-04-15T15:32:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce6f400640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce700d08b0 0x7fce70070ff0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fce680af040 tx=0x7fce680197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce66a00640 1 -- 172.21.15.73:0/2350121976 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68009510 con 0x7fce700d08b0 2024-04-15T15:32:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce66a00640 1 -- 172.21.15.73:0/2350121976 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce680be070 con 0x7fce700d08b0 2024-04-15T15:32:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce66a00640 1 -- 172.21.15.73:0/2350121976 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce680b88b0 con 0x7fce700d08b0 2024-04-15T15:32:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.581+0000 7fce75c00640 1 -- 172.21.15.73:0/2350121976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce700c6ff0 con 0x7fce700d08b0 2024-04-15T15:32:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.585+0000 7fce75c00640 1 -- 172.21.15.73:0/2350121976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce700c75b0 con 0x7fce700d08b0 2024-04-15T15:32:00.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.585+0000 7fce75c00640 1 -- 172.21.15.73:0/2350121976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce70068ab0 con 0x7fce700d08b0 2024-04-15T15:32:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.585+0000 7fce66a00640 1 -- 172.21.15.73:0/2350121976 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce680b8a50 con 0x7fce700d08b0 2024-04-15T15:32:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.589+0000 7fce66a00640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fce4c068380 0x7fce4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.589+0000 7fce66a00640 1 -- 172.21.15.73:0/2350121976 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fce681226b0 con 0x7fce700d08b0 2024-04-15T15:32:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.589+0000 7fce6ea00640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fce4c068380 0x7fce4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.589+0000 7fce6ea00640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fce4c068380 0x7fce4c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fce600017e0 tx=0x7fce60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.589+0000 7fce66a00640 1 -- 172.21.15.73:0/2350121976 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce68016620 con 0x7fce700d08b0 2024-04-15T15:32:00.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.749+0000 7fce75c00640 1 -- 172.21.15.73:0/2350121976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fce700d22b0 con 0x7fce700d08b0 2024-04-15T15:32:00.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.749+0000 7fce66a00640 1 -- 172.21.15.73:0/2350121976 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fce680f24e0 con 0x7fce700d08b0 2024-04-15T15:32:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:00.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.749+0000 7fce75c00640 1 -- 172.21.15.73:0/2350121976 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fce4c068380 msgr2=0x7fce4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.749+0000 7fce75c00640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fce4c068380 0x7fce4c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fce600017e0 tx=0x7fce60009040 comp rx=0 tx=0).stop 2024-04-15T15:32:00.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.749+0000 7fce75c00640 1 -- 172.21.15.73:0/2350121976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce700d08b0 msgr2=0x7fce70070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.749+0000 7fce75c00640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce700d08b0 0x7fce70070ff0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fce680af040 tx=0x7fce680197d0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.753+0000 7fce75c00640 1 -- 172.21.15.73:0/2350121976 shutdown_connections 2024-04-15T15:32:00.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.753+0000 7fce75c00640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce700d08b0 0x7fce70070ff0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.753+0000 7fce75c00640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce700b17a0 0x7fce70161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.753+0000 7fce75c00640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fce4c068380 0x7fce4c06a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.753+0000 7fce75c00640 1 --2- 172.21.15.73:0/2350121976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce7009afa0 0x7fce700c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.753+0000 7fce75c00640 1 -- 172.21.15.73:0/2350121976 >> 172.21.15.73:0/2350121976 conn(0x7fce700b3fe0 msgr2=0x7fce70159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:00.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.753+0000 7fce75c00640 1 -- 172.21.15.73:0/2350121976 shutdown_connections 2024-04-15T15:32:00.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.753+0000 7fce75c00640 1 -- 172.21.15.73:0/2350121976 wait complete. 2024-04-15T15:32:00.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:00.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0728e00640 1 Processor -- start 2024-04-15T15:32:00.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0728e00640 1 -- start start 2024-04-15T15:32:00.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0728e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0724146110 0x7f07240cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0728e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f07240b20b0 0x7f07240b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0728e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0724071e10 0x7f07240722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0728e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f07240cd3a0 con 0x7f0724146110 2024-04-15T15:32:00.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0728e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f07240b5160 con 0x7f07240b20b0 2024-04-15T15:32:00.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0728e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f07240b40c0 con 0x7f0724071e10 2024-04-15T15:32:00.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0721e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0724146110 0x7f07240cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0721e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0724146110 0x7f07240cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58880/0 (socket says 172.21.15.73:58880) 2024-04-15T15:32:00.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0721e00640 1 -- 172.21.15.73:0/3549659970 learned_addr learned my addr 172.21.15.73:0/3549659970 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0722800640 1 --2- 172.21.15.73:0/3549659970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0724071e10 0x7f07240722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0721400640 1 --2- 172.21.15.73:0/3549659970 >> v2:172.21.15.118:3300/0 conn(0x7f07240b20b0 0x7f07240b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0721e00640 1 -- 172.21.15.73:0/3549659970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0724071e10 msgr2=0x7f07240722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0721e00640 1 --2- 172.21.15.73:0/3549659970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0724071e10 0x7f07240722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0721e00640 1 -- 172.21.15.73:0/3549659970 >> v2:172.21.15.118:3300/0 conn(0x7f07240b20b0 msgr2=0x7f07240b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0721e00640 1 --2- 172.21.15.73:0/3549659970 >> v2:172.21.15.118:3300/0 conn(0x7f07240b20b0 0x7f07240b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0721e00640 1 -- 172.21.15.73:0/3549659970 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07240b43a0 con 0x7f0724146110 2024-04-15T15:32:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0722800640 1 --2- 172.21.15.73:0/3549659970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0724071e10 0x7f07240722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:00.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.909+0000 7f0721400640 1 --2- 172.21.15.73:0/3549659970 >> v2:172.21.15.118:3300/0 conn(0x7f07240b20b0 0x7f07240b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:00.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0721e00640 1 --2- 172.21.15.73:0/3549659970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 0x7f07240cd7b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f07240701c0 tx=0x7f071401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62907b0aecbb9de1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:00.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0720a00640 1 -- 172.21.15.73:0/3549659970 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140b1070 con 0x7f0724146110 2024-04-15T15:32:00.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0720a00640 1 -- 172.21.15.73:0/3549659970 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07140ac630 con 0x7f0724146110 2024-04-15T15:32:00.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0720a00640 1 -- 172.21.15.73:0/3549659970 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140a8050 con 0x7f0724146110 2024-04-15T15:32:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0728e00640 1 -- 172.21.15.73:0/3549659970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 msgr2=0x7f07240cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0728e00640 1 --2- 172.21.15.73:0/3549659970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 0x7f07240cd7b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f07240701c0 tx=0x7f071401c520 comp rx=0 tx=0).stop 2024-04-15T15:32:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0728e00640 1 -- 172.21.15.73:0/3549659970 shutdown_connections 2024-04-15T15:32:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0728e00640 1 --2- 172.21.15.73:0/3549659970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0724071e10 0x7f07240722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0728e00640 1 --2- 172.21.15.73:0/3549659970 >> v2:172.21.15.118:3300/0 conn(0x7f07240b20b0 0x7f07240b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0728e00640 1 --2- 172.21.15.73:0/3549659970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 0x7f07240cd7b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0728e00640 1 -- 172.21.15.73:0/3549659970 >> 172.21.15.73:0/3549659970 conn(0x7f0724067dd0 msgr2=0x7f07240d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0728e00640 1 -- 172.21.15.73:0/3549659970 shutdown_connections 2024-04-15T15:32:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.913+0000 7f0728e00640 1 -- 172.21.15.73:0/3549659970 wait complete. 2024-04-15T15:32:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 Processor -- start 2024-04-15T15:32:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 -- start start 2024-04-15T15:32:00.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0724071e10 0x7f0724159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07240b20b0 0x7f0724136fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 0x7f07241387c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07240b3d70 con 0x7f0724146110 2024-04-15T15:32:00.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f07240b4c40 con 0x7f0724071e10 2024-04-15T15:32:00.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f07240cdcf0 con 0x7f07240b20b0 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0722800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 0x7f07241387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0722800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 0x7f07241387c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58888/0 (socket says 172.21.15.73:58888) 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0722800640 1 -- 172.21.15.73:0/1725398614 learned_addr learned my addr 172.21.15.73:0/1725398614 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0722800640 1 -- 172.21.15.73:0/1725398614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07240b20b0 msgr2=0x7f0724136fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0722800640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07240b20b0 0x7f0724136fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0722800640 1 -- 172.21.15.73:0/1725398614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0724071e10 msgr2=0x7f0724159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0722800640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0724071e10 0x7f0724159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0722800640 1 -- 172.21.15.73:0/1725398614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07241378d0 con 0x7f0724146110 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0722800640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 0x7f07241387c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f071c00cd50 tx=0x7f071c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f071a000640 1 -- 172.21.15.73:0/1725398614 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c00f680 con 0x7f0724146110 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f071a000640 1 -- 172.21.15.73:0/1725398614 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071c00f840 con 0x7f0724146110 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 -- 172.21.15.73:0/1725398614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0724137bb0 con 0x7f0724146110 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f071a000640 1 -- 172.21.15.73:0/1725398614 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c00fc30 con 0x7f0724146110 2024-04-15T15:32:00.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 -- 172.21.15.73:0/1725398614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0724138170 con 0x7f0724146110 2024-04-15T15:32:00.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.917+0000 7f0728e00640 1 -- 172.21.15.73:0/1725398614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0724068ab0 con 0x7f0724146110 2024-04-15T15:32:00.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.921+0000 7f071a000640 1 -- 172.21.15.73:0/1725398614 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f071c0213f0 con 0x7f0724146110 2024-04-15T15:32:00.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.921+0000 7f071a000640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0704068380 0x7f070406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:00.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.921+0000 7f071a000640 1 -- 172.21.15.73:0/1725398614 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f071c087a70 con 0x7f0724146110 2024-04-15T15:32:00.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.921+0000 7f0721e00640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0704068380 0x7f070406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:00.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.921+0000 7f0721e00640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0704068380 0x7f070406a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07140ae000 tx=0x7f0714004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:00.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:00.925+0000 7f071a000640 1 -- 172.21.15.73:0/1725398614 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f071c014030 con 0x7f0724146110 2024-04-15T15:32:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.081+0000 7f0728e00640 1 -- 172.21.15.73:0/1725398614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f07240cd7c0 con 0x7f0724146110 2024-04-15T15:32:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.081+0000 7f071a000640 1 -- 172.21.15.73:0/1725398614 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f071c057d80 con 0x7f0724146110 2024-04-15T15:32:01.085 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 -- 172.21.15.73:0/1725398614 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0704068380 msgr2=0x7f070406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0704068380 0x7f070406a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07140ae000 tx=0x7f0714004740 comp rx=0 tx=0).stop 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 -- 172.21.15.73:0/1725398614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 msgr2=0x7f07241387c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 0x7f07241387c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f071c00cd50 tx=0x7f071c00a650 comp rx=0 tx=0).stop 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 -- 172.21.15.73:0/1725398614 shutdown_connections 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0724146110 0x7f07241387c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0704068380 0x7f070406a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07240b20b0 0x7f0724136fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 --2- 172.21.15.73:0/1725398614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0724071e10 0x7f0724159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 -- 172.21.15.73:0/1725398614 >> 172.21.15.73:0/1725398614 conn(0x7f0724067dd0 msgr2=0x7f07240b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 -- 172.21.15.73:0/1725398614 shutdown_connections 2024-04-15T15:32:01.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.085+0000 7f0728e00640 1 -- 172.21.15.73:0/1725398614 wait complete. 2024-04-15T15:32:01.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:32:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.237+0000 7f9b68e00640 1 Processor -- start 2024-04-15T15:32:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.237+0000 7f9b68e00640 1 -- start start 2024-04-15T15:32:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b68e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b640b27c0 0x7f9b6415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b68e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b640b3e30 0x7f9b640b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b68e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b64070160 con 0x7f9b6415b5d0 2024-04-15T15:32:01.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b68e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9b6415b9b0 con 0x7f9b640b3e30 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b68e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f9b6415f1f0 con 0x7f9b640b27c0 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b62800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b640b3e30 0x7f9b640b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b61e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9b6415b5d0 0x7f9b640b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53150/0 (socket says 172.21.15.73:53150) 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b61e00640 1 -- 172.21.15.73:0/179610592 learned_addr learned my addr 172.21.15.73:0/179610592 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b5be00640 1 --2- 172.21.15.73:0/179610592 >> v2:172.21.15.118:3300/0 conn(0x7f9b640b27c0 0x7f9b6415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b62800640 1 -- 172.21.15.73:0/179610592 >> v2:172.21.15.118:3300/0 conn(0x7f9b640b27c0 msgr2=0x7f9b6415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b62800640 1 --2- 172.21.15.73:0/179610592 >> v2:172.21.15.118:3300/0 conn(0x7f9b640b27c0 0x7f9b6415fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b62800640 1 -- 172.21.15.73:0/179610592 >> v1:172.21.15.73:6789/0 conn(0x7f9b6415b5d0 legacy=0x7f9b640b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b62800640 1 -- 172.21.15.73:0/179610592 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6406fe80 con 0x7f9b640b3e30 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b5be00640 1 --2- 172.21.15.73:0/179610592 >> v2:172.21.15.118:3300/0 conn(0x7f9b640b27c0 0x7f9b6415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.241+0000 7f9b61400640 1 -- 172.21.15.73:0/179610592 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680475697 0 0) 0x7f9b64070160 con 0x7f9b6415b5d0 2024-04-15T15:32:01.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b62800640 1 --2- 172.21.15.73:0/179610592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b640b3e30 0x7f9b640b4740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9b640b2c50 tx=0x7f9b5c01c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44464b3e34d3c68d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:01.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b61400640 1 -- 172.21.15.73:0/179610592 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0b2070 con 0x7f9b640b3e30 2024-04-15T15:32:01.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b61400640 1 -- 172.21.15.73:0/179610592 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b5c0a56a0 con 0x7f9b640b3e30 2024-04-15T15:32:01.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b61400640 1 -- 172.21.15.73:0/179610592 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0a5a70 con 0x7f9b640b3e30 2024-04-15T15:32:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 -- 172.21.15.73:0/179610592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b640b3e30 msgr2=0x7f9b640b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 --2- 172.21.15.73:0/179610592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b640b3e30 0x7f9b640b4740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9b640b2c50 tx=0x7f9b5c01c7e0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 -- 172.21.15.73:0/179610592 shutdown_connections 2024-04-15T15:32:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 --2- 172.21.15.73:0/179610592 >> v2:172.21.15.118:3300/0 conn(0x7f9b640b27c0 0x7f9b6415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 --2- 172.21.15.73:0/179610592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b640b3e30 0x7f9b640b4740 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 -- 172.21.15.73:0/179610592 >> 172.21.15.73:0/179610592 conn(0x7f9b64067dd0 msgr2=0x7f9b640d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 -- 172.21.15.73:0/179610592 shutdown_connections 2024-04-15T15:32:01.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 -- 172.21.15.73:0/179610592 wait complete. 2024-04-15T15:32:01.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 Processor -- start 2024-04-15T15:32:01.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 -- start start 2024-04-15T15:32:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.245+0000 7f9b68e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b640b27c0 0x7f9b6415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b68e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b640b3e30 0x7f9b6414f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b68e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6415b5d0 0x7f9b64160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b68e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6406faa0 con 0x7f9b6415b5d0 2024-04-15T15:32:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b68e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9b640b4240 con 0x7f9b640b27c0 2024-04-15T15:32:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b68e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6406fc20 con 0x7f9b640b3e30 2024-04-15T15:32:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b62800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6415b5d0 0x7f9b64160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b62800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6415b5d0 0x7f9b64160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58904/0 (socket says 172.21.15.73:58904) 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b62800640 1 -- 172.21.15.73:0/387478214 learned_addr learned my addr 172.21.15.73:0/387478214 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b61e00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b640b27c0 0x7f9b6415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b5be00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b640b3e30 0x7f9b6414f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b62800640 1 -- 172.21.15.73:0/387478214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b640b3e30 msgr2=0x7f9b6414f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b62800640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b640b3e30 0x7f9b6414f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b62800640 1 -- 172.21.15.73:0/387478214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b640b27c0 msgr2=0x7f9b6415e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b62800640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b640b27c0 0x7f9b6415e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b62800640 1 -- 172.21.15.73:0/387478214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6415bc70 con 0x7f9b6415b5d0 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b5be00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b640b3e30 0x7f9b6414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b62800640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6415b5d0 0x7f9b64160150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0193f0 tx=0x7f9b5c019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b5a000640 1 -- 172.21.15.73:0/387478214 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0b2050 con 0x7f9b6415b5d0 2024-04-15T15:32:01.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b5a000640 1 -- 172.21.15.73:0/387478214 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b5c0be070 con 0x7f9b6415b5d0 2024-04-15T15:32:01.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b68e00640 1 -- 172.21.15.73:0/387478214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b6415bf50 con 0x7f9b6415b5d0 2024-04-15T15:32:01.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b5a000640 1 -- 172.21.15.73:0/387478214 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0ada90 con 0x7f9b6415b5d0 2024-04-15T15:32:01.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b68e00640 1 -- 172.21.15.73:0/387478214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b6415c510 con 0x7f9b6415b5d0 2024-04-15T15:32:01.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b68e00640 1 -- 172.21.15.73:0/387478214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b64068ab0 con 0x7f9b6415b5d0 2024-04-15T15:32:01.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.249+0000 7f9b5a000640 1 -- 172.21.15.73:0/387478214 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9b5c0adc30 con 0x7f9b6415b5d0 2024-04-15T15:32:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.253+0000 7f9b5a000640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b400683b0 0x7f9b4006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.253+0000 7f9b5a000640 1 -- 172.21.15.73:0/387478214 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9b5c121ec0 con 0x7f9b6415b5d0 2024-04-15T15:32:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.253+0000 7f9b61e00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b400683b0 0x7f9b4006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.253+0000 7f9b61e00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b400683b0 0x7f9b4006a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b54007fd0 tx=0x7f9b54007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:01.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.257+0000 7f9b5a000640 1 -- 172.21.15.73:0/387478214 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b5c016520 con 0x7f9b6415b5d0 2024-04-15T15:32:01.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.445+0000 7f9b68e00640 1 -- 172.21.15.73:0/387478214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b6415ea30 con 0x7f9b6415b5d0 2024-04-15T15:32:01.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.445+0000 7f9b5a000640 1 -- 172.21.15.73:0/387478214 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f9b5c0f2250 con 0x7f9b6415b5d0 2024-04-15T15:32:01.448 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:01.448 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:31:33.826027+0000","modified":"2024-04-15T15:31:52.268632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-15T15:32:01.449 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-04-15T15:32:01.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 -- 172.21.15.73:0/387478214 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b400683b0 msgr2=0x7f9b4006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b400683b0 0x7f9b4006a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b54007fd0 tx=0x7f9b54007d60 comp rx=0 tx=0).stop 2024-04-15T15:32:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 -- 172.21.15.73:0/387478214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6415b5d0 msgr2=0x7f9b64160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6415b5d0 0x7f9b64160150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0193f0 tx=0x7f9b5c019580 comp rx=0 tx=0).stop 2024-04-15T15:32:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 -- 172.21.15.73:0/387478214 shutdown_connections 2024-04-15T15:32:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6415b5d0 0x7f9b64160150 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b400683b0 0x7f9b4006a870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b640b3e30 0x7f9b6414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 --2- 172.21.15.73:0/387478214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b640b27c0 0x7f9b6415e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 -- 172.21.15.73:0/387478214 >> 172.21.15.73:0/387478214 conn(0x7f9b64067dd0 msgr2=0x7f9b6406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 -- 172.21.15.73:0/387478214 shutdown_connections 2024-04-15T15:32:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.449+0000 7f9b68e00640 1 -- 172.21.15.73:0/387478214 wait complete. 2024-04-15T15:32:01.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:01.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd36e600640 1 Processor -- start 2024-04-15T15:32:01.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd36e600640 1 -- start start 2024-04-15T15:32:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd36e600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3680b0940 0x7fd36806ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd36e600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd36806bf90 0x7fd368070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd36e600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd368162710 con 0x7fd368070980 2024-04-15T15:32:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd36e600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd3681634d0 con 0x7fd3680b0940 2024-04-15T15:32:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd36e600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd3680d22e0 con 0x7fd36806bf90 2024-04-15T15:32:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd367400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3680b0940 0x7fd36806ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd367e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd368070980 0x7fd36815e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53156/0 (socket says 172.21.15.73:53156) 2024-04-15T15:32:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd367e00640 1 -- 172.21.15.73:0/3694209485 learned_addr learned my addr 172.21.15.73:0/3694209485 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd35fe00640 1 --2- 172.21.15.73:0/3694209485 >> v2:172.21.15.118:3300/0 conn(0x7fd36806bf90 0x7fd368070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd367400640 1 -- 172.21.15.73:0/3694209485 >> v2:172.21.15.118:3300/0 conn(0x7fd36806bf90 msgr2=0x7fd368070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd367400640 1 --2- 172.21.15.73:0/3694209485 >> v2:172.21.15.118:3300/0 conn(0x7fd36806bf90 0x7fd368070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd367400640 1 -- 172.21.15.73:0/3694209485 >> v1:172.21.15.73:6789/0 conn(0x7fd368070980 legacy=0x7fd36815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.605+0000 7fd367400640 1 -- 172.21.15.73:0/3694209485 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3681629f0 con 0x7fd3680b0940 2024-04-15T15:32:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd367400640 1 --2- 172.21.15.73:0/3694209485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3680b0940 0x7fd36806ba50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd368071830 tx=0x7fd35801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb569d9979be790 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd366a00640 1 -- 172.21.15.73:0/3694209485 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580b0070 con 0x7fd3680b0940 2024-04-15T15:32:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd366a00640 1 -- 172.21.15.73:0/3694209485 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3580a4e50 con 0x7fd3680b0940 2024-04-15T15:32:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd366a00640 1 -- 172.21.15.73:0/3694209485 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580ab820 con 0x7fd3680b0940 2024-04-15T15:32:01.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd36e600640 1 -- 172.21.15.73:0/3694209485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3680b0940 msgr2=0x7fd36806ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd36e600640 1 --2- 172.21.15.73:0/3694209485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3680b0940 0x7fd36806ba50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd368071830 tx=0x7fd35801c3c0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd36e600640 1 -- 172.21.15.73:0/3694209485 shutdown_connections 2024-04-15T15:32:01.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd36e600640 1 --2- 172.21.15.73:0/3694209485 >> v2:172.21.15.118:3300/0 conn(0x7fd36806bf90 0x7fd368070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd36e600640 1 --2- 172.21.15.73:0/3694209485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3680b0940 0x7fd36806ba50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd36e600640 1 -- 172.21.15.73:0/3694209485 >> 172.21.15.73:0/3694209485 conn(0x7fd3680d1410 msgr2=0x7fd3680d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd36e600640 1 -- 172.21.15.73:0/3694209485 shutdown_connections 2024-04-15T15:32:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd36e600640 1 -- 172.21.15.73:0/3694209485 wait complete. 2024-04-15T15:32:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.609+0000 7fd36e600640 1 Processor -- start 2024-04-15T15:32:01.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd36e600640 1 -- start start 2024-04-15T15:32:01.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd36e600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36806bf90 0x7fd3680cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd36e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd368070980 0x7fd368160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd36e600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3680b0940 0x7fd368151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd36e600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd3680cba60 con 0x7fd36806bf90 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd36e600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd368070d90 con 0x7fd368070980 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd36e600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd3680cbbe0 con 0x7fd3680b0940 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36806bf90 0x7fd3680cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36806bf90 0x7fd3680cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58930/0 (socket says 172.21.15.73:58930) 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367400640 1 -- 172.21.15.73:0/4037560279 learned_addr learned my addr 172.21.15.73:0/4037560279 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367e00640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3680b0940 0x7fd368151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd35fe00640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd368070980 0x7fd368160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367400640 1 -- 172.21.15.73:0/4037560279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3680b0940 msgr2=0x7fd368151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367400640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3680b0940 0x7fd368151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367400640 1 -- 172.21.15.73:0/4037560279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd368070980 msgr2=0x7fd368160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367400640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd368070980 0x7fd368160770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367400640 1 -- 172.21.15.73:0/4037560279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3680cc7c0 con 0x7fd36806bf90 2024-04-15T15:32:01.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367e00640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3680b0940 0x7fd368151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd35fe00640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd368070980 0x7fd368160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd367400640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36806bf90 0x7fd3680cbf70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd358018fd0 tx=0x7fd35801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd35f400640 1 -- 172.21.15.73:0/4037560279 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580b0050 con 0x7fd36806bf90 2024-04-15T15:32:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd35f400640 1 -- 172.21.15.73:0/4037560279 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3580bc070 con 0x7fd36806bf90 2024-04-15T15:32:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd36e600640 1 -- 172.21.15.73:0/4037560279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3680ccaa0 con 0x7fd36806bf90 2024-04-15T15:32:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd35f400640 1 -- 172.21.15.73:0/4037560279 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580b7870 con 0x7fd36806bf90 2024-04-15T15:32:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd36e600640 1 -- 172.21.15.73:0/4037560279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3680cd060 con 0x7fd36806bf90 2024-04-15T15:32:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.613+0000 7fd36e600640 1 -- 172.21.15.73:0/4037560279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd368068ab0 con 0x7fd36806bf90 2024-04-15T15:32:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.617+0000 7fd35f400640 1 -- 172.21.15.73:0/4037560279 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd3580b7a10 con 0x7fd36806bf90 2024-04-15T15:32:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.617+0000 7fd35f400640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd344068380 0x7fd34406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.617+0000 7fd35f400640 1 -- 172.21.15.73:0/4037560279 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd3581214c0 con 0x7fd36806bf90 2024-04-15T15:32:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.617+0000 7fd35fe00640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd344068380 0x7fd34406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.617+0000 7fd35fe00640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd344068380 0x7fd34406a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd36815a680 tx=0x7fd350008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.621+0000 7fd35f400640 1 -- 172.21.15.73:0/4037560279 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd358016070 con 0x7fd36806bf90 2024-04-15T15:32:01.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.777+0000 7fd36e600640 1 -- 172.21.15.73:0/4037560279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3680b7390 con 0x7fd36806bf90 2024-04-15T15:32:01.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd35f400640 1 -- 172.21.15.73:0/4037560279 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fd3580f1730 con 0x7fd36806bf90 2024-04-15T15:32:01.781 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:01.781 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 -- 172.21.15.73:0/4037560279 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd344068380 msgr2=0x7fd34406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd344068380 0x7fd34406a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd36815a680 tx=0x7fd350008040 comp rx=0 tx=0).stop 2024-04-15T15:32:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 -- 172.21.15.73:0/4037560279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36806bf90 msgr2=0x7fd3680cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36806bf90 0x7fd3680cbf70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd358018fd0 tx=0x7fd35801ac00 comp rx=0 tx=0).stop 2024-04-15T15:32:01.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 -- 172.21.15.73:0/4037560279 shutdown_connections 2024-04-15T15:32:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd344068380 0x7fd34406a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3680b0940 0x7fd368151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd368070980 0x7fd368160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 --2- 172.21.15.73:0/4037560279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36806bf90 0x7fd3680cbf70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 -- 172.21.15.73:0/4037560279 >> 172.21.15.73:0/4037560279 conn(0x7fd3680d1410 msgr2=0x7fd3680aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 -- 172.21.15.73:0/4037560279 shutdown_connections 2024-04-15T15:32:01.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.781+0000 7fd36e600640 1 -- 172.21.15.73:0/4037560279 wait complete. 2024-04-15T15:32:01.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:01.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.937+0000 7fbdb5400640 1 Processor -- start 2024-04-15T15:32:01.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.937+0000 7fbdb5400640 1 -- start start 2024-04-15T15:32:01.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbdb5400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb00b20b0 0x7fbdb00b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbdb5400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbdb015cbd0 0x7fbdb015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbdb5400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb00cd3a0 con 0x7fbdb0146110 2024-04-15T15:32:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbdb5400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb00b5160 con 0x7fbdb015cbd0 2024-04-15T15:32:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbdb5400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb00b40c0 con 0x7fbdb00b20b0 2024-04-15T15:32:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbda5e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb00b20b0 0x7fbdb00b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbdaf200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbdb015cbd0 0x7fbdb015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbda5e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb00b20b0 0x7fbdb00b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:34872/0 (socket says 172.21.15.73:34872) 2024-04-15T15:32:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbda5e00640 1 -- 172.21.15.73:0/2633198157 learned_addr learned my addr 172.21.15.73:0/2633198157 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbda5e00640 1 -- 172.21.15.73:0/2633198157 >> v2:172.21.15.118:3300/0 conn(0x7fbdb015cbd0 msgr2=0x7fbdb015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbda5e00640 1 --2- 172.21.15.73:0/2633198157 >> v2:172.21.15.118:3300/0 conn(0x7fbdb015cbd0 0x7fbdb015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbda5e00640 1 -- 172.21.15.73:0/2633198157 >> v1:172.21.15.118:6789/0 conn(0x7fbdb0146110 legacy=0x7fbdb00cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbdade00640 1 -- 172.21.15.73:0/2633198157 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870895668 0 0) 0x7fbdb00cd3a0 con 0x7fbdb0146110 2024-04-15T15:32:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.941+0000 7fbda5e00640 1 -- 172.21.15.73:0/2633198157 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb00b43a0 con 0x7fbdb00b20b0 2024-04-15T15:32:01.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbda5e00640 1 --2- 172.21.15.73:0/2633198157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb00b20b0 0x7fbdb00b2530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009870 tx=0x7fbd9801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=102e88c37d6fe543 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:01.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdade00640 1 -- 172.21.15.73:0/2633198157 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd980ab650 con 0x7fbdb00b20b0 2024-04-15T15:32:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdade00640 1 -- 172.21.15.73:0/2633198157 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd980b0070 con 0x7fbdb00b20b0 2024-04-15T15:32:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdade00640 1 -- 172.21.15.73:0/2633198157 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd980aba10 con 0x7fbdb00b20b0 2024-04-15T15:32:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdb5400640 1 -- 172.21.15.73:0/2633198157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb00b20b0 msgr2=0x7fbdb00b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdb5400640 1 --2- 172.21.15.73:0/2633198157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb00b20b0 0x7fbdb00b2530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009870 tx=0x7fbd9801c560 comp rx=0 tx=0).stop 2024-04-15T15:32:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdb5400640 1 -- 172.21.15.73:0/2633198157 shutdown_connections 2024-04-15T15:32:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdb5400640 1 --2- 172.21.15.73:0/2633198157 >> v2:172.21.15.118:3300/0 conn(0x7fbdb015cbd0 0x7fbdb015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdb5400640 1 --2- 172.21.15.73:0/2633198157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb00b20b0 0x7fbdb00b2530 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdb5400640 1 -- 172.21.15.73:0/2633198157 >> 172.21.15.73:0/2633198157 conn(0x7fbdb0067dd0 msgr2=0x7fbdb00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdb5400640 1 -- 172.21.15.73:0/2633198157 shutdown_connections 2024-04-15T15:32:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdb5400640 1 -- 172.21.15.73:0/2633198157 wait complete. 2024-04-15T15:32:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdb5400640 1 Processor -- start 2024-04-15T15:32:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.945+0000 7fbdb5400640 1 -- start start 2024-04-15T15:32:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdb5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdb00b20b0 0x7fbdb013d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdb5400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdb0146110 0x7fbdb00a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdb5400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb015cbd0 0x7fbdb0143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdb5400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb0169210 con 0x7fbdb0146110 2024-04-15T15:32:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdb5400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb00b3d70 con 0x7fbdb00b20b0 2024-04-15T15:32:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdb5400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb0169390 con 0x7fbdb015cbd0 2024-04-15T15:32:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdb0146110 0x7fbdb00a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdb0146110 0x7fbdb00a96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58936/0 (socket says 172.21.15.73:58936) 2024-04-15T15:32:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda5e00640 1 -- 172.21.15.73:0/2721504894 learned_addr learned my addr 172.21.15.73:0/2721504894 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdae800640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdb00b20b0 0x7fbdb013d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdaf200640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb015cbd0 0x7fbdb0143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda5e00640 1 -- 172.21.15.73:0/2721504894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb015cbd0 msgr2=0x7fbdb0143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda5e00640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb015cbd0 0x7fbdb0143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda5e00640 1 -- 172.21.15.73:0/2721504894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdb00b20b0 msgr2=0x7fbdb013d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda5e00640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdb00b20b0 0x7fbdb013d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda5e00640 1 -- 172.21.15.73:0/2721504894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb013d760 con 0x7fbdb0146110 2024-04-15T15:32:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda5e00640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdb0146110 0x7fbdb00a96f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbd980ad040 tx=0x7fbd9801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:01.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda7400640 1 -- 172.21.15.73:0/2721504894 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd980be5f0 con 0x7fbdb0146110 2024-04-15T15:32:01.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda7400640 1 -- 172.21.15.73:0/2721504894 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd980be7b0 con 0x7fbdb0146110 2024-04-15T15:32:01.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda7400640 1 -- 172.21.15.73:0/2721504894 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd980beba0 con 0x7fbdb0146110 2024-04-15T15:32:01.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdb5400640 1 -- 172.21.15.73:0/2721504894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb013ed10 con 0x7fbdb0146110 2024-04-15T15:32:01.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdb5400640 1 -- 172.21.15.73:0/2721504894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb013f2d0 con 0x7fbdb0146110 2024-04-15T15:32:01.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbdb5400640 1 -- 172.21.15.73:0/2721504894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb0068ab0 con 0x7fbdb0146110 2024-04-15T15:32:01.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.949+0000 7fbda7400640 1 -- 172.21.15.73:0/2721504894 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd980b43f0 con 0x7fbdb0146110 2024-04-15T15:32:01.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.953+0000 7fbda7400640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbd8c068380 0x7fbd8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:01.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.953+0000 7fbda7400640 1 -- 172.21.15.73:0/2721504894 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbd98121be0 con 0x7fbdb0146110 2024-04-15T15:32:01.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.953+0000 7fbdae800640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbd8c068380 0x7fbd8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:01.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.953+0000 7fbdae800640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbd8c068380 0x7fbd8c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbda0000f70 tx=0x7fbda0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:01.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:01.957+0000 7fbda7400640 1 -- 172.21.15.73:0/2721504894 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd980c4060 con 0x7fbdb0146110 2024-04-15T15:32:02.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.113+0000 7fbdb5400640 1 -- 172.21.15.73:0/2721504894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbdb0159110 con 0x7fbdb0146110 2024-04-15T15:32:02.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.113+0000 7fbda7400640 1 -- 172.21.15.73:0/2721504894 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fbd98016150 con 0x7fbdb0146110 2024-04-15T15:32:02.116 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 -- 172.21.15.73:0/2721504894 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbd8c068380 msgr2=0x7fbd8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbd8c068380 0x7fbd8c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbda0000f70 tx=0x7fbda0009040 comp rx=0 tx=0).stop 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 -- 172.21.15.73:0/2721504894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdb0146110 msgr2=0x7fbdb00a96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdb0146110 0x7fbdb00a96f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbd980ad040 tx=0x7fbd9801ada0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 -- 172.21.15.73:0/2721504894 shutdown_connections 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbd8c068380 0x7fbd8c06a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb015cbd0 0x7fbdb0143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdb0146110 0x7fbdb00a96f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 --2- 172.21.15.73:0/2721504894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdb00b20b0 0x7fbdb013d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 -- 172.21.15.73:0/2721504894 >> 172.21.15.73:0/2721504894 conn(0x7fbdb0067dd0 msgr2=0x7fbdb0144c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 -- 172.21.15.73:0/2721504894 shutdown_connections 2024-04-15T15:32:02.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.117+0000 7fbdb5400640 1 -- 172.21.15.73:0/2721504894 wait complete. 2024-04-15T15:32:02.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:02.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4597c00640 1 Processor -- start 2024-04-15T15:32:02.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4597c00640 1 -- start start 2024-04-15T15:32:02.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4597c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f459015e760 0x7f4590073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4597c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f459006d170 0x7f459006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4597c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45900b4810 con 0x7f4590070130 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4597c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f45900cd2f0 con 0x7f459006d170 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4597c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f45900b45c0 con 0x7f459015e760 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4595c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f459006d170 0x7f459006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4595c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f459006d170 0x7f459006e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58942/0 (socket says 172.21.15.73:58942) 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4595c00640 1 -- 172.21.15.73:0/2223547982 learned_addr learned my addr 172.21.15.73:0/2223547982 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4595200640 1 --2- 172.21.15.73:0/2223547982 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f459015e760 0x7f4590073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4595c00640 1 -- 172.21.15.73:0/2223547982 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f459015e760 msgr2=0x7f4590073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4595c00640 1 --2- 172.21.15.73:0/2223547982 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f459015e760 0x7f4590073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4595c00640 1 -- 172.21.15.73:0/2223547982 >> v1:172.21.15.118:6789/0 conn(0x7f4590070130 legacy=0x7f459006ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.273+0000 7f4595c00640 1 -- 172.21.15.73:0/2223547982 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45900b4af0 con 0x7f459006d170 2024-04-15T15:32:02.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f4595c00640 1 --2- 172.21.15.73:0/2223547982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 0x7f459006e740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4588009e50 tx=0x7f458801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def9e0b05238b9ba server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:02.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f458f400640 1 -- 172.21.15.73:0/2223547982 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880a57e0 con 0x7f459006d170 2024-04-15T15:32:02.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f458f400640 1 -- 172.21.15.73:0/2223547982 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45880a5980 con 0x7f459006d170 2024-04-15T15:32:02.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f458f400640 1 -- 172.21.15.73:0/2223547982 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880a5d50 con 0x7f459006d170 2024-04-15T15:32:02.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f4597c00640 1 -- 172.21.15.73:0/2223547982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 msgr2=0x7f459006e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f4597c00640 1 --2- 172.21.15.73:0/2223547982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 0x7f459006e740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4588009e50 tx=0x7f458801ca00 comp rx=0 tx=0).stop 2024-04-15T15:32:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f4597c00640 1 -- 172.21.15.73:0/2223547982 shutdown_connections 2024-04-15T15:32:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f4597c00640 1 --2- 172.21.15.73:0/2223547982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 0x7f459006e740 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f4597c00640 1 --2- 172.21.15.73:0/2223547982 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f459015e760 0x7f4590073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f4597c00640 1 -- 172.21.15.73:0/2223547982 >> 172.21.15.73:0/2223547982 conn(0x7f4590072590 msgr2=0x7f4590072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f4597c00640 1 -- 172.21.15.73:0/2223547982 shutdown_connections 2024-04-15T15:32:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.277+0000 7f4597c00640 1 -- 172.21.15.73:0/2223547982 wait complete. 2024-04-15T15:32:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 Processor -- start 2024-04-15T15:32:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 -- start start 2024-04-15T15:32:02.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 0x7f459014a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4590070130 0x7f4590152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459015e760 0x7f45900ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f459006f610 con 0x7f459006d170 2024-04-15T15:32:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f459006f490 con 0x7f459015e760 2024-04-15T15:32:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f459006f790 con 0x7f4590070130 2024-04-15T15:32:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4595200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 0x7f459014a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4595200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 0x7f459014a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58944/0 (socket says 172.21.15.73:58944) 2024-04-15T15:32:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4595200640 1 -- 172.21.15.73:0/3959992701 learned_addr learned my addr 172.21.15.73:0/3959992701 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f458fe00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4590070130 0x7f4590152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4595c00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459015e760 0x7f45900ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4595200640 1 -- 172.21.15.73:0/3959992701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4590070130 msgr2=0x7f4590152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4595200640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4590070130 0x7f4590152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4595200640 1 -- 172.21.15.73:0/3959992701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459015e760 msgr2=0x7f45900ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4595200640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459015e760 0x7f45900ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4595200640 1 -- 172.21.15.73:0/3959992701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4590152c70 con 0x7f459006d170 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4595200640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 0x7f459014a600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f458000d5f0 tx=0x7f458000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f458cc00640 1 -- 172.21.15.73:0/3959992701 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45800125f0 con 0x7f459006d170 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f458cc00640 1 -- 172.21.15.73:0/3959992701 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4580019070 con 0x7f459006d170 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f458cc00640 1 -- 172.21.15.73:0/3959992701 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45800129b0 con 0x7f459006d170 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 -- 172.21.15.73:0/3959992701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4590152f50 con 0x7f459006d170 2024-04-15T15:32:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 -- 172.21.15.73:0/3959992701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4590154ee0 con 0x7f459006d170 2024-04-15T15:32:02.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.281+0000 7f4597c00640 1 -- 172.21.15.73:0/3959992701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4590068ab0 con 0x7f459006d170 2024-04-15T15:32:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.285+0000 7f458cc00640 1 -- 172.21.15.73:0/3959992701 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4580012b50 con 0x7f459006d170 2024-04-15T15:32:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.285+0000 7f458cc00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4570068380 0x7f457006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.285+0000 7f458cc00640 1 -- 172.21.15.73:0/3959992701 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4580086fd0 con 0x7f459006d170 2024-04-15T15:32:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.285+0000 7f458fe00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4570068380 0x7f457006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.285+0000 7f458fe00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4570068380 0x7f457006a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f459014e000 tx=0x7f457c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.289+0000 7f458cc00640 1 -- 172.21.15.73:0/3959992701 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4580056bf0 con 0x7f459006d170 2024-04-15T15:32:02.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.445+0000 7f4597c00640 1 -- 172.21.15.73:0/3959992701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4590073260 con 0x7f459006d170 2024-04-15T15:32:02.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.445+0000 7f458cc00640 1 -- 172.21.15.73:0/3959992701 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f458005aef0 con 0x7f459006d170 2024-04-15T15:32:02.448 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:02.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 -- 172.21.15.73:0/3959992701 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4570068380 msgr2=0x7f457006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4570068380 0x7f457006a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f459014e000 tx=0x7f457c009040 comp rx=0 tx=0).stop 2024-04-15T15:32:02.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 -- 172.21.15.73:0/3959992701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 msgr2=0x7f459014a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 0x7f459014a600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f458000d5f0 tx=0x7f458000dab0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 -- 172.21.15.73:0/3959992701 shutdown_connections 2024-04-15T15:32:02.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459015e760 0x7f45900ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4570068380 0x7f457006a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4590070130 0x7f4590152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 --2- 172.21.15.73:0/3959992701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f459006d170 0x7f459014a600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 -- 172.21.15.73:0/3959992701 >> 172.21.15.73:0/3959992701 conn(0x7f4590072590 msgr2=0x7f4590157550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:02.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 -- 172.21.15.73:0/3959992701 shutdown_connections 2024-04-15T15:32:02.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.449+0000 7f4597c00640 1 -- 172.21.15.73:0/3959992701 wait complete. 2024-04-15T15:32:02.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.609+0000 7f3405800640 1 Processor -- start 2024-04-15T15:32:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.609+0000 7f3405800640 1 -- start start 2024-04-15T15:32:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f3405800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f340015fc90 0x7f34000b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f3405800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3400070160 con 0x7f340015b5d0 2024-04-15T15:32:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f3405800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340015f1f0 con 0x7f34000b27c0 2024-04-15T15:32:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f3405800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f340015b9b0 con 0x7f340015fc90 2024-04-15T15:32:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f33ff400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f340015fc90 0x7f34000b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f33fea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f340015b5d0 0x7f34000b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53168/0 (socket says 172.21.15.73:53168) 2024-04-15T15:32:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f33fea00640 1 -- 172.21.15.73:0/2289449192 learned_addr learned my addr 172.21.15.73:0/2289449192 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f33ff400640 1 -- 172.21.15.73:0/2289449192 >> v1:172.21.15.118:6789/0 conn(0x7f34000b27c0 legacy=0x7f34000b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f33ff400640 1 -- 172.21.15.73:0/2289449192 >> v1:172.21.15.73:6789/0 conn(0x7f340015b5d0 legacy=0x7f34000b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f33fd600640 1 -- 172.21.15.73:0/2289449192 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757676933 0 0) 0x7f3400070160 con 0x7f340015b5d0 2024-04-15T15:32:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.613+0000 7f33ff400640 1 -- 172.21.15.73:0/2289449192 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340006fe80 con 0x7f340015fc90 2024-04-15T15:32:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f33ff400640 1 --2- 172.21.15.73:0/2289449192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015fc90 0x7f34000b3e30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33f80097c0 tx=0x7f33f801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b50d6b9a379c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f33fd600640 1 -- 172.21.15.73:0/2289449192 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f80b0070 con 0x7f340015fc90 2024-04-15T15:32:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f33fd600640 1 -- 172.21.15.73:0/2289449192 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f80ab600 con 0x7f340015fc90 2024-04-15T15:32:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f33fd600640 1 -- 172.21.15.73:0/2289449192 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f80ab9d0 con 0x7f340015fc90 2024-04-15T15:32:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 -- 172.21.15.73:0/2289449192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015fc90 msgr2=0x7f34000b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 --2- 172.21.15.73:0/2289449192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015fc90 0x7f34000b3e30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33f80097c0 tx=0x7f33f801c310 comp rx=0 tx=0).stop 2024-04-15T15:32:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 -- 172.21.15.73:0/2289449192 shutdown_connections 2024-04-15T15:32:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 --2- 172.21.15.73:0/2289449192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015fc90 0x7f34000b3e30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 -- 172.21.15.73:0/2289449192 >> 172.21.15.73:0/2289449192 conn(0x7f3400067dd0 msgr2=0x7f34000d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 -- 172.21.15.73:0/2289449192 shutdown_connections 2024-04-15T15:32:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 -- 172.21.15.73:0/2289449192 wait complete. 2024-04-15T15:32:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 Processor -- start 2024-04-15T15:32:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 -- start start 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34000b27c0 0x7f340014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015b5d0 0x7f34001519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340015fc90 0x7f3400151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f340006fc20 con 0x7f340015b5d0 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f340006faa0 con 0x7f340015fc90 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.617+0000 7f3405800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3400169470 con 0x7f34000b27c0 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33fe000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015b5d0 0x7f34001519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33fe000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015b5d0 0x7f34001519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58960/0 (socket says 172.21.15.73:58960) 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33fe000640 1 -- 172.21.15.73:0/2273454933 learned_addr learned my addr 172.21.15.73:0/2273454933 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33fea00640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34000b27c0 0x7f340014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33ff400640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340015fc90 0x7f3400151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33fe000640 1 -- 172.21.15.73:0/2273454933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34000b27c0 msgr2=0x7f340014f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33fe000640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34000b27c0 0x7f340014f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33fe000640 1 -- 172.21.15.73:0/2273454933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340015fc90 msgr2=0x7f3400151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33fe000640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340015fc90 0x7f3400151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33fe000640 1 -- 172.21.15.73:0/2273454933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3400153b20 con 0x7f340015b5d0 2024-04-15T15:32:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33fe000640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015b5d0 0x7f34001519f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f33e800b410 tx=0x7f33e800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33f6a00640 1 -- 172.21.15.73:0/2273454933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8015030 con 0x7f340015b5d0 2024-04-15T15:32:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33f6a00640 1 -- 172.21.15.73:0/2273454933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e8004020 con 0x7f340015b5d0 2024-04-15T15:32:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f3405800640 1 -- 172.21.15.73:0/2273454933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34001542e0 con 0x7f340015b5d0 2024-04-15T15:32:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33f6a00640 1 -- 172.21.15.73:0/2273454933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8004450 con 0x7f340015b5d0 2024-04-15T15:32:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f3405800640 1 -- 172.21.15.73:0/2273454933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34001548a0 con 0x7f340015b5d0 2024-04-15T15:32:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f3405800640 1 -- 172.21.15.73:0/2273454933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34000d02f0 con 0x7f340015b5d0 2024-04-15T15:32:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33f6a00640 1 -- 172.21.15.73:0/2273454933 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33e8018070 con 0x7f340015b5d0 2024-04-15T15:32:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.621+0000 7f33f6a00640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f33dc068380 0x7f33dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.625+0000 7f33f6a00640 1 -- 172.21.15.73:0/2273454933 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f33e8086960 con 0x7f340015b5d0 2024-04-15T15:32:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.625+0000 7f33fea00640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f33dc068380 0x7f33dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.625+0000 7f33fea00640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f33dc068380 0x7f33dc06a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f33f0005fd0 tx=0x7f33f0005b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.629+0000 7f33f6a00640 1 -- 172.21.15.73:0/2273454933 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f33e8056b80 con 0x7f340015b5d0 2024-04-15T15:32:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 -- 172.21.15.73:0/2273454933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3400068ab0 con 0x7f340015b5d0 2024-04-15T15:32:02.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f33f6a00640 1 -- 172.21.15.73:0/2273454933 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f33e8056480 con 0x7f340015b5d0 2024-04-15T15:32:02.787 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 -- 172.21.15.73:0/2273454933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f33dc068380 msgr2=0x7f33dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f33dc068380 0x7f33dc06a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f33f0005fd0 tx=0x7f33f0005b80 comp rx=0 tx=0).stop 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 -- 172.21.15.73:0/2273454933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015b5d0 msgr2=0x7f34001519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015b5d0 0x7f34001519f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f33e800b410 tx=0x7f33e800b8d0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 -- 172.21.15.73:0/2273454933 shutdown_connections 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f340015fc90 0x7f3400151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f340015b5d0 0x7f34001519f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f33dc068380 0x7f33dc06a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 --2- 172.21.15.73:0/2273454933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34000b27c0 0x7f340014f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.785+0000 7f3405800640 1 -- 172.21.15.73:0/2273454933 >> 172.21.15.73:0/2273454933 conn(0x7f3400067dd0 msgr2=0x7f34000b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.789+0000 7f3405800640 1 -- 172.21.15.73:0/2273454933 shutdown_connections 2024-04-15T15:32:02.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.789+0000 7f3405800640 1 -- 172.21.15.73:0/2273454933 wait complete. 2024-04-15T15:32:02.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:02.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.945+0000 7fece1000640 1 Processor -- start 2024-04-15T15:32:02.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.945+0000 7fece1000640 1 -- start start 2024-04-15T15:32:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fece1000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fecdc0af610 0x7fecdc06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fece1000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecdc0d0450 0x7fecdc0d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fece1000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecdc0d0da0 con 0x7fecdc15b560 2024-04-15T15:32:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fece1000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fecdc0ce620 con 0x7fecdc0d0450 2024-04-15T15:32:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fece1000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fecdc06dc10 con 0x7fecdc0af610 2024-04-15T15:32:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fecdbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecdc0d0450 0x7fecdc0d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fecdbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecdc0d0450 0x7fecdc0d0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58974/0 (socket says 172.21.15.73:58974) 2024-04-15T15:32:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fecdbe00640 1 -- 172.21.15.73:0/2565115067 learned_addr learned my addr 172.21.15.73:0/2565115067 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fecdbe00640 1 -- 172.21.15.73:0/2565115067 >> v2:172.21.15.118:3300/0 conn(0x7fecdc0af610 msgr2=0x7fecdc06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fecdbe00640 1 --2- 172.21.15.73:0/2565115067 >> v2:172.21.15.118:3300/0 conn(0x7fecdc0af610 0x7fecdc06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fecdbe00640 1 -- 172.21.15.73:0/2565115067 >> v1:172.21.15.118:6789/0 conn(0x7fecdc15b560 legacy=0x7fecdc0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fecdbe00640 1 -- 172.21.15.73:0/2565115067 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecdc06def0 con 0x7fecdc0d0450 2024-04-15T15:32:02.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.949+0000 7fecdbe00640 1 --2- 172.21.15.73:0/2565115067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0d0450 0x7fecdc0d0860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0afc70 tx=0x7fecd401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f5dc17bcb44e5b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:02.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fecdaa00640 1 -- 172.21.15.73:0/2565115067 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd40a55e0 con 0x7fecdc0d0450 2024-04-15T15:32:02.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fecdaa00640 1 -- 172.21.15.73:0/2565115067 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd40a5780 con 0x7fecdc0d0450 2024-04-15T15:32:02.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fecdaa00640 1 -- 172.21.15.73:0/2565115067 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd40a5b50 con 0x7fecdc0d0450 2024-04-15T15:32:02.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 -- 172.21.15.73:0/2565115067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0d0450 msgr2=0x7fecdc0d0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 --2- 172.21.15.73:0/2565115067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0d0450 0x7fecdc0d0860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0afc70 tx=0x7fecd401c920 comp rx=0 tx=0).stop 2024-04-15T15:32:02.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 -- 172.21.15.73:0/2565115067 shutdown_connections 2024-04-15T15:32:02.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 --2- 172.21.15.73:0/2565115067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0d0450 0x7fecdc0d0860 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 --2- 172.21.15.73:0/2565115067 >> v2:172.21.15.118:3300/0 conn(0x7fecdc0af610 0x7fecdc06e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 -- 172.21.15.73:0/2565115067 >> 172.21.15.73:0/2565115067 conn(0x7fecdc06bc20 msgr2=0x7fecdc06c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:02.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 -- 172.21.15.73:0/2565115067 shutdown_connections 2024-04-15T15:32:02.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 -- 172.21.15.73:0/2565115067 wait complete. 2024-04-15T15:32:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 Processor -- start 2024-04-15T15:32:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 -- start start 2024-04-15T15:32:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0af610 0x7fecdc099b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fecdc0d0450 0x7fecdc0c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecdc15b560 0x7fecdc1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc0b40d0 con 0x7fecdc0af610 2024-04-15T15:32:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc0b3f50 con 0x7fecdc15b560 2024-04-15T15:32:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fece1000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fecdc0b4250 con 0x7fecdc0d0450 2024-04-15T15:32:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fecdb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0af610 0x7fecdc099b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fecdb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0af610 0x7fecdc099b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58978/0 (socket says 172.21.15.73:58978) 2024-04-15T15:32:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fecdb400640 1 -- 172.21.15.73:0/3485423235 learned_addr learned my addr 172.21.15.73:0/3485423235 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fecdbe00640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecdc15b560 0x7fecdc1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.953+0000 7fecd2a00640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fecdc0d0450 0x7fecdc0c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecdb400640 1 -- 172.21.15.73:0/3485423235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fecdc0d0450 msgr2=0x7fecdc0c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecdb400640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fecdc0d0450 0x7fecdc0c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecdb400640 1 -- 172.21.15.73:0/3485423235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecdc15b560 msgr2=0x7fecdc1564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecdb400640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecdc15b560 0x7fecdc1564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecdb400640 1 -- 172.21.15.73:0/3485423235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecdc0c62b0 con 0x7fecdc0af610 2024-04-15T15:32:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecdbe00640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecdc15b560 0x7fecdc1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecdb400640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0af610 0x7fecdc099b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feccc00b3e0 tx=0x7feccc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecd3e00640 1 -- 172.21.15.73:0/3485423235 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc015020 con 0x7fecdc0af610 2024-04-15T15:32:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecd3e00640 1 -- 172.21.15.73:0/3485423235 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feccc011850 con 0x7fecdc0af610 2024-04-15T15:32:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecd3e00640 1 -- 172.21.15.73:0/3485423235 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc011c40 con 0x7fecdc0af610 2024-04-15T15:32:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fece1000640 1 -- 172.21.15.73:0/3485423235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecdc0c6590 con 0x7fecdc0af610 2024-04-15T15:32:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fece1000640 1 -- 172.21.15.73:0/3485423235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecdc0c6b50 con 0x7fecdc0af610 2024-04-15T15:32:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fece1000640 1 -- 172.21.15.73:0/3485423235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecdc04fd60 con 0x7fecdc0af610 2024-04-15T15:32:02.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecd3e00640 1 -- 172.21.15.73:0/3485423235 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feccc018020 con 0x7fecdc0af610 2024-04-15T15:32:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecd3e00640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fecb8068380 0x7fecb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecd3e00640 1 -- 172.21.15.73:0/3485423235 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feccc086d80 con 0x7fecdc0af610 2024-04-15T15:32:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.957+0000 7fecd2a00640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fecb8068380 0x7fecb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.961+0000 7fecd2a00640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fecb8068380 0x7fecb806a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecc4006fd0 tx=0x7fecc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:02.961+0000 7fecd3e00640 1 -- 172.21.15.73:0/3485423235 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feccc01f020 con 0x7fecdc0af610 2024-04-15T15:32:03.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:32:03.075 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:32:03.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.121+0000 7fece1000640 1 -- 172.21.15.73:0/3485423235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fecdc0b0d20 con 0x7fecdc0af610 2024-04-15T15:32:03.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.121+0000 7fecd3e00640 1 -- 172.21.15.73:0/3485423235 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7feccc0172c0 con 0x7fecdc0af610 2024-04-15T15:32:03.123 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.121+0000 7fece1000640 1 -- 172.21.15.73:0/3485423235 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fecb8068380 msgr2=0x7fecb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.121+0000 7fece1000640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fecb8068380 0x7fecb806a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecc4006fd0 tx=0x7fecc4008040 comp rx=0 tx=0).stop 2024-04-15T15:32:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.125+0000 7fece1000640 1 -- 172.21.15.73:0/3485423235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0af610 msgr2=0x7fecdc099b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.125+0000 7fece1000640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0af610 0x7fecdc099b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feccc00b3e0 tx=0x7feccc00b8a0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.125+0000 7fece1000640 1 -- 172.21.15.73:0/3485423235 shutdown_connections 2024-04-15T15:32:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.125+0000 7fece1000640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecdc15b560 0x7fecdc1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.125+0000 7fece1000640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fecb8068380 0x7fecb806a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.125+0000 7fece1000640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fecdc0d0450 0x7fecdc0c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.125+0000 7fece1000640 1 --2- 172.21.15.73:0/3485423235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecdc0af610 0x7fecdc099b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.125+0000 7fece1000640 1 -- 172.21.15.73:0/3485423235 >> 172.21.15.73:0/3485423235 conn(0x7fecdc06bc20 msgr2=0x7fecdc0afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:03.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.125+0000 7fece1000640 1 -- 172.21.15.73:0/3485423235 shutdown_connections 2024-04-15T15:32:03.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.125+0000 7fece1000640 1 -- 172.21.15.73:0/3485423235 wait complete. 2024-04-15T15:32:03.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:32:03.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c22a00640 1 Processor -- start 2024-04-15T15:32:03.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c22a00640 1 -- start start 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c22a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9c1c15c490 0x7f9c1c0cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c22a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c1c0d1580 0x7f9c1c1600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c22a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c160620 0x7f9c1c0cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c22a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1c0ccac0 con 0x7f9c1c0d1580 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c22a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1c0ccda0 con 0x7f9c1c15c490 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c22a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1c0d1ad0 con 0x7f9c1c160620 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c20c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c1c0d1580 0x7f9c1c1600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c20c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c1c0d1580 0x7f9c1c1600e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58988/0 (socket says 172.21.15.73:58988) 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.321+0000 7f9c20c00640 1 -- 172.21.15.73:0/424325305 learned_addr learned my addr 172.21.15.73:0/424325305 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c22000640 1 --2- 172.21.15.73:0/424325305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c160620 0x7f9c1c0cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c21600640 1 --2- 172.21.15.73:0/424325305 >> v2:172.21.15.118:3300/0 conn(0x7f9c1c15c490 0x7f9c1c0cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c20c00640 1 -- 172.21.15.73:0/424325305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c160620 msgr2=0x7f9c1c0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:03.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c20c00640 1 --2- 172.21.15.73:0/424325305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c160620 0x7f9c1c0cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c20c00640 1 -- 172.21.15.73:0/424325305 >> v2:172.21.15.118:3300/0 conn(0x7f9c1c15c490 msgr2=0x7f9c1c0cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:03.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c20c00640 1 --2- 172.21.15.73:0/424325305 >> v2:172.21.15.118:3300/0 conn(0x7f9c1c15c490 0x7f9c1c0cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c20c00640 1 -- 172.21.15.73:0/424325305 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c0d1db0 con 0x7f9c1c0d1580 2024-04-15T15:32:03.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c20c00640 1 --2- 172.21.15.73:0/424325305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c0d1580 0x7f9c1c1600e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009870 tx=0x7f9c0801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c897ba67a044024 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:03.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c1be00640 1 -- 172.21.15.73:0/424325305 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c080b0070 con 0x7f9c1c0d1580 2024-04-15T15:32:03.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c1be00640 1 -- 172.21.15.73:0/424325305 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c080ab600 con 0x7f9c1c0d1580 2024-04-15T15:32:03.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.325+0000 7f9c1be00640 1 -- 172.21.15.73:0/424325305 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c080ab9d0 con 0x7f9c1c0d1580 2024-04-15T15:32:03.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 -- 172.21.15.73:0/424325305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c0d1580 msgr2=0x7f9c1c1600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 --2- 172.21.15.73:0/424325305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c0d1580 0x7f9c1c1600e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009870 tx=0x7f9c0801c260 comp rx=0 tx=0).stop 2024-04-15T15:32:03.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 -- 172.21.15.73:0/424325305 shutdown_connections 2024-04-15T15:32:03.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 --2- 172.21.15.73:0/424325305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c160620 0x7f9c1c0cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 --2- 172.21.15.73:0/424325305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c0d1580 0x7f9c1c1600e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 --2- 172.21.15.73:0/424325305 >> v2:172.21.15.118:3300/0 conn(0x7f9c1c15c490 0x7f9c1c0cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 -- 172.21.15.73:0/424325305 >> 172.21.15.73:0/424325305 conn(0x7f9c1c06ba50 msgr2=0x7f9c1c06be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 -- 172.21.15.73:0/424325305 shutdown_connections 2024-04-15T15:32:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 -- 172.21.15.73:0/424325305 wait complete. 2024-04-15T15:32:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 Processor -- start 2024-04-15T15:32:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 -- start start 2024-04-15T15:32:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c0d1580 0x7f9c1c0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c1c15c490 0x7f9c1c0a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c160620 0x7f9c1c1f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0b5380 con 0x7f9c1c160620 2024-04-15T15:32:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0b5200 con 0x7f9c1c15c490 2024-04-15T15:32:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1c0d22d0 con 0x7f9c1c0d1580 2024-04-15T15:32:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c160620 0x7f9c1c1f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c160620 0x7f9c1c1f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58992/0 (socket says 172.21.15.73:58992) 2024-04-15T15:32:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22000640 1 -- 172.21.15.73:0/3244404313 learned_addr learned my addr 172.21.15.73:0/3244404313 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c21600640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c0d1580 0x7f9c1c0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c20c00640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c1c15c490 0x7f9c1c0a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22000640 1 -- 172.21.15.73:0/3244404313 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c0d1580 msgr2=0x7f9c1c0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22000640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c0d1580 0x7f9c1c0b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22000640 1 -- 172.21.15.73:0/3244404313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c1c15c490 msgr2=0x7f9c1c0a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22000640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c1c15c490 0x7f9c1c0a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22000640 1 -- 172.21.15.73:0/3244404313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c0b44e0 con 0x7f9c1c160620 2024-04-15T15:32:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.329+0000 7f9c22000640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c160620 0x7f9c1c1f7970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c14007e60 tx=0x7f9c1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:03.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c19600640 1 -- 172.21.15.73:0/3244404313 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14014420 con 0x7f9c1c160620 2024-04-15T15:32:03.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c19600640 1 -- 172.21.15.73:0/3244404313 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c14019070 con 0x7f9c1c160620 2024-04-15T15:32:03.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c19600640 1 -- 172.21.15.73:0/3244404313 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14014820 con 0x7f9c1c160620 2024-04-15T15:32:03.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c22a00640 1 -- 172.21.15.73:0/3244404313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1c0c9640 con 0x7f9c1c160620 2024-04-15T15:32:03.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c22a00640 1 -- 172.21.15.73:0/3244404313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1c0c9c00 con 0x7f9c1c160620 2024-04-15T15:32:03.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c22a00640 1 -- 172.21.15.73:0/3244404313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c1c04fd60 con 0x7f9c1c160620 2024-04-15T15:32:03.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c19600640 1 -- 172.21.15.73:0/3244404313 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c140149c0 con 0x7f9c1c160620 2024-04-15T15:32:03.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c19600640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9bfc068380 0x7f9bfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c19600640 1 -- 172.21.15.73:0/3244404313 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9c140874b0 con 0x7f9c1c160620 2024-04-15T15:32:03.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c21600640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9bfc068380 0x7f9bfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.333+0000 7f9c21600640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9bfc068380 0x7f9bfc06a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c100045f0 tx=0x7f9c10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:03.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.337+0000 7f9c19600640 1 -- 172.21.15.73:0/3244404313 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c14057040 con 0x7f9c1c160620 2024-04-15T15:32:03.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.529+0000 7f9c22a00640 1 -- 172.21.15.73:0/3244404313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c1c0cbd20 con 0x7f9c1c160620 2024-04-15T15:32:03.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.529+0000 7f9c19600640 1 -- 172.21.15.73:0/3244404313 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f9c1405b340 con 0x7f9c1c160620 2024-04-15T15:32:03.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:03.531 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:31:33.826027+0000","modified":"2024-04-15T15:31:52.268632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-15T15:32:03.531 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-04-15T15:32:03.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 -- 172.21.15.73:0/3244404313 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9bfc068380 msgr2=0x7f9bfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9bfc068380 0x7f9bfc06a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c100045f0 tx=0x7f9c10008040 comp rx=0 tx=0).stop 2024-04-15T15:32:03.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 -- 172.21.15.73:0/3244404313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c160620 msgr2=0x7f9c1c1f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c160620 0x7f9c1c1f7970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c14007e60 tx=0x7f9c1400e4b0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 -- 172.21.15.73:0/3244404313 shutdown_connections 2024-04-15T15:32:03.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c1c160620 0x7f9c1c1f7970 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c1c15c490 0x7f9c1c0a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9bfc068380 0x7f9bfc06a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 --2- 172.21.15.73:0/3244404313 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c0d1580 0x7f9c1c0b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 -- 172.21.15.73:0/3244404313 >> 172.21.15.73:0/3244404313 conn(0x7f9c1c06ba50 msgr2=0x7f9c1c0b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:03.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 -- 172.21.15.73:0/3244404313 shutdown_connections 2024-04-15T15:32:03.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.533+0000 7f9c22a00640 1 -- 172.21.15.73:0/3244404313 wait complete. 2024-04-15T15:32:03.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:03.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f27e00640 1 Processor -- start 2024-04-15T15:32:03.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f27e00640 1 -- start start 2024-04-15T15:32:03.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f27e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9f20162a80 0x7f9f200b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f27e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f2006fbd0 0x7f9f20162e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f27e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2006e970 con 0x7f9f200b3e30 2024-04-15T15:32:03.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f27e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2006ec50 con 0x7f9f20162a80 2024-04-15T15:32:03.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f27e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2006ef30 con 0x7f9f2006fbd0 2024-04-15T15:32:03.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f25400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9f20162a80 0x7f9f200b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f25e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9f200b3e30 0x7f9f20166840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53180/0 (socket says 172.21.15.73:53180) 2024-04-15T15:32:03.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f25e00640 1 -- 172.21.15.73:0/2859819962 learned_addr learned my addr 172.21.15.73:0/2859819962 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:03.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f24a00640 1 --2- 172.21.15.73:0/2859819962 >> v2:172.21.15.118:3300/0 conn(0x7f9f2006fbd0 0x7f9f20162e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.685+0000 7f9f25400640 1 -- 172.21.15.73:0/2859819962 >> v2:172.21.15.118:3300/0 conn(0x7f9f2006fbd0 msgr2=0x7f9f20162e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:03.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f25400640 1 --2- 172.21.15.73:0/2859819962 >> v2:172.21.15.118:3300/0 conn(0x7f9f2006fbd0 0x7f9f20162e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f25400640 1 -- 172.21.15.73:0/2859819962 >> v1:172.21.15.73:6789/0 conn(0x7f9f200b3e30 legacy=0x7f9f20166840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f25400640 1 -- 172.21.15.73:0/2859819962 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2006f210 con 0x7f9f20162a80 2024-04-15T15:32:03.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f24a00640 1 --2- 172.21.15.73:0/2859819962 >> v2:172.21.15.118:3300/0 conn(0x7f9f2006fbd0 0x7f9f20162e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:03.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f1fe00640 1 -- 172.21.15.73:0/2859819962 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2230051526 0 0) 0x7f9f2006e970 con 0x7f9f200b3e30 2024-04-15T15:32:03.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f25400640 1 --2- 172.21.15.73:0/2859819962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f20162a80 0x7f9f200b3420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9f200d0ef0 tx=0x7f9f1401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad70319a8c0942 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:03.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f1fe00640 1 -- 172.21.15.73:0/2859819962 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f140ab610 con 0x7f9f20162a80 2024-04-15T15:32:03.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f1fe00640 1 -- 172.21.15.73:0/2859819962 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f140b0070 con 0x7f9f20162a80 2024-04-15T15:32:03.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f1fe00640 1 -- 172.21.15.73:0/2859819962 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f140ab9d0 con 0x7f9f20162a80 2024-04-15T15:32:03.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f27e00640 1 -- 172.21.15.73:0/2859819962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f20162a80 msgr2=0x7f9f200b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f27e00640 1 --2- 172.21.15.73:0/2859819962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f20162a80 0x7f9f200b3420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9f200d0ef0 tx=0x7f9f1401c450 comp rx=0 tx=0).stop 2024-04-15T15:32:03.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f27e00640 1 -- 172.21.15.73:0/2859819962 shutdown_connections 2024-04-15T15:32:03.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f27e00640 1 --2- 172.21.15.73:0/2859819962 >> v2:172.21.15.118:3300/0 conn(0x7f9f2006fbd0 0x7f9f20162e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f27e00640 1 --2- 172.21.15.73:0/2859819962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f20162a80 0x7f9f200b3420 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f27e00640 1 -- 172.21.15.73:0/2859819962 >> 172.21.15.73:0/2859819962 conn(0x7f9f20067dd0 msgr2=0x7f9f200d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:03.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f27e00640 1 -- 172.21.15.73:0/2859819962 shutdown_connections 2024-04-15T15:32:03.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.689+0000 7f9f27e00640 1 -- 172.21.15.73:0/2859819962 wait complete. 2024-04-15T15:32:03.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f27e00640 1 Processor -- start 2024-04-15T15:32:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f27e00640 1 -- start start 2024-04-15T15:32:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f27e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f2006fbd0 0x7f9f201559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f27e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f200b3e30 0x7f9f2015c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f27e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20162a80 0x7f9f20158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f27e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9f20163520 con 0x7f9f2006fbd0 2024-04-15T15:32:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f27e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201633a0 con 0x7f9f20162a80 2024-04-15T15:32:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f27e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2016f900 con 0x7f9f200b3e30 2024-04-15T15:32:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f25400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f2006fbd0 0x7f9f201559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f25400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f2006fbd0 0x7f9f201559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59004/0 (socket says 172.21.15.73:59004) 2024-04-15T15:32:03.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f25400640 1 -- 172.21.15.73:0/1111452551 learned_addr learned my addr 172.21.15.73:0/1111452551 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:03.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f24a00640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f200b3e30 0x7f9f2015c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f25e00640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20162a80 0x7f9f20158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f25400640 1 -- 172.21.15.73:0/1111452551 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f200b3e30 msgr2=0x7f9f2015c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f25400640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f200b3e30 0x7f9f2015c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f25400640 1 -- 172.21.15.73:0/1111452551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20162a80 msgr2=0x7f9f20158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f25400640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20162a80 0x7f9f20158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f25400640 1 -- 172.21.15.73:0/1111452551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f20157400 con 0x7f9f2006fbd0 2024-04-15T15:32:03.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f25400640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f2006fbd0 0x7f9f201559b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9f140ad040 tx=0x7f9f1401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:03.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f1d600640 1 -- 172.21.15.73:0/1111452551 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f140bf610 con 0x7f9f2006fbd0 2024-04-15T15:32:03.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f1d600640 1 -- 172.21.15.73:0/1111452551 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f140bf7d0 con 0x7f9f2006fbd0 2024-04-15T15:32:03.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f1d600640 1 -- 172.21.15.73:0/1111452551 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f140bfbc0 con 0x7f9f2006fbd0 2024-04-15T15:32:03.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f27e00640 1 -- 172.21.15.73:0/1111452551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f20155ef0 con 0x7f9f2006fbd0 2024-04-15T15:32:03.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.693+0000 7f9f27e00640 1 -- 172.21.15.73:0/1111452551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2015a7a0 con 0x7f9f2006fbd0 2024-04-15T15:32:03.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.697+0000 7f9f27e00640 1 -- 172.21.15.73:0/1111452551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f20068ab0 con 0x7f9f2006fbd0 2024-04-15T15:32:03.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.697+0000 7f9f1d600640 1 -- 172.21.15.73:0/1111452551 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f140bd020 con 0x7f9f2006fbd0 2024-04-15T15:32:03.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.697+0000 7f9f1d600640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f000683b0 0x7f9f0006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:03.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.697+0000 7f9f1d600640 1 -- 172.21.15.73:0/1111452551 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9f14121070 con 0x7f9f2006fbd0 2024-04-15T15:32:03.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.697+0000 7f9f24a00640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f000683b0 0x7f9f0006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:03.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.697+0000 7f9f24a00640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f000683b0 0x7f9f0006a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9f2016cc10 tx=0x7f9f0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:03.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.701+0000 7f9f1d600640 1 -- 172.21.15.73:0/1111452551 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f140c6030 con 0x7f9f2006fbd0 2024-04-15T15:32:03.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.861+0000 7f9f27e00640 1 -- 172.21.15.73:0/1111452551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f200b2030 con 0x7f9f2006fbd0 2024-04-15T15:32:03.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.861+0000 7f9f1d600640 1 -- 172.21.15.73:0/1111452551 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f9f140a8050 con 0x7f9f2006fbd0 2024-04-15T15:32:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:03.863 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:31:38.883320+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.861+0000 7f9f27e00640 1 -- 172.21.15.73:0/1111452551 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f000683b0 msgr2=0x7f9f0006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.861+0000 7f9f27e00640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f000683b0 0x7f9f0006a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9f2016cc10 tx=0x7f9f0c008040 comp rx=0 tx=0).stop 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.861+0000 7f9f27e00640 1 -- 172.21.15.73:0/1111452551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f2006fbd0 msgr2=0x7f9f201559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.861+0000 7f9f27e00640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f2006fbd0 0x7f9f201559b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9f140ad040 tx=0x7f9f1401ac90 comp rx=0 tx=0).stop 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.865+0000 7f9f27e00640 1 -- 172.21.15.73:0/1111452551 shutdown_connections 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.865+0000 7f9f27e00640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20162a80 0x7f9f20158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.865+0000 7f9f27e00640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f000683b0 0x7f9f0006a870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.865+0000 7f9f27e00640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f200b3e30 0x7f9f2015c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.865+0000 7f9f27e00640 1 --2- 172.21.15.73:0/1111452551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f2006fbd0 0x7f9f201559b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.865+0000 7f9f27e00640 1 -- 172.21.15.73:0/1111452551 >> 172.21.15.73:0/1111452551 conn(0x7f9f20067dd0 msgr2=0x7f9f200b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.865+0000 7f9f27e00640 1 -- 172.21.15.73:0/1111452551 shutdown_connections 2024-04-15T15:32:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:03.865+0000 7f9f27e00640 1 -- 172.21.15.73:0/1111452551 wait complete. 2024-04-15T15:32:03.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:32:04.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.017+0000 7ff151400640 1 Processor -- start 2024-04-15T15:32:04.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.017+0000 7ff151400640 1 -- start start 2024-04-15T15:32:04.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.017+0000 7ff151400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff14c15b5d0 0x7ff14c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff151400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff14c070160 con 0x7ff14c0b3e30 2024-04-15T15:32:04.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff151400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff14c15f1f0 con 0x7ff14c0b27c0 2024-04-15T15:32:04.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff151400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff14c15b9b0 con 0x7ff14c15b5d0 2024-04-15T15:32:04.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff14a800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff14c15b5d0 0x7ff14c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff141e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff14c0b3e30 0x7ff14c0b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53188/0 (socket says 172.21.15.73:53188) 2024-04-15T15:32:04.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff141e00640 1 -- 172.21.15.73:0/3939918779 learned_addr learned my addr 172.21.15.73:0/3939918779 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:04.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff14a800640 1 -- 172.21.15.73:0/3939918779 >> v1:172.21.15.118:6789/0 conn(0x7ff14c0b27c0 legacy=0x7ff14c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:04.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff14a800640 1 -- 172.21.15.73:0/3939918779 >> v1:172.21.15.73:6789/0 conn(0x7ff14c0b3e30 legacy=0x7ff14c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff14a800640 1 -- 172.21.15.73:0/3939918779 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c06fe80 con 0x7ff14c15b5d0 2024-04-15T15:32:04.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff149e00640 1 -- 172.21.15.73:0/3939918779 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 144169667 0 0) 0x7ff14c070160 con 0x7ff14c0b3e30 2024-04-15T15:32:04.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff14a800640 1 --2- 172.21.15.73:0/3939918779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 0x7ff14c15fc90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0097f0 tx=0x7ff13c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e699bf63d564fbef server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:04.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff149e00640 1 -- 172.21.15.73:0/3939918779 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0b0070 con 0x7ff14c15b5d0 2024-04-15T15:32:04.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff149e00640 1 -- 172.21.15.73:0/3939918779 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13c0ab600 con 0x7ff14c15b5d0 2024-04-15T15:32:04.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.021+0000 7ff149e00640 1 -- 172.21.15.73:0/3939918779 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0ab9d0 con 0x7ff14c15b5d0 2024-04-15T15:32:04.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 -- 172.21.15.73:0/3939918779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 msgr2=0x7ff14c15fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 --2- 172.21.15.73:0/3939918779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 0x7ff14c15fc90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0097f0 tx=0x7ff13c01c2e0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 -- 172.21.15.73:0/3939918779 shutdown_connections 2024-04-15T15:32:04.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 --2- 172.21.15.73:0/3939918779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 0x7ff14c15fc90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 -- 172.21.15.73:0/3939918779 >> 172.21.15.73:0/3939918779 conn(0x7ff14c067dd0 msgr2=0x7ff14c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:04.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 -- 172.21.15.73:0/3939918779 shutdown_connections 2024-04-15T15:32:04.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 -- 172.21.15.73:0/3939918779 wait complete. 2024-04-15T15:32:04.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 Processor -- start 2024-04-15T15:32:04.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 -- start start 2024-04-15T15:32:04.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14c0b27c0 0x7ff14c142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff14c0b3e30 0x7ff14c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 0x7ff14c154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c06faa0 con 0x7ff14c15b5d0 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c0cfd00 con 0x7ff14c0b3e30 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff151400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff14c06fc20 con 0x7ff14c0b27c0 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff14b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 0x7ff14c154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff14b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 0x7ff14c154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59024/0 (socket says 172.21.15.73:59024) 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff14b200640 1 -- 172.21.15.73:0/251037340 learned_addr learned my addr 172.21.15.73:0/251037340 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff14a800640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14c0b27c0 0x7ff14c142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.025+0000 7ff141e00640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff14c0b3e30 0x7ff14c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff14b200640 1 -- 172.21.15.73:0/251037340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14c0b27c0 msgr2=0x7ff14c142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff14b200640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14c0b27c0 0x7ff14c142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff14b200640 1 -- 172.21.15.73:0/251037340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff14c0b3e30 msgr2=0x7ff14c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff14b200640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff14c0b3e30 0x7ff14c0b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff14b200640 1 -- 172.21.15.73:0/251037340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c15c9e0 con 0x7ff14c15b5d0 2024-04-15T15:32:04.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff14b200640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 0x7ff14c154cd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff14400b9e0 tx=0x7ff14400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:04.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff143400640 1 -- 172.21.15.73:0/251037340 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144003b80 con 0x7ff14c15b5d0 2024-04-15T15:32:04.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff143400640 1 -- 172.21.15.73:0/251037340 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff144003d20 con 0x7ff14c15b5d0 2024-04-15T15:32:04.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff143400640 1 -- 172.21.15.73:0/251037340 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14400cb60 con 0x7ff14c15b5d0 2024-04-15T15:32:04.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff151400640 1 -- 172.21.15.73:0/251037340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14c15ccc0 con 0x7ff14c15b5d0 2024-04-15T15:32:04.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff151400640 1 -- 172.21.15.73:0/251037340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14c15d280 con 0x7ff14c15b5d0 2024-04-15T15:32:04.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff151400640 1 -- 172.21.15.73:0/251037340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff14c068ab0 con 0x7ff14c15b5d0 2024-04-15T15:32:04.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff143400640 1 -- 172.21.15.73:0/251037340 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff144006d10 con 0x7ff14c15b5d0 2024-04-15T15:32:04.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff143400640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff1280683b0 0x7ff12806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff143400640 1 -- 172.21.15.73:0/251037340 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff144086800 con 0x7ff14c15b5d0 2024-04-15T15:32:04.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.029+0000 7ff14a800640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff1280683b0 0x7ff12806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.033+0000 7ff14a800640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff1280683b0 0x7ff12806a870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0ad000 tx=0x7ff13c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:04.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.033+0000 7ff143400640 1 -- 172.21.15.73:0/251037340 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff144056390 con 0x7ff14c15b5d0 2024-04-15T15:32:04.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.221+0000 7ff151400640 1 -- 172.21.15.73:0/251037340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff14c0adee0 con 0x7ff14c15b5d0 2024-04-15T15:32:04.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff143400640 1 -- 172.21.15.73:0/251037340 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7ff14405a690 con 0x7ff14c15b5d0 2024-04-15T15:32:04.225 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:04.225 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:31:33.826027+0000","modified":"2024-04-15T15:31:52.268632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-15T15:32:04.226 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-04-15T15:32:04.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 -- 172.21.15.73:0/251037340 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff1280683b0 msgr2=0x7ff12806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff1280683b0 0x7ff12806a870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0ad000 tx=0x7ff13c0a6000 comp rx=0 tx=0).stop 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 -- 172.21.15.73:0/251037340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 msgr2=0x7ff14c154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 0x7ff14c154cd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff14400b9e0 tx=0x7ff14400bea0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 -- 172.21.15.73:0/251037340 shutdown_connections 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14c15b5d0 0x7ff14c154cd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff14c0b3e30 0x7ff14c0b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff1280683b0 0x7ff12806a870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 --2- 172.21.15.73:0/251037340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14c0b27c0 0x7ff14c142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 -- 172.21.15.73:0/251037340 >> 172.21.15.73:0/251037340 conn(0x7ff14c067dd0 msgr2=0x7ff14c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 -- 172.21.15.73:0/251037340 shutdown_connections 2024-04-15T15:32:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.225+0000 7ff151400640 1 -- 172.21.15.73:0/251037340 wait complete. 2024-04-15T15:32:04.648 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T15:31:33.826027+0000', 'modified': '2024-04-15T15:31:52.268632+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/2095978965', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 2095978965}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2095978965}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4281, 'qdb_cluster': [4281]} 2024-04-15T15:32:04.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-15T15:32:04.649 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-15T15:32:04.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4baa00640 1 Processor -- start 2024-04-15T15:32:04.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4baa00640 1 -- start start 2024-04-15T15:32:04.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4baa00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4b415c680 0x7fe4b415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4baa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe4b40ce4e0 0x7fe4b41601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4baa00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4b415ca60 con 0x7fe4b40b0b40 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4baa00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b40cd010 con 0x7fe4b415c680 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4baa00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b40cd2f0 con 0x7fe4b40ce4e0 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4b9600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4b415c680 0x7fe4b415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4b8c00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe4b40b0b40 0x7fe4b40cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53198/0 (socket says 172.21.15.73:53198) 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4b8c00640 1 -- 172.21.15.73:0/3789054402 learned_addr learned my addr 172.21.15.73:0/3789054402 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4ba000640 1 --2- 172.21.15.73:0/3789054402 >> v2:172.21.15.118:3300/0 conn(0x7fe4b40ce4e0 0x7fe4b41601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4b9600640 1 -- 172.21.15.73:0/3789054402 >> v2:172.21.15.118:3300/0 conn(0x7fe4b40ce4e0 msgr2=0x7fe4b41601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4b9600640 1 --2- 172.21.15.73:0/3789054402 >> v2:172.21.15.118:3300/0 conn(0x7fe4b40ce4e0 0x7fe4b41601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4b9600640 1 -- 172.21.15.73:0/3789054402 >> v1:172.21.15.73:6789/0 conn(0x7fe4b40b0b40 legacy=0x7fe4b40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4b3e00640 1 -- 172.21.15.73:0/3789054402 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665810716 0 0) 0x7fe4b415ca60 con 0x7fe4b40b0b40 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4b9600640 1 -- 172.21.15.73:0/3789054402 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b40cd5d0 con 0x7fe4b415c680 2024-04-15T15:32:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.785+0000 7fe4ba000640 1 --2- 172.21.15.73:0/3789054402 >> v2:172.21.15.118:3300/0 conn(0x7fe4b40ce4e0 0x7fe4b41601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:04.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4b9600640 1 --2- 172.21.15.73:0/3789054402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b415c680 0x7fe4b415d660 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4073e40 tx=0x7fe4a801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2802cbdcff21b139 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:04.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4b3e00640 1 -- 172.21.15.73:0/3789054402 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80b2070 con 0x7fe4b415c680 2024-04-15T15:32:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4b3e00640 1 -- 172.21.15.73:0/3789054402 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a80ad680 con 0x7fe4b415c680 2024-04-15T15:32:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4b3e00640 1 -- 172.21.15.73:0/3789054402 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80ada50 con 0x7fe4b415c680 2024-04-15T15:32:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4baa00640 1 -- 172.21.15.73:0/3789054402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b415c680 msgr2=0x7fe4b415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4baa00640 1 --2- 172.21.15.73:0/3789054402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b415c680 0x7fe4b415d660 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4073e40 tx=0x7fe4a801c3c0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4baa00640 1 -- 172.21.15.73:0/3789054402 shutdown_connections 2024-04-15T15:32:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4baa00640 1 --2- 172.21.15.73:0/3789054402 >> v2:172.21.15.118:3300/0 conn(0x7fe4b40ce4e0 0x7fe4b41601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4baa00640 1 --2- 172.21.15.73:0/3789054402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b415c680 0x7fe4b415d660 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4baa00640 1 -- 172.21.15.73:0/3789054402 >> 172.21.15.73:0/3789054402 conn(0x7fe4b40b2e90 msgr2=0x7fe4b40b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4baa00640 1 -- 172.21.15.73:0/3789054402 shutdown_connections 2024-04-15T15:32:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.789+0000 7fe4baa00640 1 -- 172.21.15.73:0/3789054402 wait complete. 2024-04-15T15:32:04.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4baa00640 1 Processor -- start 2024-04-15T15:32:04.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4baa00640 1 -- start start 2024-04-15T15:32:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4baa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b40b0b40 0x7fe4b41f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4baa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b40ce4e0 0x7fe4b40d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4baa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b415c680 0x7fe4b4166760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4baa00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b41694c0 con 0x7fe4b40ce4e0 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4baa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b4169340 con 0x7fe4b415c680 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4baa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b4169640 con 0x7fe4b40b0b40 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b40ce4e0 0x7fe4b40d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b40ce4e0 0x7fe4b40d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59040/0 (socket says 172.21.15.73:59040) 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b8c00640 1 -- 172.21.15.73:0/4232481943 learned_addr learned my addr 172.21.15.73:0/4232481943 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b9600640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b40b0b40 0x7fe4b41f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4ba000640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b415c680 0x7fe4b4166760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b8c00640 1 -- 172.21.15.73:0/4232481943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b40b0b40 msgr2=0x7fe4b41f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b40b0b40 0x7fe4b41f6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b8c00640 1 -- 172.21.15.73:0/4232481943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b415c680 msgr2=0x7fe4b4166760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b415c680 0x7fe4b4166760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b8c00640 1 -- 172.21.15.73:0/4232481943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b41f7150 con 0x7fe4b40ce4e0 2024-04-15T15:32:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b9600640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b40b0b40 0x7fe4b41f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:04.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4ba000640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b415c680 0x7fe4b4166760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:04.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b40ce4e0 0x7fe4b40d0050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c4d0 tx=0x7fe4a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:04.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b1600640 1 -- 172.21.15.73:0/4232481943 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0018070 con 0x7fe4b40ce4e0 2024-04-15T15:32:04.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b1600640 1 -- 172.21.15.73:0/4232481943 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a00074e0 con 0x7fe4b40ce4e0 2024-04-15T15:32:04.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4b1600640 1 -- 172.21.15.73:0/4232481943 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0004a30 con 0x7fe4b40ce4e0 2024-04-15T15:32:04.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4baa00640 1 -- 172.21.15.73:0/4232481943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b41fa930 con 0x7fe4b40ce4e0 2024-04-15T15:32:04.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.793+0000 7fe4baa00640 1 -- 172.21.15.73:0/4232481943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b41faef0 con 0x7fe4b40ce4e0 2024-04-15T15:32:04.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4b1600640 1 -- 172.21.15.73:0/4232481943 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4a0004bd0 con 0x7fe4b40ce4e0 2024-04-15T15:32:04.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4b1600640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe494068380 0x7fe49406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4b1600640 1 -- 172.21.15.73:0/4232481943 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe4a0085fe0 con 0x7fe4b40ce4e0 2024-04-15T15:32:04.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4b9600640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe494068380 0x7fe49406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4bf528000 1 Processor -- start 2024-04-15T15:32:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4bf528000 1 -- start start 2024-04-15T15:32:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4b9600640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe494068380 0x7fe49406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80af000 tx=0x7fe4a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b48e0 0x5597e61b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b5200 0x5597e61680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e61689c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4bf528000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5597e5fb9290 con 0x5597e61b5200 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4bf528000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5597e5f54bd0 con 0x5597e61b48e0 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4bf528000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x5597e5fb5250 con 0x5597e61685e0 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b5200 0x5597e61680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b5200 0x5597e61680a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59044/0 (socket says 172.21.15.73:59044) 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.797+0000 7fe4b8c00640 1 -- 172.21.15.73:0/1275477930 learned_addr learned my addr 172.21.15.73:0/1275477930 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 -- 172.21.15.73:0/1275477930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 msgr2=0x5597e61689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/1275477930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e61689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 -- 172.21.15.73:0/1275477930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b48e0 msgr2=0x5597e61b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/1275477930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b48e0 0x5597e61b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 -- 172.21.15.73:0/1275477930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597e5ffe520 con 0x5597e61b5200 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/1275477930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b5200 0x5597e61680a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe4a005e260 tx=0x7fe4a0051e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b82a7cf2fa4c2e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4a6000640 1 -- 172.21.15.73:0/1275477930 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a006e170 con 0x5597e61b5200 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4a6000640 1 -- 172.21.15.73:0/1275477930 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a005e790 con 0x5597e61b5200 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4a6000640 1 -- 172.21.15.73:0/1275477930 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0052220 con 0x5597e61b5200 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 -- 172.21.15.73:0/1275477930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b5200 msgr2=0x5597e61680a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 --2- 172.21.15.73:0/1275477930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b5200 0x5597e61680a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe4a005e260 tx=0x7fe4a0051e50 comp rx=0 tx=0).stop 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 -- 172.21.15.73:0/1275477930 shutdown_connections 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 --2- 172.21.15.73:0/1275477930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e61689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 --2- 172.21.15.73:0/1275477930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b5200 0x5597e61680a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 --2- 172.21.15.73:0/1275477930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b48e0 0x5597e61b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 -- 172.21.15.73:0/1275477930 >> 172.21.15.73:0/1275477930 conn(0x5597e6052510 msgr2=0x5597e61978a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:04.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 -- 172.21.15.73:0/1275477930 shutdown_connections 2024-04-15T15:32:04.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 -- 172.21.15.73:0/1275477930 wait complete. 2024-04-15T15:32:04.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 -- start start 2024-04-15T15:32:04.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 Processor -- start 2024-04-15T15:32:04.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e6198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6199400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 0x5597e6199940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5597e5f75530 con 0x5597e61b48e0 2024-04-15T15:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5597e603a140 con 0x5597e61b5200 2024-04-15T15:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x5597e6173a30 con 0x5597e61685e0 2024-04-15T15:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4bf528000 10 client.0 _ll_register_callbacks cb 0x5597e6155fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59054/0 (socket says 172.21.15.73:59054) 2024-04-15T15:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 -- 172.21.15.73:0/3161691704 learned_addr learned my addr 172.21.15.73:0/3161691704 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:04.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b9600640 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e6198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4ba000640 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 0x5597e6199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 -- 172.21.15.73:0/3161691704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 msgr2=0x5597e6198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e6198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 -- 172.21.15.73:0/3161691704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 msgr2=0x5597e6199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 0x5597e6199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4b8c00640 1 -- 172.21.15.73:0/3161691704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597e5f5c940 con 0x5597e61b48e0 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.801+0000 7fe4ba000640 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 0x5597e6199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6199400 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0053e60 tx=0x7fe4a0058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c69b52d4e450673 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe49aa00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe49aa00640 1 -- 172.21.15.73:0/3161691704 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0074060 con 0x5597e61b48e0 2024-04-15T15:32:04.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe49aa00640 1 -- 172.21.15.73:0/3161691704 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe4a007dd80 con 0x5597e61b48e0 2024-04-15T15:32:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 -- 172.21.15.73:0/3161691704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4a005e790 con 0x5597e61b48e0 2024-04-15T15:32:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe49aa00640 1 -- 172.21.15.73:0/3161691704 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe4a007b050 con 0x5597e61b48e0 2024-04-15T15:32:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 10 client.4815 fetch_fsmap learned FSMap version 9 2024-04-15T15:32:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 -- 172.21.15.73:0/3161691704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5597e5f3fe80 con 0x5597e61b48e0 2024-04-15T15:32:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe49aa00640 1 -- 172.21.15.73:0/3161691704 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a005e790 con 0x5597e61b48e0 2024-04-15T15:32:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe49aa00640 1 -- 172.21.15.73:0/3161691704 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7fe4a0055000 con 0x5597e61b48e0 2024-04-15T15:32:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 10 client.4815 fetch_fsmap finished waiting for FSMap version 9 2024-04-15T15:32:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 10 client.4815 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-15T15:32:04.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 20 client.4815 populate_metadata read hostname 'smithi073' 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x5597e619a1b0 0x5597e61c6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 4 client.4815 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 -- 172.21.15.73:0/3161691704 --> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597e5f52bc0 con 0x5597e619a1b0 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4b9600640 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x5597e619a1b0 0x5597e61c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe49aa00640 10 client.4815 ms_handle_connect on v2:172.21.15.73:6834/2095978965 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4b9600640 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x5597e619a1b0 0x5597e61c6060 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbc11287924dc118 server_cookie=f3dc98f7e00eebf7 in_seq=0 out_seq=0 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe49aa00640 1 -- 172.21.15.73:0/3161691704 <== mds.0 v2:172.21.15.73:6834/2095978965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5597e5f52bc0 con 0x5597e619a1b0 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe49aa00640 10 client.4815 handle_command_reply: tid=0 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 client.4815 shutdown 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 -- 172.21.15.73:0/3161691704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 msgr2=0x5597e6199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6199400 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0053e60 tx=0x7fe4a0058000 comp rx=0 tx=0).stop 2024-04-15T15:32:04.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 -- 172.21.15.73:0/3161691704 shutdown_connections 2024-04-15T15:32:04.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x5597e619a1b0 0x5597e61c6060 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 0x5597e6199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6199400 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 --2- 172.21.15.73:0/3161691704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e6198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe49aa00640 0 client.4815 ms_handle_reset on v2:172.21.15.73:6834/2095978965 2024-04-15T15:32:04.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 -- 172.21.15.73:0/3161691704 >> 172.21.15.73:0/3161691704 conn(0x5597e6052510 msgr2=0x5597e61677a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:04.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 -- 172.21.15.73:0/3161691704 shutdown_connections 2024-04-15T15:32:04.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 1 -- 172.21.15.73:0/3161691704 wait complete. 2024-04-15T15:32:04.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.805+0000 7fe4bf528000 20 client.4815 trim_cache size 0 max 16384 2024-04-15T15:32:04.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 Processor -- start 2024-04-15T15:32:04.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 -- start start 2024-04-15T15:32:04.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e61c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 0x5597e6167450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b4204340 con 0x5597e61b48e0 2024-04-15T15:32:04.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b42036a0 con 0x5597e61b5200 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b4203cf0 con 0x5597e61685e0 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6166f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59062/0 (socket says 172.21.15.73:59062) 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4b8c00640 1 -- 172.21.15.73:0/1368894239 learned_addr learned my addr 172.21.15.73:0/1368894239 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4b9600640 1 --2- 172.21.15.73:0/1368894239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e61c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4ba000640 1 --2- 172.21.15.73:0/1368894239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 0x5597e6167450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4b8c00640 1 -- 172.21.15.73:0/1368894239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 msgr2=0x5597e61c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/1368894239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e61c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4b8c00640 1 -- 172.21.15.73:0/1368894239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 msgr2=0x5597e6167450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/1368894239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 0x5597e6167450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4b8c00640 1 -- 172.21.15.73:0/1368894239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597e603a5d0 con 0x5597e61b48e0 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/1368894239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6166f10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0055b40 tx=0x7fe4a0081000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42b5d10e52bb1fa server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:04.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4a5600640 1 -- 172.21.15.73:0/1368894239 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a005e790 con 0x5597e61b48e0 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4a5600640 1 -- 172.21.15.73:0/1368894239 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a0055bb0 con 0x5597e61b48e0 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4a5600640 1 -- 172.21.15.73:0/1368894239 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a007ddc0 con 0x5597e61b48e0 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 -- 172.21.15.73:0/1368894239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 msgr2=0x5597e6166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 --2- 172.21.15.73:0/1368894239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6166f10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0055b40 tx=0x7fe4a0081000 comp rx=0 tx=0).stop 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 -- 172.21.15.73:0/1368894239 shutdown_connections 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 --2- 172.21.15.73:0/1368894239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61b5200 0x5597e6167450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 --2- 172.21.15.73:0/1368894239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e6166f10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 --2- 172.21.15.73:0/1368894239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61685e0 0x5597e61c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 -- 172.21.15.73:0/1368894239 >> 172.21.15.73:0/1368894239 conn(0x5597e6052510 msgr2=0x5597e6166800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 -- 172.21.15.73:0/1368894239 shutdown_connections 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 -- 172.21.15.73:0/1368894239 wait complete. 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 -- start start 2024-04-15T15:32:04.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.825+0000 7fe4bf528000 1 Processor -- start 2024-04-15T15:32:04.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61685e0 0x5597e61c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e61dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61b5200 0x5597e61e0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5597e5f75530 con 0x5597e61b48e0 2024-04-15T15:32:04.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5597e6173a30 con 0x5597e61685e0 2024-04-15T15:32:04.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x5597e603a140 con 0x5597e61b5200 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 10 client.0 _ll_register_callbacks cb 0x7fe4a006d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e61dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e61dfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59068/0 (socket says 172.21.15.73:59068) 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b8c00640 1 -- 172.21.15.73:0/378901987 learned_addr learned my addr 172.21.15.73:0/378901987 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b9600640 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61685e0 0x5597e61c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4ba000640 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61b5200 0x5597e61e0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b8c00640 1 -- 172.21.15.73:0/378901987 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61b5200 msgr2=0x5597e61e0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61b5200 0x5597e61e0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b8c00640 1 -- 172.21.15.73:0/378901987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61685e0 msgr2=0x5597e61c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61685e0 0x5597e61c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b8c00640 1 -- 172.21.15.73:0/378901987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597e60116e0 con 0x5597e61b48e0 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4ba000640 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61b5200 0x5597e61e0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b8c00640 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e61dfbf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c4a0 tx=0x7fe4a0058070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629a057ad154f24b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:04.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe49aa00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe49aa00640 1 -- 172.21.15.73:0/378901987 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a005e790 con 0x5597e61b48e0 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe49aa00640 1 -- 172.21.15.73:0/378901987 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe4a0051900 con 0x5597e61b48e0 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- 172.21.15.73:0/378901987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4a0055bb0 con 0x5597e61b48e0 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe49aa00640 1 -- 172.21.15.73:0/378901987 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe4a0067050 con 0x5597e61b48e0 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 10 client.4821 fetch_fsmap learned FSMap version 9 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- 172.21.15.73:0/378901987 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5597e5f5e260 con 0x5597e61b48e0 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe49aa00640 1 -- 172.21.15.73:0/378901987 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a0055bb0 con 0x5597e61b48e0 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe49aa00640 1 -- 172.21.15.73:0/378901987 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7fe4a006a020 con 0x5597e61b48e0 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 10 client.4821 fetch_fsmap finished waiting for FSMap version 9 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 10 client.4821 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 20 client.4821 populate_metadata read hostname 'smithi073' 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x5597e6223650 0x5597e6223a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:04.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 4 client.4821 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- 172.21.15.73:0/378901987 --> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] -- command(tid 0: {"prefix": "status"}) -- 0x5597e5fc6cb0 con 0x5597e6223650 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b9600640 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x5597e6223650 0x5597e6223a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4b9600640 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x5597e6223650 0x5597e6223a30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1e9016b2917f434 server_cookie=d241e24afddb32d7 in_seq=0 out_seq=0 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe49aa00640 10 client.4821 ms_handle_connect on v2:172.21.15.73:6834/2095978965 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe49aa00640 1 -- 172.21.15.73:0/378901987 <== mds.0 v2:172.21.15.73:6834/2095978965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5597e5fc6cb0 con 0x5597e6223650 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe49aa00640 10 client.4821 handle_command_reply: tid=0 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 client.4821 shutdown 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- 172.21.15.73:0/378901987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 msgr2=0x5597e61dfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e61dfbf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c4a0 tx=0x7fe4a0058070 comp rx=0 tx=0).stop 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- 172.21.15.73:0/378901987 shutdown_connections 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.73:6834/2095978965,v1:172.21.15.73:6837/2095978965] conn(0x5597e6223650 0x5597e6223a30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5597e61b5200 0x5597e61e0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597e61b48e0 0x5597e61dfbf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe49aa00640 0 client.4821 ms_handle_reset on v2:172.21.15.73:6834/2095978965 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 --2- 172.21.15.73:0/378901987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5597e61685e0 0x5597e61c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- 172.21.15.73:0/378901987 >> 172.21.15.73:0/378901987 conn(0x5597e6052510 msgr2=0x5597e6167090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- 172.21.15.73:0/378901987 shutdown_connections 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.829+0000 7fe4bf528000 1 -- 172.21.15.73:0/378901987 wait complete. 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4bf528000 20 client.4821 trim_cache size 0 max 16384 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "a72de584-7db8-4f62-b310-5ee655143eeb", 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4281, 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-04-15T15:32:04.840 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-04-15T15:32:04.841 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-04-15T15:32:04.841 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 30.396260265999999, 2024-04-15T15:32:04.841 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 9, 2024-04-15T15:32:04.841 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 25, 2024-04-15T15:32:04.841 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 25, 2024-04-15T15:32:04.841 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 37.930205874000002 2024-04-15T15:32:04.841 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:32:04.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 -- 172.21.15.73:0/4232481943 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe494068380 msgr2=0x7fe49406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe494068380 0x7fe49406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80af000 tx=0x7fe4a8008040 comp rx=0 tx=0).stop 2024-04-15T15:32:04.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 -- 172.21.15.73:0/4232481943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b40ce4e0 msgr2=0x7fe4b40d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:04.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b40ce4e0 0x7fe4b40d0050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c4d0 tx=0x7fe4a000c990 comp rx=0 tx=0).stop 2024-04-15T15:32:04.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 -- 172.21.15.73:0/4232481943 shutdown_connections 2024-04-15T15:32:04.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b415c680 0x7fe4b4166760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b40ce4e0 0x7fe4b40d0050 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe494068380 0x7fe49406a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 --2- 172.21.15.73:0/4232481943 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b40b0b40 0x7fe4b41f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 -- 172.21.15.73:0/4232481943 >> 172.21.15.73:0/4232481943 conn(0x7fe4b40b2e90 msgr2=0x7fe4b406ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 -- 172.21.15.73:0/4232481943 shutdown_connections 2024-04-15T15:32:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:04.833+0000 7fe4baa00640 1 -- 172.21.15.73:0/4232481943 wait complete. 2024-04-15T15:32:04.853 INFO:teuthology.run_tasks:Running task sequential... 2024-04-15T15:32:04.863 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-15T15:32:04.863 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-15T15:32:04.863 INFO:teuthology.task.print:Enabling mgr modules 2024-04-15T15:32:04.863 INFO:teuthology.run_tasks:Running task kclient... 2024-04-15T15:32:04.884 INFO:tasks.kclient:Mounting kernel clients... 2024-04-15T15:32:04.884 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-15T15:32:04.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:04.884 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-15T15:32:04.893 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-15T15:32:04.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:04.894 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T15:32:04.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:04.956 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-04-15T15:32:05.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:05.135 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-15T15:32:05.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:05.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-04-15T15:32:05.210 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-04-15T15:32:05.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:32:05.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:05.212 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-04-15T15:32:05.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:05.222 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-04-15T15:32:05.288 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2024-04-15T15:32:05.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:32:05.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:05.290 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-04-15T15:32:05.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:05.345 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-04-15T15:32:05.412 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2024-04-15T15:32:05.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:32:05.414 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-15T15:32:05.414 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T15:32:05.414 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T15:32:05.415 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:32:05.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8f1c00640 1 Processor -- start 2024-04-15T15:32:05.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8f1c00640 1 -- start start 2024-04-15T15:32:05.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8f1c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd8ec0b2530 0x7fd8ec15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:05.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8f1c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8ec0cd3a0 con 0x7fd8ec146110 2024-04-15T15:32:05.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8f1c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8ec0b5160 con 0x7fd8ec0b20b0 2024-04-15T15:32:05.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8f1c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd8ec0b40c0 con 0x7fd8ec0b2530 2024-04-15T15:32:05.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8eaa00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd8ec146110 0x7fd8ec0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53208/0 (socket says 172.21.15.73:53208) 2024-04-15T15:32:05.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8eaa00640 1 -- 172.21.15.73:0/3823218894 learned_addr learned my addr 172.21.15.73:0/3823218894 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:05.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8eb400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd8ec0b2530 0x7fd8ec15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:05.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8eb400640 1 -- 172.21.15.73:0/3823218894 >> v1:172.21.15.118:6789/0 conn(0x7fd8ec0b20b0 legacy=0x7fd8ec15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:05.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8eb400640 1 -- 172.21.15.73:0/3823218894 >> v1:172.21.15.73:6789/0 conn(0x7fd8ec146110 legacy=0x7fd8ec0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:05.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8e9600640 1 -- 172.21.15.73:0/3823218894 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3624382995 0 0) 0x7fd8ec0cd3a0 con 0x7fd8ec146110 2024-04-15T15:32:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.553+0000 7fd8eb400640 1 -- 172.21.15.73:0/3823218894 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec0b43a0 con 0x7fd8ec0b2530 2024-04-15T15:32:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8eb400640 1 --2- 172.21.15.73:0/3823218894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 0x7fd8ec15d2e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0cf010 tx=0x7fd8e401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99d2793f2b0e7f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8e9600640 1 -- 172.21.15.73:0/3823218894 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40ab610 con 0x7fd8ec0b2530 2024-04-15T15:32:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8e9600640 1 -- 172.21.15.73:0/3823218894 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e40b0070 con 0x7fd8ec0b2530 2024-04-15T15:32:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8e9600640 1 -- 172.21.15.73:0/3823218894 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40ab9d0 con 0x7fd8ec0b2530 2024-04-15T15:32:05.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8f1c00640 1 -- 172.21.15.73:0/3823218894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 msgr2=0x7fd8ec15d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:05.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8f1c00640 1 --2- 172.21.15.73:0/3823218894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 0x7fd8ec15d2e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0cf010 tx=0x7fd8e401c410 comp rx=0 tx=0).stop 2024-04-15T15:32:05.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8f1c00640 1 -- 172.21.15.73:0/3823218894 shutdown_connections 2024-04-15T15:32:05.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8f1c00640 1 --2- 172.21.15.73:0/3823218894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 0x7fd8ec15d2e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:05.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8f1c00640 1 -- 172.21.15.73:0/3823218894 >> 172.21.15.73:0/3823218894 conn(0x7fd8ec067dd0 msgr2=0x7fd8ec0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:05.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8f1c00640 1 -- 172.21.15.73:0/3823218894 shutdown_connections 2024-04-15T15:32:05.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.557+0000 7fd8f1c00640 1 -- 172.21.15.73:0/3823218894 wait complete. 2024-04-15T15:32:05.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8f1c00640 1 Processor -- start 2024-04-15T15:32:05.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8f1c00640 1 -- start start 2024-04-15T15:32:05.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8f1c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec0b20b0 0x7fd8ec14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:05.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8f1c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 0x7fd8ec166ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:05.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8f1c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8ec146110 0x7fd8ec06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8f1c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec0b3d70 con 0x7fd8ec0b2530 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8f1c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec0b2980 con 0x7fd8ec0b20b0 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8f1c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ec15dc30 con 0x7fd8ec146110 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8ea000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 0x7fd8ec166ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8ea000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 0x7fd8ec166ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59088/0 (socket says 172.21.15.73:59088) 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8ea000640 1 -- 172.21.15.73:0/2053408019 learned_addr learned my addr 172.21.15.73:0/2053408019 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8ea000640 1 -- 172.21.15.73:0/2053408019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8ec146110 msgr2=0x7fd8ec06fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8ea000640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8ec146110 0x7fd8ec06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8ea000640 1 -- 172.21.15.73:0/2053408019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec0b20b0 msgr2=0x7fd8ec14f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8ea000640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec0b20b0 0x7fd8ec14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8ea000640 1 -- 172.21.15.73:0/2053408019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec164610 con 0x7fd8ec0b2530 2024-04-15T15:32:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8ea000640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 0x7fd8ec166ef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800c450 tx=0x7fd8d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8e2a00640 1 -- 172.21.15.73:0/2053408019 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8012830 con 0x7fd8ec0b2530 2024-04-15T15:32:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8e2a00640 1 -- 172.21.15.73:0/2053408019 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8017070 con 0x7fd8ec0b2530 2024-04-15T15:32:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8e2a00640 1 -- 172.21.15.73:0/2053408019 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8012c30 con 0x7fd8ec0b2530 2024-04-15T15:32:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8f1c00640 1 -- 172.21.15.73:0/2053408019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ec1648f0 con 0x7fd8ec0b2530 2024-04-15T15:32:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.561+0000 7fd8f1c00640 1 -- 172.21.15.73:0/2053408019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ec164eb0 con 0x7fd8ec0b2530 2024-04-15T15:32:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.565+0000 7fd8f1c00640 1 -- 172.21.15.73:0/2053408019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8ec068ab0 con 0x7fd8ec0b2530 2024-04-15T15:32:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.565+0000 7fd8e2a00640 1 -- 172.21.15.73:0/2053408019 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd8d801c460 con 0x7fd8ec0b2530 2024-04-15T15:32:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.565+0000 7fd8e2a00640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd8cc068380 0x7fd8cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.565+0000 7fd8e2a00640 1 -- 172.21.15.73:0/2053408019 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd8d8086bd0 con 0x7fd8ec0b2530 2024-04-15T15:32:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.565+0000 7fd8eaa00640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd8cc068380 0x7fd8cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.565+0000 7fd8eaa00640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd8cc068380 0x7fd8cc06a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec1fabb0 tx=0x7fd8dc007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:05.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.569+0000 7fd8e2a00640 1 -- 172.21.15.73:0/2053408019 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd8d8056db0 con 0x7fd8ec0b2530 2024-04-15T15:32:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.761+0000 7fd8f1c00640 1 -- 172.21.15.73:0/2053408019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd8ec165080 con 0x7fd8ec0b2530 2024-04-15T15:32:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8e2a00640 1 -- 172.21.15.73:0/2053408019 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fd8d80566b0 con 0x7fd8ec0b2530 2024-04-15T15:32:05.765 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-15T15:32:05.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 -- 172.21.15.73:0/2053408019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd8cc068380 msgr2=0x7fd8cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:05.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd8cc068380 0x7fd8cc06a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec1fabb0 tx=0x7fd8dc007cf0 comp rx=0 tx=0).stop 2024-04-15T15:32:05.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 -- 172.21.15.73:0/2053408019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 msgr2=0x7fd8ec166ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:05.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 0x7fd8ec166ef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800c450 tx=0x7fd8d800c910 comp rx=0 tx=0).stop 2024-04-15T15:32:05.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 -- 172.21.15.73:0/2053408019 shutdown_connections 2024-04-15T15:32:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd8cc068380 0x7fd8cc06a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8ec146110 0x7fd8ec06fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec0b2530 0x7fd8ec166ef0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 --2- 172.21.15.73:0/2053408019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec0b20b0 0x7fd8ec14f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 -- 172.21.15.73:0/2053408019 >> 172.21.15.73:0/2053408019 conn(0x7fd8ec067dd0 msgr2=0x7fd8ec0cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 -- 172.21.15.73:0/2053408019 shutdown_connections 2024-04-15T15:32:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05.765+0000 7fd8f1c00640 1 -- 172.21.15.73:0/2053408019 wait complete. 2024-04-15T15:32:05.786 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-15T15:32:05.786 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:32:05.786 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-04-15T15:32:05.786 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-15T15:32:05.786 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T15:32:05.786 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-15T15:32:05.787 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T15:32:05.787 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:32:05.787 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-15T15:32:05.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:05.787 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:05.799 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42430sec preferred_lft 42430sec 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:61:e3:76:67 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:32:05.800 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:05.801 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-15T15:32:05.801 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:05.801 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:32:05.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-04-15T15:32:05.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-04-15T15:32:05.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-04-15T15:32:05.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-15T15:32:05.801 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:32:05.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:05.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:05.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:05.955 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:32:05.974 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-04-15T15:32:05.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:05.976 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-04-15T15:32:06.028 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-04-15T15:32:06.028 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:32:06.028 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:32:06.028 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:32:06.029 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:32:06.029 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:32:06.029 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:32:06.029 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:06.029 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:06.029 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:06.029 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:32:06.029 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:06.029 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:32:06.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:32:06.030 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:32:06.030 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:32:06.030 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:32:06.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:06.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:06.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:06.169 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-15T15:32:06.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:06.178 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-04-15T15:32:06.233 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:06.233 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:32:06.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T15:32:06.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-15T15:32:06.233 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:32:06.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:06.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:06.362 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-15T15:32:06.362 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:06.363 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:32:06.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-15T15:32:06.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-15T15:32:06.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-15T15:32:06.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-15T15:32:06.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-15T15:32:06.363 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:32:06.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:06.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:06.506 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:06.506 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:32:06.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-04-15T15:32:06.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-04-15T15:32:06.506 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:32:06.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:06.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:06.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:06.631 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-15T15:32:06.680 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-15T15:32:06.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:06.681 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-15T15:32:06.737 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-15T15:32:06.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:06.737 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:32:06.828 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:32:06.828 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-15T15:32:06.828 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:32:07.400 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:32:07.400 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-15T15:32:07.400 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:32:07.400 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:07.400 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:07.413 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:32:07.414 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-15T15:32:07.414 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:32:07.414 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:07.414 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:07.414 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790" 2024-04-15T15:32:07.414 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2024-04-15T15:32:07.414 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a72de584-7db8-4f62-b310-5ee655143eeb" will pass to kernel 2024-04-15T15:32:07.418 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-15T15:32:07.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:07.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-15T15:32:07.440 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:07.543 INFO:teuthology.orchestra.run.smithi073.stdout:client4833 2024-04-15T15:32:07.543 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:07.544 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:07.552 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:07.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:07.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:07.651 INFO:teuthology.orchestra.run.smithi073.stdout:client4833 2024-04-15T15:32:07.654 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:07.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:07.709 INFO:teuthology.orchestra.run.smithi073.stdout:client4833 2024-04-15T15:32:07.709 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a72de584-7db8-4f62-b310-5ee655143eeb.client4833/status') 2024-04-15T15:32:07.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:07.810 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4833 (3)192.168.0.1:0/2878379803 2024-04-15T15:32:07.810 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2024-04-15T15:32:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2024-04-15T15:32:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2024-04-15T15:32:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:69 bytes copied, 4.8525e-05 s, 1.4 MB/s 2024-04-15T15:32:07.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:07.818 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-15T15:32:07.818 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T15:32:07.818 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-15T15:32:07.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:32:07.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980f200640 1 Processor -- start 2024-04-15T15:32:07.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980f200640 1 -- start start 2024-04-15T15:32:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98080b17a0 0x7f98080d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980f200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f980809b170 0x7f980815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980f200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98080d1000 con 0x7f980806dad0 2024-04-15T15:32:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980f200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f98080d12e0 con 0x7f980809b170 2024-04-15T15:32:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f98080d15c0 con 0x7f98080b17a0 2024-04-15T15:32:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980d200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f980809b170 0x7f980815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980d200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f980809b170 0x7f980815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37990/0 (socket says 172.21.15.73:37990) 2024-04-15T15:32:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980d200640 1 -- 172.21.15.73:0/3400666002 learned_addr learned my addr 172.21.15.73:0/3400666002 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f9807e00640 1 --2- 172.21.15.73:0/3400666002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98080b17a0 0x7f98080d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980d200640 1 -- 172.21.15.73:0/3400666002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98080b17a0 msgr2=0x7f98080d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980d200640 1 --2- 172.21.15.73:0/3400666002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98080b17a0 0x7f98080d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:07.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980d200640 1 -- 172.21.15.73:0/3400666002 >> v1:172.21.15.118:6789/0 conn(0x7f980806dad0 legacy=0x7f980809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:07.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.957+0000 7f980d200640 1 -- 172.21.15.73:0/3400666002 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98080d18a0 con 0x7f980809b170 2024-04-15T15:32:07.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f980d200640 1 --2- 172.21.15.73:0/3400666002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980809b170 0x7f980815e160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9800009e50 tx=0x7f980001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e099b539942e87a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:07.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f9807400640 1 -- 172.21.15.73:0/3400666002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980806e140 con 0x7f980809b170 2024-04-15T15:32:07.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f9807400640 1 -- 172.21.15.73:0/3400666002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98000a5780 con 0x7f980809b170 2024-04-15T15:32:07.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f9807400640 1 -- 172.21.15.73:0/3400666002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98000a5b50 con 0x7f980809b170 2024-04-15T15:32:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f980f200640 1 -- 172.21.15.73:0/3400666002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980809b170 msgr2=0x7f980815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f980f200640 1 --2- 172.21.15.73:0/3400666002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980809b170 0x7f980815e160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9800009e50 tx=0x7f980001c9f0 comp rx=0 tx=0).stop 2024-04-15T15:32:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f980f200640 1 -- 172.21.15.73:0/3400666002 shutdown_connections 2024-04-15T15:32:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f980f200640 1 --2- 172.21.15.73:0/3400666002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980809b170 0x7f980815e160 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f980f200640 1 --2- 172.21.15.73:0/3400666002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98080b17a0 0x7f98080d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f980f200640 1 -- 172.21.15.73:0/3400666002 >> 172.21.15.73:0/3400666002 conn(0x7f98080b3fe0 msgr2=0x7f98080b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f980f200640 1 -- 172.21.15.73:0/3400666002 shutdown_connections 2024-04-15T15:32:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.961+0000 7f980f200640 1 -- 172.21.15.73:0/3400666002 wait complete. 2024-04-15T15:32:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980f200640 1 Processor -- start 2024-04-15T15:32:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980f200640 1 -- start start 2024-04-15T15:32:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f980806dad0 0x7f980815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f980809b170 0x7f980815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98080b17a0 0x7f980815d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980f200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f980806fed0 con 0x7f98080b17a0 2024-04-15T15:32:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f98080b1d90 con 0x7f980806dad0 2024-04-15T15:32:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9808070050 con 0x7f980809b170 2024-04-15T15:32:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980d200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98080b17a0 0x7f980815d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980d200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98080b17a0 0x7f980815d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38000/0 (socket says 172.21.15.73:38000) 2024-04-15T15:32:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980d200640 1 -- 172.21.15.73:0/207198295 learned_addr learned my addr 172.21.15.73:0/207198295 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f9807e00640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f980806dad0 0x7f980815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f97ff400640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f980809b170 0x7f980815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980d200640 1 -- 172.21.15.73:0/207198295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f980809b170 msgr2=0x7f980815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980d200640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f980809b170 0x7f980815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980d200640 1 -- 172.21.15.73:0/207198295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f980806dad0 msgr2=0x7f980815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980d200640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f980806dad0 0x7f980815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980d200640 1 -- 172.21.15.73:0/207198295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9808160430 con 0x7f98080b17a0 2024-04-15T15:32:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980d200640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98080b17a0 0x7f980815d0d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98000af040 tx=0x7f9800019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f9804c00640 1 -- 172.21.15.73:0/207198295 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98000b8670 con 0x7f98080b17a0 2024-04-15T15:32:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f9804c00640 1 -- 172.21.15.73:0/207198295 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98000be070 con 0x7f98080b17a0 2024-04-15T15:32:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f9804c00640 1 -- 172.21.15.73:0/207198295 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98000b8a30 con 0x7f98080b17a0 2024-04-15T15:32:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980f200640 1 -- 172.21.15.73:0/207198295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9808160710 con 0x7f98080b17a0 2024-04-15T15:32:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.965+0000 7f980f200640 1 -- 172.21.15.73:0/207198295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9808160cd0 con 0x7f98080b17a0 2024-04-15T15:32:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.969+0000 7f980f200640 1 -- 172.21.15.73:0/207198295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9808068ab0 con 0x7f98080b17a0 2024-04-15T15:32:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.969+0000 7f9804c00640 1 -- 172.21.15.73:0/207198295 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98000b8bd0 con 0x7f98080b17a0 2024-04-15T15:32:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.969+0000 7f9804c00640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f97e4068380 0x7f97e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.969+0000 7f9804c00640 1 -- 172.21.15.73:0/207198295 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9800121c30 con 0x7f98080b17a0 2024-04-15T15:32:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.969+0000 7f9807e00640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f97e4068380 0x7f97e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.969+0000 7f9807e00640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f97e4068380 0x7f97e406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f97f00079a0 tx=0x7f97f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:07.973+0000 7f9804c00640 1 -- 172.21.15.73:0/207198295 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f98000c8020 con 0x7f98080b17a0 2024-04-15T15:32:08.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 -- 172.21.15.73:0/207198295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f98080d22b0 con 0x7f98080b17a0 2024-04-15T15:32:08.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f9804c00640 1 -- 172.21.15.73:0/207198295 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f98000165e0 con 0x7f98080b17a0 2024-04-15T15:32:08.165 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-15T15:32:08.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 -- 172.21.15.73:0/207198295 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f97e4068380 msgr2=0x7f97e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f97e4068380 0x7f97e406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f97f00079a0 tx=0x7f97f0008040 comp rx=0 tx=0).stop 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 -- 172.21.15.73:0/207198295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98080b17a0 msgr2=0x7f980815d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98080b17a0 0x7f980815d0d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98000af040 tx=0x7f9800019790 comp rx=0 tx=0).stop 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 -- 172.21.15.73:0/207198295 shutdown_connections 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98080b17a0 0x7f980815d0d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f97e4068380 0x7f97e406a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f980809b170 0x7f980815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 --2- 172.21.15.73:0/207198295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f980806dad0 0x7f980815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 -- 172.21.15.73:0/207198295 >> 172.21.15.73:0/207198295 conn(0x7f98080b3fe0 msgr2=0x7f9808071190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 -- 172.21.15.73:0/207198295 shutdown_connections 2024-04-15T15:32:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08.165+0000 7f980f200640 1 -- 172.21.15.73:0/207198295 wait complete. 2024-04-15T15:32:08.186 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-15T15:32:08.186 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:32:08.186 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-04-15T15:32:08.186 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-15T15:32:08.186 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-15T15:32:08.187 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-15T15:32:08.187 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T15:32:08.187 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:32:08.187 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-15T15:32:08.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:08.187 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-04-15T15:32:08.196 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:32:08.196 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:08.197 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42428sec preferred_lft 42428sec 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:61:e3:76:67 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:08.198 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-15T15:32:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-04-15T15:32:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.199 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:32:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T15:32:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-15T15:32:08.199 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:08.199 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:32:08.257 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-04-15T15:32:08.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:08.260 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-04-15T15:32:08.312 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-04-15T15:32:08.312 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:32:08.312 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:32:08.312 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:32:08.312 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:32:08.312 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:32:08.312 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:32:08.312 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:08.313 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:08.313 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:08.313 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:32:08.313 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:08.313 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:32:08.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:32:08.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:32:08.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:32:08.313 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:32:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:08.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:08.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:08.451 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-15T15:32:08.459 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-15T15:32:08.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:08.461 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-04-15T15:32:08.516 INFO:teuthology.orchestra.run.smithi073.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-15T15:32:08.517 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:08.517 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:32:08.517 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-15T15:32:08.517 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-15T15:32:08.517 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:32:08.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:08.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:08.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-15T15:32:08.662 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 22:b7:5d:c8:48:dc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::20b7:5dff:fec8:48dc/64 scope link 2024-04-15T15:32:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:08.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 22:b7:5d:c8:48:dc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.732 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::20b7:5dff:fec8:48dc/64 scope link 2024-04-15T15:32:08.733 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:08.734 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-15T15:32:08.734 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:08.734 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:32:08.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-15T15:32:08.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-15T15:32:08.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-15T15:32:08.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-15T15:32:08.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-15T15:32:08.734 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:32:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:08.915 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:08.916 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:32:08.916 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.1 up 2024-04-15T15:32:08.916 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.1 master ceph-brx 2024-04-15T15:32:08.916 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:32:09.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:09.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:09.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:09.043 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-15T15:32:09.051 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-15T15:32:09.051 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:09.051 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-15T15:32:09.100 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-15T15:32:09.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:09.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-15T15:32:09.195 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-15T15:32:09.195 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-15T15:32:09.196 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:32:09.210 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-15T15:32:09.210 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-15T15:32:09.210 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:32:09.210 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:09.211 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:09.219 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-15T15:32:09.219 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-15T15:32:09.219 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:32:09.220 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:09.220 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:09.220 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790" 2024-04-15T15:32:09.220 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2024-04-15T15:32:09.220 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=a72de584-7db8-4f62-b310-5ee655143eeb" will pass to kernel 2024-04-15T15:32:09.223 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-15T15:32:09.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:09.224 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-15T15:32:09.245 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:09.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:09.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:09.347 INFO:teuthology.orchestra.run.smithi073.stdout:client4842 2024-04-15T15:32:09.348 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:09.348 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:09.357 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:09.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:09.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:09.461 INFO:teuthology.orchestra.run.smithi073.stdout:client4842 2024-04-15T15:32:09.461 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:09.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:09.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:09.565 INFO:teuthology.orchestra.run.smithi073.stdout:client4842 2024-04-15T15:32:09.565 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a72de584-7db8-4f62-b310-5ee655143eeb.client4842/status') 2024-04-15T15:32:09.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:09.669 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4842 (3)192.168.0.2:0/4020720742 2024-04-15T15:32:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2024-04-15T15:32:09.670 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2024-04-15T15:32:09.670 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2024-04-15T15:32:09.670 INFO:teuthology.orchestra.run.smithi073.stderr:69 bytes copied, 6.5988e-05 s, 1.0 MB/s 2024-04-15T15:32:09.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:09.678 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-15T15:32:09.679 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T15:32:09.679 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-15T15:32:09.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:32:09.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedfe200640 1 Processor -- start 2024-04-15T15:32:09.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedfe200640 1 -- start start 2024-04-15T15:32:09.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedfe200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fedf80cd1b0 0x7fedf809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedfe200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedf815cab0 0x7fedf809afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedfe200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf80cd690 con 0x7fedf815c6d0 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedfe200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80cd970 con 0x7fedf815cab0 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedfe200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80cdc50 con 0x7fedf80cd1b0 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedf7e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedf815cab0 0x7fedf809afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedf7400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fedf815c6d0 0x7fedf80d0d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52514/0 (socket says 172.21.15.73:52514) 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedf7400640 1 -- 172.21.15.73:0/4232984883 learned_addr learned my addr 172.21.15.73:0/4232984883 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedeea00640 1 --2- 172.21.15.73:0/4232984883 >> v2:172.21.15.118:3300/0 conn(0x7fedf80cd1b0 0x7fedf809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedf7e00640 1 -- 172.21.15.73:0/4232984883 >> v2:172.21.15.118:3300/0 conn(0x7fedf80cd1b0 msgr2=0x7fedf809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedf7e00640 1 --2- 172.21.15.73:0/4232984883 >> v2:172.21.15.118:3300/0 conn(0x7fedf80cd1b0 0x7fedf809aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedf7e00640 1 -- 172.21.15.73:0/4232984883 >> v1:172.21.15.73:6789/0 conn(0x7fedf815c6d0 legacy=0x7fedf80d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:09.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedf7e00640 1 -- 172.21.15.73:0/4232984883 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf80cdf30 con 0x7fedf815cab0 2024-04-15T15:32:09.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedf6a00640 1 -- 172.21.15.73:0/4232984883 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538143532 0 0) 0x7fedf80cd690 con 0x7fedf815c6d0 2024-04-15T15:32:09.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.813+0000 7fedeea00640 1 --2- 172.21.15.73:0/4232984883 >> v2:172.21.15.118:3300/0 conn(0x7fedf80cd1b0 0x7fedf809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:09.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedf7e00640 1 --2- 172.21.15.73:0/4232984883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815cab0 0x7fedf809afa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fedf8073af0 tx=0x7fedf001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a993f524bb39452f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:09.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedf6a00640 1 -- 172.21.15.73:0/4232984883 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf00b2070 con 0x7fedf815cab0 2024-04-15T15:32:09.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedf6a00640 1 -- 172.21.15.73:0/4232984883 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf80d1690 con 0x7fedf815cab0 2024-04-15T15:32:09.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedf6a00640 1 -- 172.21.15.73:0/4232984883 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf00a5c00 con 0x7fedf815cab0 2024-04-15T15:32:09.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedfe200640 1 -- 172.21.15.73:0/4232984883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815cab0 msgr2=0x7fedf809afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:09.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedfe200640 1 --2- 172.21.15.73:0/4232984883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815cab0 0x7fedf809afa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fedf8073af0 tx=0x7fedf001c900 comp rx=0 tx=0).stop 2024-04-15T15:32:09.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedfe200640 1 -- 172.21.15.73:0/4232984883 shutdown_connections 2024-04-15T15:32:09.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedfe200640 1 --2- 172.21.15.73:0/4232984883 >> v2:172.21.15.118:3300/0 conn(0x7fedf80cd1b0 0x7fedf809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:09.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedfe200640 1 --2- 172.21.15.73:0/4232984883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815cab0 0x7fedf809afa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:09.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedfe200640 1 -- 172.21.15.73:0/4232984883 >> 172.21.15.73:0/4232984883 conn(0x7fedf80b3fe0 msgr2=0x7fedf80b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:09.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedfe200640 1 -- 172.21.15.73:0/4232984883 shutdown_connections 2024-04-15T15:32:09.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.817+0000 7fedfe200640 1 -- 172.21.15.73:0/4232984883 wait complete. 2024-04-15T15:32:09.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 Processor -- start 2024-04-15T15:32:09.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 -- start start 2024-04-15T15:32:09.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedf80cd1b0 0x7fedf815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:09.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815c6d0 0x7fedf80cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:09.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedf815cab0 0x7fedf80cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:09.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80b1c20 con 0x7fedf815c6d0 2024-04-15T15:32:09.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80b1aa0 con 0x7fedf80cd1b0 2024-04-15T15:32:09.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fedf80b1da0 con 0x7fedf815cab0 2024-04-15T15:32:09.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedeea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815c6d0 0x7fedf80cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:09.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedeea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815c6d0 0x7fedf80cabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38020/0 (socket says 172.21.15.73:38020) 2024-04-15T15:32:09.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedeea00640 1 -- 172.21.15.73:0/737657933 learned_addr learned my addr 172.21.15.73:0/737657933 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:09.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedf7400640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedf80cd1b0 0x7fedf815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:09.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedf7e00640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedf815cab0 0x7fedf80cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:09.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedeea00640 1 -- 172.21.15.73:0/737657933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedf815cab0 msgr2=0x7fedf80cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:09.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedeea00640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedf815cab0 0x7fedf80cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:09.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedeea00640 1 -- 172.21.15.73:0/737657933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedf80cd1b0 msgr2=0x7fedf815a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:09.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedeea00640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedf80cd1b0 0x7fedf815a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:09.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedeea00640 1 -- 172.21.15.73:0/737657933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf80c9b30 con 0x7fedf815c6d0 2024-04-15T15:32:09.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedeea00640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815c6d0 0x7fedf80cabd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fede000c7f0 tx=0x7fede000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:09.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedefe00640 1 -- 172.21.15.73:0/737657933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0007a30 con 0x7fedf815c6d0 2024-04-15T15:32:09.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedefe00640 1 -- 172.21.15.73:0/737657933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede0007bd0 con 0x7fedf815c6d0 2024-04-15T15:32:09.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedefe00640 1 -- 172.21.15.73:0/737657933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede00113f0 con 0x7fedf815c6d0 2024-04-15T15:32:09.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 -- 172.21.15.73:0/737657933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf80c9e10 con 0x7fedf815c6d0 2024-04-15T15:32:09.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 -- 172.21.15.73:0/737657933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf80ca3d0 con 0x7fedf815c6d0 2024-04-15T15:32:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.821+0000 7fedfe200640 1 -- 172.21.15.73:0/737657933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf8068ab0 con 0x7fedf815c6d0 2024-04-15T15:32:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.825+0000 7fedefe00640 1 -- 172.21.15.73:0/737657933 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fede0011590 con 0x7fedf815c6d0 2024-04-15T15:32:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.825+0000 7fedefe00640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fedd4068380 0x7fedd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.825+0000 7fedefe00640 1 -- 172.21.15.73:0/737657933 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fede0086fd0 con 0x7fedf815c6d0 2024-04-15T15:32:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.825+0000 7fedf7400640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fedd4068380 0x7fedd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:09.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.825+0000 7fedf7400640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fedd4068380 0x7fedd406a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fede8007fd0 tx=0x7fede8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:09.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:09.829+0000 7fedefe00640 1 -- 172.21.15.73:0/737657933 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fede0015020 con 0x7fedf815c6d0 2024-04-15T15:32:10.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.021+0000 7fedfe200640 1 -- 172.21.15.73:0/737657933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fedf80b4d80 con 0x7fedf815c6d0 2024-04-15T15:32:10.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.021+0000 7fedefe00640 1 -- 172.21.15.73:0/737657933 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fede00571b0 con 0x7fedf815c6d0 2024-04-15T15:32:10.024 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 -- 172.21.15.73:0/737657933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fedd4068380 msgr2=0x7fedd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fedd4068380 0x7fedd406a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fede8007fd0 tx=0x7fede8009040 comp rx=0 tx=0).stop 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 -- 172.21.15.73:0/737657933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815c6d0 msgr2=0x7fedf80cabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815c6d0 0x7fedf80cabd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fede000c7f0 tx=0x7fede000ccb0 comp rx=0 tx=0).stop 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 -- 172.21.15.73:0/737657933 shutdown_connections 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fedd4068380 0x7fedd406a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fedf815cab0 0x7fedf80cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf815c6d0 0x7fedf80cabd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 --2- 172.21.15.73:0/737657933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedf80cd1b0 0x7fedf815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 -- 172.21.15.73:0/737657933 >> 172.21.15.73:0/737657933 conn(0x7fedf80b3fe0 msgr2=0x7fedf8160210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 -- 172.21.15.73:0/737657933 shutdown_connections 2024-04-15T15:32:10.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:10.025+0000 7fedfe200640 1 -- 172.21.15.73:0/737657933 wait complete. 2024-04-15T15:32:10.044 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-15T15:32:10.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:32:10.044 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-04-15T15:32:10.044 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-15T15:32:10.044 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-15T15:32:10.045 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-15T15:32:10.045 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T15:32:10.045 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:32:10.045 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-15T15:32:10.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:10.045 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-04-15T15:32:10.055 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:32:10.055 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:32:10.055 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:32:10.055 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:10.055 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-04-15T15:32:10.055 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:10.055 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:10.055 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42438sec preferred_lft 42438sec 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:32:10.056 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 02:42:71:7b:96:37 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:10.057 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:32:10.057 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:10.057 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-15T15:32:10.058 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:10.058 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:32:10.058 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2024-04-15T15:32:10.058 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2024-04-15T15:32:10.058 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2024-04-15T15:32:10.058 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-15T15:32:10.058 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:32:10.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:10.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:10.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:10.222 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:32:10.241 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-04-15T15:32:10.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:10.243 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-04-15T15:32:10.318 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-04-15T15:32:10.319 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:32:10.319 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:32:10.319 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:32:10.319 INFO:teuthology.orchestra.run.smithi118.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:32:10.319 INFO:teuthology.orchestra.run.smithi118.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:32:10.319 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:32:10.319 INFO:teuthology.orchestra.run.smithi118.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:10.319 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:10.319 INFO:teuthology.orchestra.run.smithi118.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:10.319 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:32:10.320 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:10.320 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:32:10.320 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:32:10.320 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:32:10.320 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:32:10.320 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:32:10.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:10.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:10.459 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-04-15T15:32:10.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:10.468 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2024-04-15T15:32:10.520 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:10.520 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:32:10.520 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T15:32:10.520 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-15T15:32:10.521 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:32:10.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:10.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:10.647 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-15T15:32:10.647 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:10.647 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:32:10.647 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-15T15:32:10.647 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-15T15:32:10.647 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-15T15:32:10.647 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-15T15:32:10.647 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-15T15:32:10.647 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:32:10.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:10.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:10.808 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:10.808 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:32:10.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-04-15T15:32:10.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2024-04-15T15:32:10.809 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:32:10.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:10.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:10.938 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:10.938 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-15T15:32:10.947 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-15T15:32:10.947 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:10.947 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-15T15:32:10.995 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-15T15:32:10.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:10.995 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:32:11.082 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:32:11.083 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-15T15:32:11.083 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:32:11.675 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:32:11.675 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-15T15:32:11.675 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:32:11.675 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:11.675 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:11.688 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:32:11.688 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-15T15:32:11.688 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:32:11.688 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:11.688 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:11.688 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790" 2024-04-15T15:32:11.688 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2024-04-15T15:32:11.688 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a72de584-7db8-4f62-b310-5ee655143eeb" will pass to kernel 2024-04-15T15:32:11.692 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-15T15:32:11.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:11.692 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-15T15:32:11.713 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:11.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:11.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:11.823 INFO:teuthology.orchestra.run.smithi118.stdout:client4854 2024-04-15T15:32:11.823 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:32:11.823 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:11.881 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:11.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:11.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:11.978 INFO:teuthology.orchestra.run.smithi118.stdout:client4854 2024-04-15T15:32:11.979 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:12.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:12.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:12.035 INFO:teuthology.orchestra.run.smithi118.stdout:client4854 2024-04-15T15:32:12.035 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a72de584-7db8-4f62-b310-5ee655143eeb.client4854/status') 2024-04-15T15:32:12.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:12.137 INFO:teuthology.orchestra.run.smithi118.stdout:instance: client.4854 (3)172.21.15.118:0/328859152 2024-04-15T15:32:12.137 INFO:teuthology.orchestra.run.smithi118.stdout:blocklisted: false 2024-04-15T15:32:12.137 INFO:teuthology.orchestra.run.smithi118.stderr:0+1 records in 2024-04-15T15:32:12.137 INFO:teuthology.orchestra.run.smithi118.stderr:0+1 records out 2024-04-15T15:32:12.138 INFO:teuthology.orchestra.run.smithi118.stderr:70 bytes copied, 6.2916e-05 s, 1.1 MB/s 2024-04-15T15:32:12.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:12.145 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-15T15:32:12.145 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T15:32:12.145 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-15T15:32:12.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:32:12.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd45a00640 1 Processor -- start 2024-04-15T15:32:12.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd45a00640 1 -- start start 2024-04-15T15:32:12.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd45a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd400b20b0 0x7fdd400b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:12.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd45a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd4015cbd0 0x7fdd4015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:12.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd45a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd400cd3a0 con 0x7fdd40146110 2024-04-15T15:32:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd45a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fdd400b5160 con 0x7fdd400b20b0 2024-04-15T15:32:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd45a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdd400b40c0 con 0x7fdd4015cbd0 2024-04-15T15:32:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd36000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd400b20b0 0x7fdd400b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd36000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd400b20b0 0x7fdd400b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38024/0 (socket says 172.21.15.73:38024) 2024-04-15T15:32:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd36000640 1 -- 172.21.15.73:0/546889196 learned_addr learned my addr 172.21.15.73:0/546889196 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:12.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd3f400640 1 --2- 172.21.15.73:0/546889196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd4015cbd0 0x7fdd4015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd36000640 1 -- 172.21.15.73:0/546889196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd4015cbd0 msgr2=0x7fdd4015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.293+0000 7fdd36000640 1 --2- 172.21.15.73:0/546889196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd4015cbd0 0x7fdd4015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd36000640 1 -- 172.21.15.73:0/546889196 >> v1:172.21.15.118:6789/0 conn(0x7fdd40146110 legacy=0x7fdd400cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:12.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd36000640 1 -- 172.21.15.73:0/546889196 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd400b43a0 con 0x7fdd400b20b0 2024-04-15T15:32:12.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd36000640 1 --2- 172.21.15.73:0/546889196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd400b20b0 0x7fdd400b2530 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009870 tx=0x7fdd2801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b5683c52c81f57 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:12.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd3e000640 1 -- 172.21.15.73:0/546889196 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd280b1070 con 0x7fdd400b20b0 2024-04-15T15:32:12.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd3e000640 1 -- 172.21.15.73:0/546889196 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd280ac630 con 0x7fdd400b20b0 2024-04-15T15:32:12.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd3e000640 1 -- 172.21.15.73:0/546889196 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd280a8050 con 0x7fdd400b20b0 2024-04-15T15:32:12.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd45a00640 1 -- 172.21.15.73:0/546889196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd400b20b0 msgr2=0x7fdd400b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:12.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd45a00640 1 --2- 172.21.15.73:0/546889196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd400b20b0 0x7fdd400b2530 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009870 tx=0x7fdd2801c520 comp rx=0 tx=0).stop 2024-04-15T15:32:12.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd45a00640 1 -- 172.21.15.73:0/546889196 shutdown_connections 2024-04-15T15:32:12.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd45a00640 1 --2- 172.21.15.73:0/546889196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd4015cbd0 0x7fdd4015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:12.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd45a00640 1 --2- 172.21.15.73:0/546889196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd400b20b0 0x7fdd400b2530 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:12.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd45a00640 1 -- 172.21.15.73:0/546889196 >> 172.21.15.73:0/546889196 conn(0x7fdd40067dd0 msgr2=0x7fdd400d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:12.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd45a00640 1 -- 172.21.15.73:0/546889196 shutdown_connections 2024-04-15T15:32:12.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.297+0000 7fdd45a00640 1 -- 172.21.15.73:0/546889196 wait complete. 2024-04-15T15:32:12.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd45a00640 1 Processor -- start 2024-04-15T15:32:12.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd45a00640 1 -- start start 2024-04-15T15:32:12.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd45a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd400b20b0 0x7fdd400cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:12.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd45a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd40146110 0x7fdd4006ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:12.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd45a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4015cbd0 0x7fdd4006f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:12.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd45a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdd40169210 con 0x7fdd4015cbd0 2024-04-15T15:32:12.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd45a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400b3d70 con 0x7fdd40146110 2024-04-15T15:32:12.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd45a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdd40169390 con 0x7fdd400b20b0 2024-04-15T15:32:12.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd3f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4015cbd0 0x7fdd4006f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:12.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd36000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd40146110 0x7fdd4006ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:12.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd3ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd400b20b0 0x7fdd400cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:12.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd3f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4015cbd0 0x7fdd4006f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38026/0 (socket says 172.21.15.73:38026) 2024-04-15T15:32:12.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd3f400640 1 -- 172.21.15.73:0/1224255024 learned_addr learned my addr 172.21.15.73:0/1224255024 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:12.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd3f400640 1 -- 172.21.15.73:0/1224255024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd400b20b0 msgr2=0x7fdd400cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:12.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd3f400640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd400b20b0 0x7fdd400cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:12.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd3f400640 1 -- 172.21.15.73:0/1224255024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd40146110 msgr2=0x7fdd4006ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:12.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd3f400640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd40146110 0x7fdd4006ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:12.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd3f400640 1 -- 172.21.15.73:0/1224255024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd400ccdd0 con 0x7fdd4015cbd0 2024-04-15T15:32:12.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd3f400640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4015cbd0 0x7fdd4006f140 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800d560 tx=0x7fdd3800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:12.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd37400640 1 -- 172.21.15.73:0/1224255024 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd380125f0 con 0x7fdd4015cbd0 2024-04-15T15:32:12.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd37400640 1 -- 172.21.15.73:0/1224255024 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd38019070 con 0x7fdd4015cbd0 2024-04-15T15:32:12.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd37400640 1 -- 172.21.15.73:0/1224255024 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd380129f0 con 0x7fdd4015cbd0 2024-04-15T15:32:12.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.301+0000 7fdd45a00640 1 -- 172.21.15.73:0/1224255024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd400ae660 con 0x7fdd4015cbd0 2024-04-15T15:32:12.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.305+0000 7fdd45a00640 1 -- 172.21.15.73:0/1224255024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd400aec20 con 0x7fdd4015cbd0 2024-04-15T15:32:12.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.305+0000 7fdd45a00640 1 -- 172.21.15.73:0/1224255024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd400af270 con 0x7fdd4015cbd0 2024-04-15T15:32:12.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.305+0000 7fdd37400640 1 -- 172.21.15.73:0/1224255024 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd38012b90 con 0x7fdd4015cbd0 2024-04-15T15:32:12.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.305+0000 7fdd37400640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdd1c068380 0x7fdd1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:12.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.305+0000 7fdd37400640 1 -- 172.21.15.73:0/1224255024 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdd38086f20 con 0x7fdd4015cbd0 2024-04-15T15:32:12.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.305+0000 7fdd3ea00640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdd1c068380 0x7fdd1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:12.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.305+0000 7fdd3ea00640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdd1c068380 0x7fdd1c06a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdd30005680 tx=0x7fdd30003dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:12.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.309+0000 7fdd37400640 1 -- 172.21.15.73:0/1224255024 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdd38056be0 con 0x7fdd4015cbd0 2024-04-15T15:32:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.501+0000 7fdd45a00640 1 -- 172.21.15.73:0/1224255024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdd40068ab0 con 0x7fdd4015cbd0 2024-04-15T15:32:12.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.501+0000 7fdd37400640 1 -- 172.21.15.73:0/1224255024 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fdd3805aee0 con 0x7fdd4015cbd0 2024-04-15T15:32:12.504 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-15T15:32:12.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 -- 172.21.15.73:0/1224255024 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdd1c068380 msgr2=0x7fdd1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:12.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdd1c068380 0x7fdd1c06a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdd30005680 tx=0x7fdd30003dd0 comp rx=0 tx=0).stop 2024-04-15T15:32:12.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 -- 172.21.15.73:0/1224255024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4015cbd0 msgr2=0x7fdd4006f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:12.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4015cbd0 0x7fdd4006f140 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800d560 tx=0x7fdd3800da20 comp rx=0 tx=0).stop 2024-04-15T15:32:12.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 -- 172.21.15.73:0/1224255024 shutdown_connections 2024-04-15T15:32:12.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4015cbd0 0x7fdd4006f140 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:12.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd40146110 0x7fdd4006ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:12.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdd1c068380 0x7fdd1c06a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:12.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 --2- 172.21.15.73:0/1224255024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd400b20b0 0x7fdd400cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:12.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 -- 172.21.15.73:0/1224255024 >> 172.21.15.73:0/1224255024 conn(0x7fdd40067dd0 msgr2=0x7fdd400cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:12.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 -- 172.21.15.73:0/1224255024 shutdown_connections 2024-04-15T15:32:12.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:12.505+0000 7fdd45a00640 1 -- 172.21.15.73:0/1224255024 wait complete. 2024-04-15T15:32:12.525 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-15T15:32:12.526 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:32:12.526 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-04-15T15:32:12.526 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-15T15:32:12.526 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-15T15:32:12.526 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-15T15:32:12.526 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T15:32:12.526 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:32:12.526 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-15T15:32:12.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:12.526 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-04-15T15:32:12.535 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:32:12.535 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:32:12.535 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:32:12.535 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:12.535 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-04-15T15:32:12.535 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:12.535 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:12.535 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42436sec preferred_lft 42436sec 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:12.536 INFO:teuthology.orchestra.run.smithi118.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 02:42:71:7b:96:37 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-15T15:32:12.537 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:12.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:12.538 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:32:12.599 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-04-15T15:32:12.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:12.602 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-04-15T15:32:12.655 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-04-15T15:32:12.655 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:32:12.655 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:32:12.655 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:32:12.655 INFO:teuthology.orchestra.run.smithi118.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:32:12.655 INFO:teuthology.orchestra.run.smithi118.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:32:12.655 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:32:12.656 INFO:teuthology.orchestra.run.smithi118.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:12.656 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:12.656 INFO:teuthology.orchestra.run.smithi118.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:12.656 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:32:12.656 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:12.656 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:32:12.656 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:32:12.656 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:32:12.656 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:32:12.657 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:32:12.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:12.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:12.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:12.791 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-04-15T15:32:12.800 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-15T15:32:12.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:12.801 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2024-04-15T15:32:12.852 INFO:teuthology.orchestra.run.smithi118.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-15T15:32:12.852 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:12.852 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:32:12.852 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-15T15:32:12.852 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-15T15:32:12.852 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:32:12.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:12.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:12.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:12.978 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-15T15:32:12.998 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 36:17:c6:0d:ff:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::3417:c6ff:fe0d:ffee/64 scope link 2024-04-15T15:32:12.999 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:13.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:13.001 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 36:17:c6:0d:ff:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::3417:c6ff:fe0d:ffee/64 scope link 2024-04-15T15:32:13.063 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:13.065 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-15T15:32:13.065 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:13.065 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:32:13.065 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-15T15:32:13.065 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-15T15:32:13.065 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-15T15:32:13.065 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-15T15:32:13.065 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-15T15:32:13.066 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:32:13.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:13.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:13.244 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:13.244 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:32:13.244 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.1 up 2024-04-15T15:32:13.244 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.1 master ceph-brx 2024-04-15T15:32:13.244 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:32:13.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:13.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:13.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:13.377 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-15T15:32:13.385 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-15T15:32:13.386 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:13.386 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-15T15:32:13.439 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-15T15:32:13.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:13.439 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-15T15:32:13.526 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-15T15:32:13.526 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-15T15:32:13.527 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:32:13.542 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-15T15:32:13.542 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-15T15:32:13.542 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:32:13.542 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:13.542 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:13.553 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-15T15:32:13.553 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-15T15:32:13.553 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:32:13.553 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:13.553 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:13.553 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790" 2024-04-15T15:32:13.553 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2024-04-15T15:32:13.553 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=a72de584-7db8-4f62-b310-5ee655143eeb" will pass to kernel 2024-04-15T15:32:13.557 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-15T15:32:13.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:13.558 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-15T15:32:13.624 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:13.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:13.724 INFO:teuthology.orchestra.run.smithi118.stdout:client4765 2024-04-15T15:32:13.724 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:32:13.724 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:13.733 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:13.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:13.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:13.830 INFO:teuthology.orchestra.run.smithi118.stdout:client4765 2024-04-15T15:32:13.830 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:13.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:13.886 INFO:teuthology.orchestra.run.smithi118.stdout:client4765 2024-04-15T15:32:13.886 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a72de584-7db8-4f62-b310-5ee655143eeb.client4765/status') 2024-04-15T15:32:13.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:13.944 INFO:teuthology.orchestra.run.smithi118.stdout:instance: client.4765 (3)192.168.0.2:0/1336450839 2024-04-15T15:32:13.944 INFO:teuthology.orchestra.run.smithi118.stdout:blocklisted: false 2024-04-15T15:32:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:0+1 records in 2024-04-15T15:32:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:0+1 records out 2024-04-15T15:32:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:69 bytes copied, 6.6065e-05 s, 1.0 MB/s 2024-04-15T15:32:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:13.952 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-15T15:32:13.969 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:14.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.121+0000 7f9199400640 1 Processor -- start 2024-04-15T15:32:14.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.121+0000 7f9199400640 1 -- start start 2024-04-15T15:32:14.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.121+0000 7f9199400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9194146110 0x7f91940cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.121+0000 7f9199400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9194072c30 con 0x7f91940b20b0 2024-04-15T15:32:14.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.121+0000 7f9199400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91940cd3a0 con 0x7f91940b2530 2024-04-15T15:32:14.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.121+0000 7f9199400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f91940b5160 con 0x7f9194146110 2024-04-15T15:32:14.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.121+0000 7f9192800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9194146110 0x7f91940cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.121+0000 7f9189e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f91940b20b0 0x7f9194071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52530/0 (socket says 172.21.15.73:52530) 2024-04-15T15:32:14.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.121+0000 7f9189e00640 1 -- 172.21.15.73:0/1152244225 learned_addr learned my addr 172.21.15.73:0/1152244225 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:14.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.125+0000 7f9192800640 1 -- 172.21.15.73:0/1152244225 >> v1:172.21.15.118:6789/0 conn(0x7f91940b2530 legacy=0x7f9194072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.125+0000 7f9192800640 1 -- 172.21.15.73:0/1152244225 >> v1:172.21.15.73:6789/0 conn(0x7f91940b20b0 legacy=0x7f9194071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.125+0000 7f9191e00640 1 -- 172.21.15.73:0/1152244225 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163671232 0 0) 0x7f9194072c30 con 0x7f91940b20b0 2024-04-15T15:32:14.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.125+0000 7f9192800640 1 -- 172.21.15.73:0/1152244225 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91940b40c0 con 0x7f9194146110 2024-04-15T15:32:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.125+0000 7f9192800640 1 --2- 172.21.15.73:0/1152244225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 0x7f91940cd7b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f91940cd570 tx=0x7f918401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec97d44a15b03c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.125+0000 7f9191e00640 1 -- 172.21.15.73:0/1152244225 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91840b2070 con 0x7f9194146110 2024-04-15T15:32:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.125+0000 7f9191e00640 1 -- 172.21.15.73:0/1152244225 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91840a59e0 con 0x7f9194146110 2024-04-15T15:32:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.125+0000 7f9191e00640 1 -- 172.21.15.73:0/1152244225 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91840a5db0 con 0x7f9194146110 2024-04-15T15:32:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 -- 172.21.15.73:0/1152244225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 msgr2=0x7f91940cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 --2- 172.21.15.73:0/1152244225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 0x7f91940cd7b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f91940cd570 tx=0x7f918401c920 comp rx=0 tx=0).stop 2024-04-15T15:32:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 -- 172.21.15.73:0/1152244225 shutdown_connections 2024-04-15T15:32:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 --2- 172.21.15.73:0/1152244225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 0x7f91940cd7b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 -- 172.21.15.73:0/1152244225 >> 172.21.15.73:0/1152244225 conn(0x7f9194067dd0 msgr2=0x7f91940d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 -- 172.21.15.73:0/1152244225 shutdown_connections 2024-04-15T15:32:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 -- 172.21.15.73:0/1152244225 wait complete. 2024-04-15T15:32:14.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 Processor -- start 2024-04-15T15:32:14.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 -- start start 2024-04-15T15:32:14.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91940b20b0 0x7f9194151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91940b2530 0x7f9194145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 0x7f9194143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f91940b2940 con 0x7f9194146110 2024-04-15T15:32:14.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f91940b4c40 con 0x7f91940b2530 2024-04-15T15:32:14.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9199400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f91940b3d70 con 0x7f91940b20b0 2024-04-15T15:32:14.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9193200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 0x7f9194143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9193200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 0x7f9194143c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38048/0 (socket says 172.21.15.73:38048) 2024-04-15T15:32:14.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9193200640 1 -- 172.21.15.73:0/2315080704 learned_addr learned my addr 172.21.15.73:0/2315080704 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:14.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9192800640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91940b20b0 0x7f9194151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9189e00640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91940b2530 0x7f9194145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9193200640 1 -- 172.21.15.73:0/2315080704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91940b20b0 msgr2=0x7f9194151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9193200640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91940b20b0 0x7f9194151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9193200640 1 -- 172.21.15.73:0/2315080704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91940b2530 msgr2=0x7f9194145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9193200640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91940b2530 0x7f9194145220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9193200640 1 -- 172.21.15.73:0/2315080704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91940b1760 con 0x7f9194146110 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9189e00640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91940b2530 0x7f9194145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.129+0000 7f9192800640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91940b20b0 0x7f9194151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f9193200640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 0x7f9194143c40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c460 tx=0x7f918c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f918b400640 1 -- 172.21.15.73:0/2315080704 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c016020 con 0x7f9194146110 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f918b400640 1 -- 172.21.15.73:0/2315080704 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c005220 con 0x7f9194146110 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f9199400640 1 -- 172.21.15.73:0/2315080704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919406f1d0 con 0x7f9194146110 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f918b400640 1 -- 172.21.15.73:0/2315080704 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c007030 con 0x7f9194146110 2024-04-15T15:32:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f9199400640 1 -- 172.21.15.73:0/2315080704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919406f790 con 0x7f9194146110 2024-04-15T15:32:14.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f9199400640 1 -- 172.21.15.73:0/2315080704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9194068ab0 con 0x7f9194146110 2024-04-15T15:32:14.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f918b400640 1 -- 172.21.15.73:0/2315080704 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f918c0071d0 con 0x7f9194146110 2024-04-15T15:32:14.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f918b400640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9170068380 0x7f917006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f918b400640 1 -- 172.21.15.73:0/2315080704 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6743+0+0 (secure 0 0 0) 0x7f918c0866f0 con 0x7f9194146110 2024-04-15T15:32:14.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.133+0000 7f9192800640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9170068380 0x7f917006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.137+0000 7f9192800640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9170068380 0x7f917006a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91840af000 tx=0x7f91840a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:14.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.137+0000 7f918b400640 1 -- 172.21.15.73:0/2315080704 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f918c020020 con 0x7f9194146110 2024-04-15T15:32:14.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.297+0000 7f9199400640 1 -- 172.21.15.73:0/2315080704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f919406f960 con 0x7f9194146110 2024-04-15T15:32:14.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.297+0000 7f918b400640 1 -- 172.21.15.73:0/2315080704 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18897 (secure 0 0 0) 0x7f918c0074c0 con 0x7f9194146110 2024-04-15T15:32:14.300 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":26,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:13.559329+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:14.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 -- 172.21.15.73:0/2315080704 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9170068380 msgr2=0x7f917006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9170068380 0x7f917006a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91840af000 tx=0x7f91840a7070 comp rx=0 tx=0).stop 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 -- 172.21.15.73:0/2315080704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 msgr2=0x7f9194143c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 0x7f9194143c40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c460 tx=0x7f918c00c920 comp rx=0 tx=0).stop 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 -- 172.21.15.73:0/2315080704 shutdown_connections 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9194146110 0x7f9194143c40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91940b2530 0x7f9194145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9170068380 0x7f917006a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 --2- 172.21.15.73:0/2315080704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91940b20b0 0x7f9194151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 -- 172.21.15.73:0/2315080704 >> 172.21.15.73:0/2315080704 conn(0x7f9194067dd0 msgr2=0x7f91940b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 -- 172.21.15.73:0/2315080704 shutdown_connections 2024-04-15T15:32:14.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.301+0000 7f9199400640 1 -- 172.21.15.73:0/2315080704 wait complete. 2024-04-15T15:32:14.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:14.323 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:14.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb177200640 1 Processor -- start 2024-04-15T15:32:14.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb177200640 1 -- start start 2024-04-15T15:32:14.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb177200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb17815e960 0x7fb1780ae170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb177200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1780ae800 con 0x7fb1780af8a0 2024-04-15T15:32:14.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb177200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1780aeae0 con 0x7fb1780ce600 2024-04-15T15:32:14.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb177200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb1780aedc0 con 0x7fb17815e960 2024-04-15T15:32:14.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb176800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb1780af8a0 0x7fb1780d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52546/0 (socket says 172.21.15.73:52546) 2024-04-15T15:32:14.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb176800640 1 -- 172.21.15.73:0/3939294005 learned_addr learned my addr 172.21.15.73:0/3939294005 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:14.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb175e00640 1 --2- 172.21.15.73:0/3939294005 >> v2:172.21.15.118:3300/0 conn(0x7fb17815e960 0x7fb1780ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb175400640 1 -- 172.21.15.73:0/3939294005 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664386486 0 0) 0x7fb1780ae800 con 0x7fb1780af8a0 2024-04-15T15:32:14.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb175400640 1 -- 172.21.15.73:0/3939294005 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb15c003530 con 0x7fb1780af8a0 2024-04-15T15:32:14.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb175400640 1 -- 172.21.15.73:0/3939294005 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2695297350 0 0) 0x7fb1780aeae0 con 0x7fb1780ce600 2024-04-15T15:32:14.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb175400640 1 -- 172.21.15.73:0/3939294005 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1780ae800 con 0x7fb1780ce600 2024-04-15T15:32:14.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb175e00640 1 -- 172.21.15.73:0/3939294005 >> v1:172.21.15.118:6789/0 conn(0x7fb1780ce600 legacy=0x7fb1780cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb175e00640 1 -- 172.21.15.73:0/3939294005 >> v1:172.21.15.73:6789/0 conn(0x7fb1780af8a0 legacy=0x7fb1780d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.461+0000 7fb175e00640 1 -- 172.21.15.73:0/3939294005 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1780af0a0 con 0x7fb17815e960 2024-04-15T15:32:14.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.465+0000 7fb175e00640 1 --2- 172.21.15.73:0/3939294005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17815e960 0x7fb1780ae170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb168009d90 tx=0x7fb16801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b19f8033f7980c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:14.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.465+0000 7fb175400640 1 -- 172.21.15.73:0/3939294005 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1680b2070 con 0x7fb17815e960 2024-04-15T15:32:14.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.465+0000 7fb175400640 1 -- 172.21.15.73:0/3939294005 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1680a5910 con 0x7fb17815e960 2024-04-15T15:32:14.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.465+0000 7fb175400640 1 -- 172.21.15.73:0/3939294005 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1680a5ce0 con 0x7fb17815e960 2024-04-15T15:32:14.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 -- 172.21.15.73:0/3939294005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17815e960 msgr2=0x7fb1780ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 --2- 172.21.15.73:0/3939294005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17815e960 0x7fb1780ae170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb168009d90 tx=0x7fb16801c940 comp rx=0 tx=0).stop 2024-04-15T15:32:14.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 -- 172.21.15.73:0/3939294005 shutdown_connections 2024-04-15T15:32:14.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 --2- 172.21.15.73:0/3939294005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17815e960 0x7fb1780ae170 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 -- 172.21.15.73:0/3939294005 >> 172.21.15.73:0/3939294005 conn(0x7fb1780b2e90 msgr2=0x7fb1780b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:14.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 -- 172.21.15.73:0/3939294005 shutdown_connections 2024-04-15T15:32:14.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 -- 172.21.15.73:0/3939294005 wait complete. 2024-04-15T15:32:14.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 Processor -- start 2024-04-15T15:32:14.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 -- start start 2024-04-15T15:32:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1780af8a0 0x7fb17814d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780ce600 0x7fb17815ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17815e960 0x7fb17814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb1780cc1e0 con 0x7fb1780ce600 2024-04-15T15:32:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb1780cc060 con 0x7fb17815e960 2024-04-15T15:32:14.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb177200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb1780cea10 con 0x7fb1780af8a0 2024-04-15T15:32:14.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb16d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780ce600 0x7fb17815ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb16d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780ce600 0x7fb17815ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38054/0 (socket says 172.21.15.73:38054) 2024-04-15T15:32:14.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb16d400640 1 -- 172.21.15.73:0/3296189840 learned_addr learned my addr 172.21.15.73:0/3296189840 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:14.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb175e00640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1780af8a0 0x7fb17814d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb176800640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17815e960 0x7fb17814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb16d400640 1 -- 172.21.15.73:0/3296189840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1780af8a0 msgr2=0x7fb17814d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb16d400640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1780af8a0 0x7fb17814d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb16d400640 1 -- 172.21.15.73:0/3296189840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17815e960 msgr2=0x7fb17814ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb16d400640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17815e960 0x7fb17814ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb16d400640 1 -- 172.21.15.73:0/3296189840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17814e060 con 0x7fb1780ce600 2024-04-15T15:32:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb16d400640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780ce600 0x7fb17815ef50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb16000c500 tx=0x7fb16000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.469+0000 7fb16ea00640 1 -- 172.21.15.73:0/3296189840 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1600052d0 con 0x7fb1780ce600 2024-04-15T15:32:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.473+0000 7fb16ea00640 1 -- 172.21.15.73:0/3296189840 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb160005490 con 0x7fb1780ce600 2024-04-15T15:32:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.473+0000 7fb16ea00640 1 -- 172.21.15.73:0/3296189840 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160012850 con 0x7fb1780ce600 2024-04-15T15:32:14.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.473+0000 7fb177200640 1 -- 172.21.15.73:0/3296189840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17814e340 con 0x7fb1780ce600 2024-04-15T15:32:14.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.473+0000 7fb177200640 1 -- 172.21.15.73:0/3296189840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17814e900 con 0x7fb1780ce600 2024-04-15T15:32:14.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.473+0000 7fb177200640 1 -- 172.21.15.73:0/3296189840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17804fd60 con 0x7fb1780ce600 2024-04-15T15:32:14.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.473+0000 7fb16ea00640 1 -- 172.21.15.73:0/3296189840 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb1600129f0 con 0x7fb1780ce600 2024-04-15T15:32:14.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.473+0000 7fb16ea00640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1540683b0 0x7fb15406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.473+0000 7fb16ea00640 1 -- 172.21.15.73:0/3296189840 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6743+0+0 (secure 0 0 0) 0x7fb160086960 con 0x7fb1780ce600 2024-04-15T15:32:14.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.473+0000 7fb175e00640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1540683b0 0x7fb15406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.477+0000 7fb175e00640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1540683b0 0x7fb15406a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb1680af000 tx=0x7fb1680a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:14.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.481+0000 7fb16ea00640 1 -- 172.21.15.73:0/3296189840 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb1600564b0 con 0x7fb1780ce600 2024-04-15T15:32:14.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.649+0000 7fb177200640 1 -- 172.21.15.73:0/3296189840 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb17806f2d0 con 0x7fb1780ce600 2024-04-15T15:32:14.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.649+0000 7fb16ea00640 1 -- 172.21.15.73:0/3296189840 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fb16005a7b0 con 0x7fb1780ce600 2024-04-15T15:32:14.651 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 -- 172.21.15.73:0/3296189840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1540683b0 msgr2=0x7fb15406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1540683b0 0x7fb15406a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb1680af000 tx=0x7fb1680a7070 comp rx=0 tx=0).stop 2024-04-15T15:32:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 -- 172.21.15.73:0/3296189840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780ce600 msgr2=0x7fb17815ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780ce600 0x7fb17815ef50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb16000c500 tx=0x7fb16000c9c0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 -- 172.21.15.73:0/3296189840 shutdown_connections 2024-04-15T15:32:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17815e960 0x7fb17814ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1780ce600 0x7fb17815ef50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb1540683b0 0x7fb15406a870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 --2- 172.21.15.73:0/3296189840 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1780af8a0 0x7fb17814d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 -- 172.21.15.73:0/3296189840 >> 172.21.15.73:0/3296189840 conn(0x7fb1780b2e90 msgr2=0x7fb178157240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 -- 172.21.15.73:0/3296189840 shutdown_connections 2024-04-15T15:32:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.653+0000 7fb177200640 1 -- 172.21.15.73:0/3296189840 wait complete. 2024-04-15T15:32:14.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:14.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.809+0000 7fd51f400640 1 Processor -- start 2024-04-15T15:32:14.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.809+0000 7fd51f400640 1 -- start start 2024-04-15T15:32:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.809+0000 7fd51f400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd51806d170 0x7fd518073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.809+0000 7fd51f400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5180b4810 con 0x7fd51815e760 2024-04-15T15:32:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.809+0000 7fd51f400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5180b4af0 con 0x7fd518070130 2024-04-15T15:32:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.809+0000 7fd51f400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd5180cd2f0 con 0x7fd51806d170 2024-04-15T15:32:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.809+0000 7fd51ca00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd51815e760 0x7fd51806ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52562/0 (socket says 172.21.15.73:52562) 2024-04-15T15:32:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.809+0000 7fd51ca00640 1 -- 172.21.15.73:0/322687325 learned_addr learned my addr 172.21.15.73:0/322687325 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.809+0000 7fd517e00640 1 --2- 172.21.15.73:0/322687325 >> v2:172.21.15.118:3300/0 conn(0x7fd51806d170 0x7fd518073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517400640 1 -- 172.21.15.73:0/322687325 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081781516 0 0) 0x7fd5180b4810 con 0x7fd51815e760 2024-04-15T15:32:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517400640 1 -- 172.21.15.73:0/322687325 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4fc003530 con 0x7fd51815e760 2024-04-15T15:32:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517400640 1 -- 172.21.15.73:0/322687325 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 920059099 0 0) 0x7fd5180b4af0 con 0x7fd518070130 2024-04-15T15:32:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517400640 1 -- 172.21.15.73:0/322687325 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5180b4810 con 0x7fd518070130 2024-04-15T15:32:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517e00640 1 -- 172.21.15.73:0/322687325 >> v1:172.21.15.118:6789/0 conn(0x7fd518070130 legacy=0x7fd51806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517e00640 1 -- 172.21.15.73:0/322687325 >> v1:172.21.15.73:6789/0 conn(0x7fd51815e760 legacy=0x7fd51806ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517e00640 1 -- 172.21.15.73:0/322687325 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180ccca0 con 0x7fd51806d170 2024-04-15T15:32:14.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517e00640 1 --2- 172.21.15.73:0/322687325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd51806d170 0x7fd518073480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd5040097c0 tx=0x7fd50401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f0c3e835d8916aa server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:14.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517400640 1 -- 172.21.15.73:0/322687325 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5040b0070 con 0x7fd51806d170 2024-04-15T15:32:14.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517400640 1 -- 172.21.15.73:0/322687325 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5040ab600 con 0x7fd51806d170 2024-04-15T15:32:14.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd517400640 1 -- 172.21.15.73:0/322687325 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51815ed50 con 0x7fd51806d170 2024-04-15T15:32:14.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd51f400640 1 -- 172.21.15.73:0/322687325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd51806d170 msgr2=0x7fd518073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.813+0000 7fd51f400640 1 --2- 172.21.15.73:0/322687325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd51806d170 0x7fd518073480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd5040097c0 tx=0x7fd50401c410 comp rx=0 tx=0).stop 2024-04-15T15:32:14.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 -- 172.21.15.73:0/322687325 shutdown_connections 2024-04-15T15:32:14.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 --2- 172.21.15.73:0/322687325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd51806d170 0x7fd518073480 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 -- 172.21.15.73:0/322687325 >> 172.21.15.73:0/322687325 conn(0x7fd518072590 msgr2=0x7fd518072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:14.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 -- 172.21.15.73:0/322687325 shutdown_connections 2024-04-15T15:32:14.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 -- 172.21.15.73:0/322687325 wait complete. 2024-04-15T15:32:14.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 Processor -- start 2024-04-15T15:32:14.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 -- start start 2024-04-15T15:32:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd51806d170 0x7fd518149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd518070130 0x7fd518157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51815e760 0x7fd518158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd51806f9f0 con 0x7fd51815e760 2024-04-15T15:32:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd51806f870 con 0x7fd51806d170 2024-04-15T15:32:14.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd51816c7c0 con 0x7fd518070130 2024-04-15T15:32:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51815e760 0x7fd518158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51815e760 0x7fd518158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38068/0 (socket says 172.21.15.73:38068) 2024-04-15T15:32:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51d400640 1 -- 172.21.15.73:0/3476400602 learned_addr learned my addr 172.21.15.73:0/3476400602 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51ca00640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd51806d170 0x7fd518149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd517e00640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd518070130 0x7fd518157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51d400640 1 -- 172.21.15.73:0/3476400602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd518070130 msgr2=0x7fd518157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51d400640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd518070130 0x7fd518157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51d400640 1 -- 172.21.15.73:0/3476400602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd51806d170 msgr2=0x7fd518149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51d400640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd51806d170 0x7fd518149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51d400640 1 -- 172.21.15.73:0/3476400602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180ae6f0 con 0x7fd51815e760 2024-04-15T15:32:14.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51d400640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51815e760 0x7fd518158000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd51000c790 tx=0x7fd51000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:14.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd514c00640 1 -- 172.21.15.73:0/3476400602 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510003b80 con 0x7fd51815e760 2024-04-15T15:32:14.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd514c00640 1 -- 172.21.15.73:0/3476400602 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd510003d20 con 0x7fd51815e760 2024-04-15T15:32:14.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd514c00640 1 -- 172.21.15.73:0/3476400602 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51000aa50 con 0x7fd51815e760 2024-04-15T15:32:14.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.817+0000 7fd51f400640 1 -- 172.21.15.73:0/3476400602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5181544a0 con 0x7fd51815e760 2024-04-15T15:32:14.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.821+0000 7fd51f400640 1 -- 172.21.15.73:0/3476400602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd518154a60 con 0x7fd51815e760 2024-04-15T15:32:14.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.821+0000 7fd51f400640 1 -- 172.21.15.73:0/3476400602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd518068ab0 con 0x7fd51815e760 2024-04-15T15:32:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.821+0000 7fd514c00640 1 -- 172.21.15.73:0/3476400602 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd51000abf0 con 0x7fd51815e760 2024-04-15T15:32:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.821+0000 7fd514c00640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd4f8068380 0x7fd4f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.821+0000 7fd514c00640 1 -- 172.21.15.73:0/3476400602 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fd510086cc0 con 0x7fd51815e760 2024-04-15T15:32:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.821+0000 7fd51ca00640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd4f8068380 0x7fd4f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:14.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.821+0000 7fd51ca00640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd4f8068380 0x7fd4f806a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd508000f70 tx=0x7fd508007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:14.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.825+0000 7fd514c00640 1 -- 172.21.15.73:0/3476400602 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd51008d080 con 0x7fd51815e760 2024-04-15T15:32:14.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.985+0000 7fd51f400640 1 -- 172.21.15.73:0/3476400602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd518073260 con 0x7fd51815e760 2024-04-15T15:32:14.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.985+0000 7fd514c00640 1 -- 172.21.15.73:0/3476400602 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fd510056780 con 0x7fd51815e760 2024-04-15T15:32:14.987 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:14.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 -- 172.21.15.73:0/3476400602 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd4f8068380 msgr2=0x7fd4f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd4f8068380 0x7fd4f806a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd508000f70 tx=0x7fd508007d40 comp rx=0 tx=0).stop 2024-04-15T15:32:14.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 -- 172.21.15.73:0/3476400602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51815e760 msgr2=0x7fd518158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:14.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51815e760 0x7fd518158000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd51000c790 tx=0x7fd51000cc50 comp rx=0 tx=0).stop 2024-04-15T15:32:14.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 -- 172.21.15.73:0/3476400602 shutdown_connections 2024-04-15T15:32:14.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51815e760 0x7fd518158000 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd4f8068380 0x7fd4f806a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd518070130 0x7fd518157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 --2- 172.21.15.73:0/3476400602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd51806d170 0x7fd518149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:14.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 -- 172.21.15.73:0/3476400602 >> 172.21.15.73:0/3476400602 conn(0x7fd518072590 msgr2=0x7fd5180b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:14.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 -- 172.21.15.73:0/3476400602 shutdown_connections 2024-04-15T15:32:14.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:14.989+0000 7fd51f400640 1 -- 172.21.15.73:0/3476400602 wait complete. 2024-04-15T15:32:15.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb342000640 1 Processor -- start 2024-04-15T15:32:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb342000640 1 -- start start 2024-04-15T15:32:15.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb342000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c15b560 0x7fb33c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb342000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33c0ce620 con 0x7fb33c0d0450 2024-04-15T15:32:15.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb342000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33c06dc10 con 0x7fb33c0af610 2024-04-15T15:32:15.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb342000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb33c06def0 con 0x7fb33c15b560 2024-04-15T15:32:15.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb341600640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb33c0d0450 0x7fb33c0d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52572/0 (socket says 172.21.15.73:52572) 2024-04-15T15:32:15.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb341600640 1 -- 172.21.15.73:0/2175894521 learned_addr learned my addr 172.21.15.73:0/2175894521 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:15.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb340c00640 1 --2- 172.21.15.73:0/2175894521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c15b560 0x7fb33c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb33b400640 1 -- 172.21.15.73:0/2175894521 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57532388 0 0) 0x7fb33c0ce620 con 0x7fb33c0d0450 2024-04-15T15:32:15.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb33b400640 1 -- 172.21.15.73:0/2175894521 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb320003530 con 0x7fb33c0d0450 2024-04-15T15:32:15.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb33b400640 1 -- 172.21.15.73:0/2175894521 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494529693 0 0) 0x7fb33c06dc10 con 0x7fb33c0af610 2024-04-15T15:32:15.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.145+0000 7fb33b400640 1 -- 172.21.15.73:0/2175894521 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb33c0ce620 con 0x7fb33c0af610 2024-04-15T15:32:15.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb340c00640 1 -- 172.21.15.73:0/2175894521 >> v1:172.21.15.118:6789/0 conn(0x7fb33c0af610 legacy=0x7fb33c0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb340c00640 1 -- 172.21.15.73:0/2175894521 >> v1:172.21.15.73:6789/0 conn(0x7fb33c0d0450 legacy=0x7fb33c0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb340c00640 1 -- 172.21.15.73:0/2175894521 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c0ce900 con 0x7fb33c15b560 2024-04-15T15:32:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb340c00640 1 --2- 172.21.15.73:0/2175894521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c15b560 0x7fb33c06e6f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009dc0 tx=0x7fb32c01c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cad6748adfa431bb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb33b400640 1 -- 172.21.15.73:0/2175894521 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0b2070 con 0x7fb33c15b560 2024-04-15T15:32:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb33b400640 1 -- 172.21.15.73:0/2175894521 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c0a57c0 con 0x7fb33c15b560 2024-04-15T15:32:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb33b400640 1 -- 172.21.15.73:0/2175894521 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0a5b70 con 0x7fb33c15b560 2024-04-15T15:32:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb342000640 1 -- 172.21.15.73:0/2175894521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c15b560 msgr2=0x7fb33c06e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb342000640 1 --2- 172.21.15.73:0/2175894521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c15b560 0x7fb33c06e6f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009dc0 tx=0x7fb32c01c900 comp rx=0 tx=0).stop 2024-04-15T15:32:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb342000640 1 -- 172.21.15.73:0/2175894521 shutdown_connections 2024-04-15T15:32:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb342000640 1 --2- 172.21.15.73:0/2175894521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c15b560 0x7fb33c06e6f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb342000640 1 -- 172.21.15.73:0/2175894521 >> 172.21.15.73:0/2175894521 conn(0x7fb33c06bc20 msgr2=0x7fb33c06c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.149+0000 7fb342000640 1 -- 172.21.15.73:0/2175894521 shutdown_connections 2024-04-15T15:32:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 -- 172.21.15.73:0/2175894521 wait complete. 2024-04-15T15:32:15.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 Processor -- start 2024-04-15T15:32:15.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 -- start start 2024-04-15T15:32:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb33c0af610 0x7fb33c099370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c0d0450 0x7fb33c0737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c15b560 0x7fb33c0c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c0b4150 con 0x7fb33c15b560 2024-04-15T15:32:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c0b3fd0 con 0x7fb33c0af610 2024-04-15T15:32:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb33c0b42d0 con 0x7fb33c0d0450 2024-04-15T15:32:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb341600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c15b560 0x7fb33c0c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb341600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c15b560 0x7fb33c0c2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38078/0 (socket says 172.21.15.73:38078) 2024-04-15T15:32:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb341600640 1 -- 172.21.15.73:0/1692025455 learned_addr learned my addr 172.21.15.73:0/1692025455 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb340c00640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb33c0af610 0x7fb33c099370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb33be00640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c0d0450 0x7fb33c0737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb341600640 1 -- 172.21.15.73:0/1692025455 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c0d0450 msgr2=0x7fb33c0737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb341600640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c0d0450 0x7fb33c0737b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb341600640 1 -- 172.21.15.73:0/1692025455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb33c0af610 msgr2=0x7fb33c099370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb341600640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb33c0af610 0x7fb33c099370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb341600640 1 -- 172.21.15.73:0/1692025455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c0cb1a0 con 0x7fb33c15b560 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb341600640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c15b560 0x7fb33c0c2f00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c3c0 tx=0x7fb33400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb338c00640 1 -- 172.21.15.73:0/1692025455 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334017070 con 0x7fb33c15b560 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb338c00640 1 -- 172.21.15.73:0/1692025455 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334005d10 con 0x7fb33c15b560 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 -- 172.21.15.73:0/1692025455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33c072710 con 0x7fb33c15b560 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb338c00640 1 -- 172.21.15.73:0/1692025455 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334007310 con 0x7fb33c15b560 2024-04-15T15:32:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.153+0000 7fb342000640 1 -- 172.21.15.73:0/1692025455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33c072cd0 con 0x7fb33c15b560 2024-04-15T15:32:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.157+0000 7fb342000640 1 -- 172.21.15.73:0/1692025455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33c04fd60 con 0x7fb33c15b560 2024-04-15T15:32:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.157+0000 7fb338c00640 1 -- 172.21.15.73:0/1692025455 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb33401a070 con 0x7fb33c15b560 2024-04-15T15:32:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.157+0000 7fb338c00640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb31c068380 0x7fb31c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.157+0000 7fb338c00640 1 -- 172.21.15.73:0/1692025455 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fb334085ff0 con 0x7fb33c15b560 2024-04-15T15:32:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.157+0000 7fb340c00640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb31c068380 0x7fb31c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.157+0000 7fb340c00640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb31c068380 0x7fb31c06a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0af000 tx=0x7fb32c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:15.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.161+0000 7fb338c00640 1 -- 172.21.15.73:0/1692025455 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb334055be0 con 0x7fb33c15b560 2024-04-15T15:32:15.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 -- 172.21.15.73:0/1692025455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb33c06f640 con 0x7fb33c15b560 2024-04-15T15:32:15.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb338c00640 1 -- 172.21.15.73:0/1692025455 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fb334059ee0 con 0x7fb33c15b560 2024-04-15T15:32:15.322 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:15.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 -- 172.21.15.73:0/1692025455 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb31c068380 msgr2=0x7fb31c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb31c068380 0x7fb31c06a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0af000 tx=0x7fb32c0a7070 comp rx=0 tx=0).stop 2024-04-15T15:32:15.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 -- 172.21.15.73:0/1692025455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c15b560 msgr2=0x7fb33c0c2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c15b560 0x7fb33c0c2f00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c3c0 tx=0x7fb33400c880 comp rx=0 tx=0).stop 2024-04-15T15:32:15.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 -- 172.21.15.73:0/1692025455 shutdown_connections 2024-04-15T15:32:15.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb33c15b560 0x7fb33c0c2f00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb31c068380 0x7fb31c06a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb33c0d0450 0x7fb33c0737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 --2- 172.21.15.73:0/1692025455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb33c0af610 0x7fb33c099370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 -- 172.21.15.73:0/1692025455 >> 172.21.15.73:0/1692025455 conn(0x7fb33c06bc20 msgr2=0x7fb33c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:15.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 -- 172.21.15.73:0/1692025455 shutdown_connections 2024-04-15T15:32:15.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.321+0000 7fb342000640 1 -- 172.21.15.73:0/1692025455 wait complete. 2024-04-15T15:32:15.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:15.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f25a0800640 1 Processor -- start 2024-04-15T15:32:15.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f25a0800640 1 -- start start 2024-04-15T15:32:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f25a0800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f259815b5d0 0x7f259815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f25a0800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f25980b27c0 0x7f25980b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f25a0800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2598070160 con 0x7f25980b3e30 2024-04-15T15:32:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f25a0800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f259815b9b0 con 0x7f25980b27c0 2024-04-15T15:32:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f25a0800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f259815f1f0 con 0x7f259815b5d0 2024-04-15T15:32:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f259e800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f25980b27c0 0x7f25980b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f259de00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f259815b5d0 0x7f259815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f259e800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f25980b27c0 0x7f25980b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38084/0 (socket says 172.21.15.73:38084) 2024-04-15T15:32:15.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.481+0000 7f259e800640 1 -- 172.21.15.73:0/1465457174 learned_addr learned my addr 172.21.15.73:0/1465457174 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:15.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f259de00640 1 -- 172.21.15.73:0/1465457174 >> v2:172.21.15.73:3300/0 conn(0x7f25980b27c0 msgr2=0x7f25980b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:15.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f259de00640 1 --2- 172.21.15.73:0/1465457174 >> v2:172.21.15.73:3300/0 conn(0x7f25980b27c0 0x7f25980b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f259de00640 1 -- 172.21.15.73:0/1465457174 >> v1:172.21.15.118:6789/0 conn(0x7f25980b3e30 legacy=0x7f25980b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f259de00640 1 -- 172.21.15.73:0/1465457174 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259806fe80 con 0x7f259815b5d0 2024-04-15T15:32:15.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f259de00640 1 --2- 172.21.15.73:0/1465457174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259815b5d0 0x7f259815fc90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f258c00ba60 tx=0x7f258c01e9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e677878348e8f367 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:15.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f259ca00640 1 -- 172.21.15.73:0/1465457174 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c0b4070 con 0x7f259815b5d0 2024-04-15T15:32:15.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f259ca00640 1 -- 172.21.15.73:0/1465457174 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f258c0a78b0 con 0x7f259815b5d0 2024-04-15T15:32:15.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f259ca00640 1 -- 172.21.15.73:0/1465457174 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c0a7c80 con 0x7f259815b5d0 2024-04-15T15:32:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f25a0800640 1 -- 172.21.15.73:0/1465457174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259815b5d0 msgr2=0x7f259815fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f25a0800640 1 --2- 172.21.15.73:0/1465457174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259815b5d0 0x7f259815fc90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f258c00ba60 tx=0x7f258c01e9e0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f25a0800640 1 -- 172.21.15.73:0/1465457174 shutdown_connections 2024-04-15T15:32:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f25a0800640 1 --2- 172.21.15.73:0/1465457174 >> v2:172.21.15.73:3300/0 conn(0x7f25980b27c0 0x7f25980b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f25a0800640 1 --2- 172.21.15.73:0/1465457174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259815b5d0 0x7f259815fc90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.485+0000 7f25a0800640 1 -- 172.21.15.73:0/1465457174 >> 172.21.15.73:0/1465457174 conn(0x7f2598067dd0 msgr2=0x7f25980d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 -- 172.21.15.73:0/1465457174 shutdown_connections 2024-04-15T15:32:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 -- 172.21.15.73:0/1465457174 wait complete. 2024-04-15T15:32:15.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 Processor -- start 2024-04-15T15:32:15.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 -- start start 2024-04-15T15:32:15.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25980b27c0 0x7f25980aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25980b3e30 0x7f259814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f259815b5d0 0x7f2598071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f259806faa0 con 0x7f259815b5d0 2024-04-15T15:32:15.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f25980b4240 con 0x7f25980b3e30 2024-04-15T15:32:15.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f259806fc20 con 0x7f25980b27c0 2024-04-15T15:32:15.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f259815b5d0 0x7f2598071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f259815b5d0 0x7f2598071e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38092/0 (socket says 172.21.15.73:38092) 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259e800640 1 -- 172.21.15.73:0/645154945 learned_addr learned my addr 172.21.15.73:0/645154945 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259d400640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25980b3e30 0x7f259814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259de00640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25980b27c0 0x7f25980aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259e800640 1 -- 172.21.15.73:0/645154945 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25980b27c0 msgr2=0x7f25980aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259e800640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25980b27c0 0x7f25980aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259e800640 1 -- 172.21.15.73:0/645154945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25980b3e30 msgr2=0x7f259814fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259e800640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25980b3e30 0x7f259814fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259e800640 1 -- 172.21.15.73:0/645154945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2598150550 con 0x7f259815b5d0 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f259e800640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f259815b5d0 0x7f2598071e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2594009cb0 tx=0x7f259400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f2592000640 1 -- 172.21.15.73:0/645154945 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400cd20 con 0x7f259815b5d0 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f2592000640 1 -- 172.21.15.73:0/645154945 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25940039a0 con 0x7f259815b5d0 2024-04-15T15:32:15.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f2592000640 1 -- 172.21.15.73:0/645154945 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594003d90 con 0x7f259815b5d0 2024-04-15T15:32:15.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.489+0000 7f25a0800640 1 -- 172.21.15.73:0/645154945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25981599f0 con 0x7f259815b5d0 2024-04-15T15:32:15.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.493+0000 7f25a0800640 1 -- 172.21.15.73:0/645154945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2598159fb0 con 0x7f259815b5d0 2024-04-15T15:32:15.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.493+0000 7f25a0800640 1 -- 172.21.15.73:0/645154945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2598068ab0 con 0x7f259815b5d0 2024-04-15T15:32:15.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.493+0000 7f2592000640 1 -- 172.21.15.73:0/645154945 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2594012050 con 0x7f259815b5d0 2024-04-15T15:32:15.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.493+0000 7f2592000640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f257c068380 0x7f257c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.493+0000 7f2592000640 1 -- 172.21.15.73:0/645154945 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f2594087150 con 0x7f259815b5d0 2024-04-15T15:32:15.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.493+0000 7f259de00640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f257c068380 0x7f257c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.493+0000 7f259de00640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f257c068380 0x7f257c06a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f258c0b1000 tx=0x7f258c0a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:15.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.497+0000 7f2592000640 1 -- 172.21.15.73:0/645154945 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2594022020 con 0x7f259815b5d0 2024-04-15T15:32:15.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.657+0000 7f25a0800640 1 -- 172.21.15.73:0/645154945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f259806f370 con 0x7f259815b5d0 2024-04-15T15:32:15.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.657+0000 7f2592000640 1 -- 172.21.15.73:0/645154945 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f2594010040 con 0x7f259815b5d0 2024-04-15T15:32:15.662 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:15.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 -- 172.21.15.73:0/645154945 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f257c068380 msgr2=0x7f257c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f257c068380 0x7f257c06a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f258c0b1000 tx=0x7f258c0a9070 comp rx=0 tx=0).stop 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 -- 172.21.15.73:0/645154945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f259815b5d0 msgr2=0x7f2598071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f259815b5d0 0x7f2598071e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2594009cb0 tx=0x7f259400c490 comp rx=0 tx=0).stop 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 -- 172.21.15.73:0/645154945 shutdown_connections 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f259815b5d0 0x7f2598071e10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25980b3e30 0x7f259814fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f257c068380 0x7f257c06a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 --2- 172.21.15.73:0/645154945 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25980b27c0 0x7f25980aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 -- 172.21.15.73:0/645154945 >> 172.21.15.73:0/645154945 conn(0x7f2598067dd0 msgr2=0x7f25980b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 -- 172.21.15.73:0/645154945 shutdown_connections 2024-04-15T15:32:15.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.661+0000 7f25a0800640 1 -- 172.21.15.73:0/645154945 wait complete. 2024-04-15T15:32:15.681 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59de000640 1 Processor -- start 2024-04-15T15:32:15.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59de000640 1 -- start start 2024-04-15T15:32:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59de000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f59d80b2310 0x7f59d8162390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59de000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59d80af440 0x7f59d815e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59de000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f59d80b26f0 0x7f59d815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59de000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f59d80b3770 con 0x7f59d80b26f0 2024-04-15T15:32:15.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59de000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f59d815ec90 con 0x7f59d80b2310 2024-04-15T15:32:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59de000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f59d80adab0 con 0x7f59d80af440 2024-04-15T15:32:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59d7e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f59d80b26f0 0x7f59d815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59d7e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f59d80b26f0 0x7f59d815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38106/0 (socket says 172.21.15.73:38106) 2024-04-15T15:32:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59d7e00640 1 -- 172.21.15.73:0/2435944850 learned_addr learned my addr 172.21.15.73:0/2435944850 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59d7400640 1 --2- 172.21.15.73:0/2435944850 >> v2:172.21.15.118:3300/0 conn(0x7f59d80b2310 0x7f59d8162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59cea00640 1 --2- 172.21.15.73:0/2435944850 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59d80af440 0x7f59d815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59d7e00640 1 -- 172.21.15.73:0/2435944850 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59d80af440 msgr2=0x7f59d815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:15.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59d7e00640 1 --2- 172.21.15.73:0/2435944850 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59d80af440 0x7f59d815e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59d7e00640 1 -- 172.21.15.73:0/2435944850 >> v2:172.21.15.118:3300/0 conn(0x7f59d80b2310 msgr2=0x7f59d8162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:15.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59d7e00640 1 --2- 172.21.15.73:0/2435944850 >> v2:172.21.15.118:3300/0 conn(0x7f59d80b2310 0x7f59d8162390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.817+0000 7f59d7e00640 1 -- 172.21.15.73:0/2435944850 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d8162a90 con 0x7f59d80b26f0 2024-04-15T15:32:15.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59d7e00640 1 --2- 172.21.15.73:0/2435944850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b26f0 0x7f59d815e750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f59d8073020 tx=0x7f59d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17275a57d4fdb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:15.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59d6a00640 1 -- 172.21.15.73:0/2435944850 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00ab5f0 con 0x7f59d80b26f0 2024-04-15T15:32:15.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59d6a00640 1 -- 172.21.15.73:0/2435944850 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d00b0070 con 0x7f59d80b26f0 2024-04-15T15:32:15.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59d6a00640 1 -- 172.21.15.73:0/2435944850 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00ab9b0 con 0x7f59d80b26f0 2024-04-15T15:32:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59de000640 1 -- 172.21.15.73:0/2435944850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b26f0 msgr2=0x7f59d815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59de000640 1 --2- 172.21.15.73:0/2435944850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b26f0 0x7f59d815e750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f59d8073020 tx=0x7f59d001c520 comp rx=0 tx=0).stop 2024-04-15T15:32:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59de000640 1 -- 172.21.15.73:0/2435944850 shutdown_connections 2024-04-15T15:32:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59de000640 1 --2- 172.21.15.73:0/2435944850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b26f0 0x7f59d815e750 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59de000640 1 --2- 172.21.15.73:0/2435944850 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59d80af440 0x7f59d815e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59de000640 1 --2- 172.21.15.73:0/2435944850 >> v2:172.21.15.118:3300/0 conn(0x7f59d80b2310 0x7f59d8162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59de000640 1 -- 172.21.15.73:0/2435944850 >> 172.21.15.73:0/2435944850 conn(0x7f59d8067dd0 msgr2=0x7f59d80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59de000640 1 -- 172.21.15.73:0/2435944850 shutdown_connections 2024-04-15T15:32:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.821+0000 7f59de000640 1 -- 172.21.15.73:0/2435944850 wait complete. 2024-04-15T15:32:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59de000640 1 Processor -- start 2024-04-15T15:32:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59de000640 1 -- start start 2024-04-15T15:32:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59de000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d80af440 0x7f59d8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59de000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b2310 0x7f59d815f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59de000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59d80b26f0 0x7f59d8149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59de000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f59d80aec00 con 0x7f59d80b2310 2024-04-15T15:32:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59de000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f59d80aea80 con 0x7f59d80af440 2024-04-15T15:32:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59de000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f59d80aed80 con 0x7f59d80b26f0 2024-04-15T15:32:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b2310 0x7f59d815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b2310 0x7f59d815f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38114/0 (socket says 172.21.15.73:38114) 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cea00640 1 -- 172.21.15.73:0/2037843669 learned_addr learned my addr 172.21.15.73:0/2037843669 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59d7400640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d80af440 0x7f59d8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59d7e00640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59d80b26f0 0x7f59d8149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cea00640 1 -- 172.21.15.73:0/2037843669 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59d80b26f0 msgr2=0x7f59d8149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cea00640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59d80b26f0 0x7f59d8149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cea00640 1 -- 172.21.15.73:0/2037843669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d80af440 msgr2=0x7f59d8156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cea00640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d80af440 0x7f59d8156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cea00640 1 -- 172.21.15.73:0/2037843669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d814a3b0 con 0x7f59d80b2310 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cea00640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b2310 0x7f59d815f840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59c000e930 tx=0x7f59c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cfe00640 1 -- 172.21.15.73:0/2037843669 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0017070 con 0x7f59d80b2310 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cfe00640 1 -- 172.21.15.73:0/2037843669 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c000ca00 con 0x7f59d80b2310 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59cfe00640 1 -- 172.21.15.73:0/2037843669 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c000cdb0 con 0x7f59d80b2310 2024-04-15T15:32:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59de000640 1 -- 172.21.15.73:0/2037843669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d8161050 con 0x7f59d80b2310 2024-04-15T15:32:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.825+0000 7f59de000640 1 -- 172.21.15.73:0/2037843669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d8160290 con 0x7f59d80b2310 2024-04-15T15:32:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.829+0000 7f59de000640 1 -- 172.21.15.73:0/2037843669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d8068ab0 con 0x7f59d80b2310 2024-04-15T15:32:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.829+0000 7f59cfe00640 1 -- 172.21.15.73:0/2037843669 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59c001a070 con 0x7f59d80b2310 2024-04-15T15:32:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.829+0000 7f59cfe00640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f59b40683b0 0x7f59b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.829+0000 7f59cfe00640 1 -- 172.21.15.73:0/2037843669 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f59c0086dd0 con 0x7f59d80b2310 2024-04-15T15:32:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.829+0000 7f59d7400640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f59b40683b0 0x7f59b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.829+0000 7f59d7400640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f59b40683b0 0x7f59b406a870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f59c80113e0 tx=0x7f59c800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:15.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.833+0000 7f59cfe00640 1 -- 172.21.15.73:0/2037843669 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59c0056950 con 0x7f59d80b2310 2024-04-15T15:32:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.993+0000 7f59de000640 1 -- 172.21.15.73:0/2037843669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59d8154360 con 0x7f59d80b2310 2024-04-15T15:32:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.993+0000 7f59cfe00640 1 -- 172.21.15.73:0/2037843669 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7f59c005ac50 con 0x7f59d80b2310 2024-04-15T15:32:15.996 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:15.996 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 -- 172.21.15.73:0/2037843669 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f59b40683b0 msgr2=0x7f59b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f59b40683b0 0x7f59b406a870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f59c80113e0 tx=0x7f59c800b040 comp rx=0 tx=0).stop 2024-04-15T15:32:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 -- 172.21.15.73:0/2037843669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b2310 msgr2=0x7f59d815f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b2310 0x7f59d815f840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59c000e930 tx=0x7f59c000edf0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 -- 172.21.15.73:0/2037843669 shutdown_connections 2024-04-15T15:32:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f59b40683b0 0x7f59b406a870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59d80b26f0 0x7f59d8149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d80b2310 0x7f59d815f840 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 --2- 172.21.15.73:0/2037843669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d80af440 0x7f59d8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 -- 172.21.15.73:0/2037843669 >> 172.21.15.73:0/2037843669 conn(0x7f59d8067dd0 msgr2=0x7f59d806eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:15.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 -- 172.21.15.73:0/2037843669 shutdown_connections 2024-04-15T15:32:15.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:15.997+0000 7f59de000640 1 -- 172.21.15.73:0/2037843669 wait complete. 2024-04-15T15:32:16.018 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:16.019 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:16.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb60a00640 1 Processor -- start 2024-04-15T15:32:16.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb60a00640 1 -- start start 2024-04-15T15:32:16.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb60a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c15fc90 0x7fdb5c0b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb60a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5c070160 con 0x7fdb5c15b5d0 2024-04-15T15:32:16.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb60a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5c15f1f0 con 0x7fdb5c0b27c0 2024-04-15T15:32:16.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb60a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c15b9b0 con 0x7fdb5c15fc90 2024-04-15T15:32:16.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb59e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdb5c15b5d0 0x7fdb5c0b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52576/0 (socket says 172.21.15.73:52576) 2024-04-15T15:32:16.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb59e00640 1 -- 172.21.15.73:0/1094561054 learned_addr learned my addr 172.21.15.73:0/1094561054 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:16.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb5a800640 1 --2- 172.21.15.73:0/1094561054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c15fc90 0x7fdb5c0b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb59400640 1 -- 172.21.15.73:0/1094561054 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60004892 0 0) 0x7fdb5c070160 con 0x7fdb5c15b5d0 2024-04-15T15:32:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb59400640 1 -- 172.21.15.73:0/1094561054 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb40003530 con 0x7fdb5c15b5d0 2024-04-15T15:32:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb59400640 1 -- 172.21.15.73:0/1094561054 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1318306755 0 0) 0x7fdb5c15f1f0 con 0x7fdb5c0b27c0 2024-04-15T15:32:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb59400640 1 -- 172.21.15.73:0/1094561054 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb5c070160 con 0x7fdb5c0b27c0 2024-04-15T15:32:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb5a800640 1 -- 172.21.15.73:0/1094561054 >> v1:172.21.15.118:6789/0 conn(0x7fdb5c0b27c0 legacy=0x7fdb5c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb59400640 1 -- 172.21.15.73:0/1094561054 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1374267382 0 0) 0x7fdb40003530 con 0x7fdb5c15b5d0 2024-04-15T15:32:16.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb5a800640 1 -- 172.21.15.73:0/1094561054 >> v1:172.21.15.73:6789/0 conn(0x7fdb5c15b5d0 legacy=0x7fdb5c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.157+0000 7fdb5a800640 1 -- 172.21.15.73:0/1094561054 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c06fe80 con 0x7fdb5c15fc90 2024-04-15T15:32:16.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb5a800640 1 --2- 172.21.15.73:0/1094561054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c15fc90 0x7fdb5c0b3e30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009dc0 tx=0x7fdb5401c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd76db8756b53f53 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:16.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb59400640 1 -- 172.21.15.73:0/1094561054 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c001680 con 0x7fdb5c15fc90 2024-04-15T15:32:16.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb59400640 1 -- 172.21.15.73:0/1094561054 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb540a8410 con 0x7fdb5c15fc90 2024-04-15T15:32:16.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb59400640 1 -- 172.21.15.73:0/1094561054 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540a87e0 con 0x7fdb5c15fc90 2024-04-15T15:32:16.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb60a00640 1 -- 172.21.15.73:0/1094561054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c15fc90 msgr2=0x7fdb5c0b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb60a00640 1 --2- 172.21.15.73:0/1094561054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c15fc90 0x7fdb5c0b3e30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009dc0 tx=0x7fdb5401c760 comp rx=0 tx=0).stop 2024-04-15T15:32:16.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb60a00640 1 -- 172.21.15.73:0/1094561054 shutdown_connections 2024-04-15T15:32:16.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb60a00640 1 --2- 172.21.15.73:0/1094561054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c15fc90 0x7fdb5c0b3e30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb60a00640 1 -- 172.21.15.73:0/1094561054 >> 172.21.15.73:0/1094561054 conn(0x7fdb5c067dd0 msgr2=0x7fdb5c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:16.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb60a00640 1 -- 172.21.15.73:0/1094561054 shutdown_connections 2024-04-15T15:32:16.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.161+0000 7fdb60a00640 1 -- 172.21.15.73:0/1094561054 wait complete. 2024-04-15T15:32:16.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb60a00640 1 Processor -- start 2024-04-15T15:32:16.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb60a00640 1 -- start start 2024-04-15T15:32:16.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb60a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c0b27c0 0x7fdb5c14f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb60a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5c15b5d0 0x7fdb5c14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb60a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5c15fc90 0x7fdb5c14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb60a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c06fc20 con 0x7fdb5c15fc90 2024-04-15T15:32:16.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb60a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c06faa0 con 0x7fdb5c15b5d0 2024-04-15T15:32:16.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb60a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c169470 con 0x7fdb5c0b27c0 2024-04-15T15:32:16.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb5a800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5c15fc90 0x7fdb5c14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb5a800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5c15fc90 0x7fdb5c14eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38122/0 (socket says 172.21.15.73:38122) 2024-04-15T15:32:16.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb5a800640 1 -- 172.21.15.73:0/2869410163 learned_addr learned my addr 172.21.15.73:0/2869410163 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:16.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb59e00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c0b27c0 0x7fdb5c14f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb5a800640 1 -- 172.21.15.73:0/2869410163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c0b27c0 msgr2=0x7fdb5c14f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb51400640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5c15b5d0 0x7fdb5c14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb5a800640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c0b27c0 0x7fdb5c14f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb5a800640 1 -- 172.21.15.73:0/2869410163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5c15b5d0 msgr2=0x7fdb5c14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb5a800640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5c15b5d0 0x7fdb5c14fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb5a800640 1 -- 172.21.15.73:0/2869410163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c150370 con 0x7fdb5c15fc90 2024-04-15T15:32:16.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb59e00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c0b27c0 0x7fdb5c14f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:16.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb51400640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5c15b5d0 0x7fdb5c14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:16.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb5a800640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5c15fc90 0x7fdb5c14eac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb54098140 tx=0x7fdb54019500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:16.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb52a00640 1 -- 172.21.15.73:0/2869410163 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540bf070 con 0x7fdb5c15fc90 2024-04-15T15:32:16.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb52a00640 1 -- 172.21.15.73:0/2869410163 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb54003ba0 con 0x7fdb5c15fc90 2024-04-15T15:32:16.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb60a00640 1 -- 172.21.15.73:0/2869410163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5c150640 con 0x7fdb5c15fc90 2024-04-15T15:32:16.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb52a00640 1 -- 172.21.15.73:0/2869410163 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54009450 con 0x7fdb5c15fc90 2024-04-15T15:32:16.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.165+0000 7fdb60a00640 1 -- 172.21.15.73:0/2869410163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5c150c00 con 0x7fdb5c15fc90 2024-04-15T15:32:16.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.169+0000 7fdb60a00640 1 -- 172.21.15.73:0/2869410163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5c068ab0 con 0x7fdb5c15fc90 2024-04-15T15:32:16.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.169+0000 7fdb52a00640 1 -- 172.21.15.73:0/2869410163 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdb540c2070 con 0x7fdb5c15fc90 2024-04-15T15:32:16.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.169+0000 7fdb52a00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdb38068380 0x7fdb3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.169+0000 7fdb52a00640 1 -- 172.21.15.73:0/2869410163 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fdb541212f0 con 0x7fdb5c15fc90 2024-04-15T15:32:16.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.169+0000 7fdb59e00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdb38068380 0x7fdb3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.169+0000 7fdb59e00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdb38068380 0x7fdb3806a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c000fc0 tx=0x7fdb4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:16.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.173+0000 7fdb52a00640 1 -- 172.21.15.73:0/2869410163 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdb540b7070 con 0x7fdb5c15fc90 2024-04-15T15:32:16.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 -- 172.21.15.73:0/2869410163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdb5c06f370 con 0x7fdb5c15fc90 2024-04-15T15:32:16.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb52a00640 1 -- 172.21.15.73:0/2869410163 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fdb540ac030 con 0x7fdb5c15fc90 2024-04-15T15:32:16.333 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:16.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 -- 172.21.15.73:0/2869410163 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdb38068380 msgr2=0x7fdb3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdb38068380 0x7fdb3806a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c000fc0 tx=0x7fdb4c009040 comp rx=0 tx=0).stop 2024-04-15T15:32:16.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 -- 172.21.15.73:0/2869410163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5c15fc90 msgr2=0x7fdb5c14eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5c15fc90 0x7fdb5c14eac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb54098140 tx=0x7fdb54019500 comp rx=0 tx=0).stop 2024-04-15T15:32:16.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 -- 172.21.15.73:0/2869410163 shutdown_connections 2024-04-15T15:32:16.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5c15fc90 0x7fdb5c14eac0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5c15b5d0 0x7fdb5c14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fdb38068380 0x7fdb3806a840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 --2- 172.21.15.73:0/2869410163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb5c0b27c0 0x7fdb5c14f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 -- 172.21.15.73:0/2869410163 >> 172.21.15.73:0/2869410163 conn(0x7fdb5c067dd0 msgr2=0x7fdb5c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:16.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 -- 172.21.15.73:0/2869410163 shutdown_connections 2024-04-15T15:32:16.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.333+0000 7fdb60a00640 1 -- 172.21.15.73:0/2869410163 wait complete. 2024-04-15T15:32:16.354 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:16.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.489+0000 7ff9eba00640 1 Processor -- start 2024-04-15T15:32:16.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.489+0000 7ff9eba00640 1 -- start start 2024-04-15T15:32:16.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9eba00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e415b5d0 0x7ff9e415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9eba00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff9e40b3e30 0x7ff9e40b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9eba00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9e40b25f0 0x7ff9e40b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9eba00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e415b9b0 con 0x7ff9e40b25f0 2024-04-15T15:32:16.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9eba00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e4070160 con 0x7ff9e40b3e30 2024-04-15T15:32:16.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9eba00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e415f1f0 con 0x7ff9e415b5d0 2024-04-15T15:32:16.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e9a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9e40b25f0 0x7ff9e40b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e9a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9e40b25f0 0x7ff9e40b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38124/0 (socket says 172.21.15.73:38124) 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e9a00640 1 -- 172.21.15.73:0/2368204118 learned_addr learned my addr 172.21.15.73:0/2368204118 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e3e00640 1 --2- 172.21.15.73:0/2368204118 >> v2:172.21.15.118:3300/0 conn(0x7ff9e40b3e30 0x7ff9e40b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e9000640 1 --2- 172.21.15.73:0/2368204118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e415b5d0 0x7ff9e415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e9a00640 1 -- 172.21.15.73:0/2368204118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e415b5d0 msgr2=0x7ff9e415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e9a00640 1 --2- 172.21.15.73:0/2368204118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e415b5d0 0x7ff9e415fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e9a00640 1 -- 172.21.15.73:0/2368204118 >> v2:172.21.15.118:3300/0 conn(0x7ff9e40b3e30 msgr2=0x7ff9e40b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e9a00640 1 --2- 172.21.15.73:0/2368204118 >> v2:172.21.15.118:3300/0 conn(0x7ff9e40b3e30 0x7ff9e40b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e9a00640 1 -- 172.21.15.73:0/2368204118 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e406fe80 con 0x7ff9e40b25f0 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e3e00640 1 --2- 172.21.15.73:0/2368204118 >> v2:172.21.15.118:3300/0 conn(0x7ff9e40b3e30 0x7ff9e40b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:16.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.493+0000 7ff9e9000640 1 --2- 172.21.15.73:0/2368204118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e415b5d0 0x7ff9e415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:16.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9e9a00640 1 --2- 172.21.15.73:0/2368204118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b25f0 0x7ff9e40b4740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40731e0 tx=0x7ff9dc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46538daf15d4689 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:16.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9e3400640 1 -- 172.21.15.73:0/2368204118 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0090d0 con 0x7ff9e40b25f0 2024-04-15T15:32:16.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9e3400640 1 -- 172.21.15.73:0/2368204118 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0a5640 con 0x7ff9e40b25f0 2024-04-15T15:32:16.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9e3400640 1 -- 172.21.15.73:0/2368204118 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc009270 con 0x7ff9e40b25f0 2024-04-15T15:32:16.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 -- 172.21.15.73:0/2368204118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b25f0 msgr2=0x7ff9e40b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 --2- 172.21.15.73:0/2368204118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b25f0 0x7ff9e40b4740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40731e0 tx=0x7ff9dc01c8d0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 -- 172.21.15.73:0/2368204118 shutdown_connections 2024-04-15T15:32:16.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 --2- 172.21.15.73:0/2368204118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b25f0 0x7ff9e40b4740 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 --2- 172.21.15.73:0/2368204118 >> v2:172.21.15.118:3300/0 conn(0x7ff9e40b3e30 0x7ff9e40b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 --2- 172.21.15.73:0/2368204118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e415b5d0 0x7ff9e415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 -- 172.21.15.73:0/2368204118 >> 172.21.15.73:0/2368204118 conn(0x7ff9e4067dd0 msgr2=0x7ff9e40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:16.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 -- 172.21.15.73:0/2368204118 shutdown_connections 2024-04-15T15:32:16.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 -- 172.21.15.73:0/2368204118 wait complete. 2024-04-15T15:32:16.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 Processor -- start 2024-04-15T15:32:16.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 -- start start 2024-04-15T15:32:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e40b25f0 0x7ff9e415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b3e30 0x7ff9e40b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9e415b5d0 0x7ff9e41501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40b4390 con 0x7ff9e40b3e30 2024-04-15T15:32:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40b4210 con 0x7ff9e415b5d0 2024-04-15T15:32:16.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.497+0000 7ff9eba00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e406faa0 con 0x7ff9e40b25f0 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b3e30 0x7ff9e40b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b3e30 0x7ff9e40b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38140/0 (socket says 172.21.15.73:38140) 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e3e00640 1 -- 172.21.15.73:0/2204434870 learned_addr learned my addr 172.21.15.73:0/2204434870 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e9a00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9e415b5d0 0x7ff9e41501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e9000640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e40b25f0 0x7ff9e415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e3e00640 1 -- 172.21.15.73:0/2204434870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e40b25f0 msgr2=0x7ff9e415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e3e00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e40b25f0 0x7ff9e415a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e3e00640 1 -- 172.21.15.73:0/2204434870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9e415b5d0 msgr2=0x7ff9e41501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e3e00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9e415b5d0 0x7ff9e41501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e3e00640 1 -- 172.21.15.73:0/2204434870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e4156a30 con 0x7ff9e40b3e30 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e9000640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e40b25f0 0x7ff9e415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:16.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e3e00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b3e30 0x7ff9e40b1470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000c7f0 tx=0x7ff9d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:16.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e0c00640 1 -- 172.21.15.73:0/2204434870 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0015070 con 0x7ff9e40b3e30 2024-04-15T15:32:16.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e0c00640 1 -- 172.21.15.73:0/2204434870 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d0007820 con 0x7ff9e40b3e30 2024-04-15T15:32:16.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e0c00640 1 -- 172.21.15.73:0/2204434870 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0007c10 con 0x7ff9e40b3e30 2024-04-15T15:32:16.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9eba00640 1 -- 172.21.15.73:0/2204434870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e4152ba0 con 0x7ff9e40b3e30 2024-04-15T15:32:16.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9eba00640 1 -- 172.21.15.73:0/2204434870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e4153440 con 0x7ff9e40b3e30 2024-04-15T15:32:16.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9eba00640 1 -- 172.21.15.73:0/2204434870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e4068ab0 con 0x7ff9e40b3e30 2024-04-15T15:32:16.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e0c00640 1 -- 172.21.15.73:0/2204434870 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff9d0018070 con 0x7ff9e40b3e30 2024-04-15T15:32:16.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.501+0000 7ff9e0c00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff9c40683b0 0x7ff9c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.505+0000 7ff9e0c00640 1 -- 172.21.15.73:0/2204434870 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7ff9d0086d90 con 0x7ff9e40b3e30 2024-04-15T15:32:16.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.505+0000 7ff9e9000640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff9c40683b0 0x7ff9c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.505+0000 7ff9e9000640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff9c40683b0 0x7ff9c406a870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400a930 tx=0x7ff9d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.505+0000 7ff9e0c00640 1 -- 172.21.15.73:0/2204434870 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9d0056980 con 0x7ff9e40b3e30 2024-04-15T15:32:16.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.665+0000 7ff9eba00640 1 -- 172.21.15.73:0/2204434870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff9e406ea40 con 0x7ff9e40b3e30 2024-04-15T15:32:16.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.665+0000 7ff9e0c00640 1 -- 172.21.15.73:0/2204434870 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7ff9d005ac80 con 0x7ff9e40b3e30 2024-04-15T15:32:16.667 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 -- 172.21.15.73:0/2204434870 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff9c40683b0 msgr2=0x7ff9c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff9c40683b0 0x7ff9c406a870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400a930 tx=0x7ff9d4008040 comp rx=0 tx=0).stop 2024-04-15T15:32:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 -- 172.21.15.73:0/2204434870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b3e30 msgr2=0x7ff9e40b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b3e30 0x7ff9e40b1470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000c7f0 tx=0x7ff9d000ccb0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 -- 172.21.15.73:0/2204434870 shutdown_connections 2024-04-15T15:32:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9e415b5d0 0x7ff9e41501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9e40b3e30 0x7ff9e40b1470 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff9c40683b0 0x7ff9c406a870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 --2- 172.21.15.73:0/2204434870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9e40b25f0 0x7ff9e415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 -- 172.21.15.73:0/2204434870 >> 172.21.15.73:0/2204434870 conn(0x7ff9e4067dd0 msgr2=0x7ff9e40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 -- 172.21.15.73:0/2204434870 shutdown_connections 2024-04-15T15:32:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.669+0000 7ff9eba00640 1 -- 172.21.15.73:0/2204434870 wait complete. 2024-04-15T15:32:16.689 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:16.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd52200640 1 Processor -- start 2024-04-15T15:32:16.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd52200640 1 -- start start 2024-04-15T15:32:16.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd52200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd4c15b5d0 0x7fcd4c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd52200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd4c0b27c0 0x7fcd4c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd52200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd4c070160 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd52200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4c15b9b0 con 0x7fcd4c15b5d0 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd52200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4c15f1f0 con 0x7fcd4c0b27c0 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd4b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd4c15b5d0 0x7fcd4c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd4b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd4c15b5d0 0x7fcd4c15fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38142/0 (socket says 172.21.15.73:38142) 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd4b400640 1 -- 172.21.15.73:0/2517535885 learned_addr learned my addr 172.21.15.73:0/2517535885 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.825+0000 7fcd4be00640 1 --2- 172.21.15.73:0/2517535885 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c0b27c0 0x7fcd4c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd4b400640 1 -- 172.21.15.73:0/2517535885 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c0b27c0 msgr2=0x7fcd4c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd4b400640 1 --2- 172.21.15.73:0/2517535885 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c0b27c0 0x7fcd4c0b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd4b400640 1 -- 172.21.15.73:0/2517535885 >> v1:172.21.15.118:6789/0 conn(0x7fcd4c0b3e30 legacy=0x7fcd4c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd4b400640 1 -- 172.21.15.73:0/2517535885 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c06fe80 con 0x7fcd4c15b5d0 2024-04-15T15:32:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd4b400640 1 --2- 172.21.15.73:0/2517535885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15b5d0 0x7fcd4c15fc90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00d150 tx=0x7fcd3c01ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f9ce5fbcd32801 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd4a000640 1 -- 172.21.15.73:0/2517535885 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c00b0d0 con 0x7fcd4c15b5d0 2024-04-15T15:32:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd4a000640 1 -- 172.21.15.73:0/2517535885 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3c00b270 con 0x7fcd4c15b5d0 2024-04-15T15:32:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd4a000640 1 -- 172.21.15.73:0/2517535885 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0a7930 con 0x7fcd4c15b5d0 2024-04-15T15:32:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd52200640 1 -- 172.21.15.73:0/2517535885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15b5d0 msgr2=0x7fcd4c15fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd52200640 1 --2- 172.21.15.73:0/2517535885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15b5d0 0x7fcd4c15fc90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00d150 tx=0x7fcd3c01ea60 comp rx=0 tx=0).stop 2024-04-15T15:32:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd52200640 1 -- 172.21.15.73:0/2517535885 shutdown_connections 2024-04-15T15:32:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd52200640 1 --2- 172.21.15.73:0/2517535885 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c0b27c0 0x7fcd4c0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd52200640 1 --2- 172.21.15.73:0/2517535885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15b5d0 0x7fcd4c15fc90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.829+0000 7fcd52200640 1 -- 172.21.15.73:0/2517535885 >> 172.21.15.73:0/2517535885 conn(0x7fcd4c067dd0 msgr2=0x7fcd4c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 -- 172.21.15.73:0/2517535885 shutdown_connections 2024-04-15T15:32:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 -- 172.21.15.73:0/2517535885 wait complete. 2024-04-15T15:32:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 Processor -- start 2024-04-15T15:32:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 -- start start 2024-04-15T15:32:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b27c0 0x7fcd4c153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c0b3e30 0x7fcd4c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c15b5d0 0x7fcd4c1fab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c06faa0 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0cfd00 con 0x7fcd4c15b5d0 2024-04-15T15:32:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c06fc20 con 0x7fcd4c0b27c0 2024-04-15T15:32:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c0b3e30 0x7fcd4c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c0b3e30 0x7fcd4c15cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38154/0 (socket says 172.21.15.73:38154) 2024-04-15T15:32:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4aa00640 1 -- 172.21.15.73:0/550114779 learned_addr learned my addr 172.21.15.73:0/550114779 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4b400640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b27c0 0x7fcd4c153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4be00640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c15b5d0 0x7fcd4c1fab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4aa00640 1 -- 172.21.15.73:0/550114779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b27c0 msgr2=0x7fcd4c153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4aa00640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b27c0 0x7fcd4c153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4aa00640 1 -- 172.21.15.73:0/550114779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c15b5d0 msgr2=0x7fcd4c1fab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4aa00640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c15b5d0 0x7fcd4c1fab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4aa00640 1 -- 172.21.15.73:0/550114779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c1fb550 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd4aa00640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c0b3e30 0x7fcd4c15cd40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b410 tx=0x7fcd3800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd43400640 1 -- 172.21.15.73:0/550114779 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38015020 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd43400640 1 -- 172.21.15.73:0/550114779 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd38011830 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.833+0000 7fcd52200640 1 -- 172.21.15.73:0/550114779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c1fb830 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.837+0000 7fcd43400640 1 -- 172.21.15.73:0/550114779 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38011c60 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.837+0000 7fcd52200640 1 -- 172.21.15.73:0/550114779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c154b50 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.837+0000 7fcd52200640 1 -- 172.21.15.73:0/550114779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c068ab0 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.837+0000 7fcd43400640 1 -- 172.21.15.73:0/550114779 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd38018020 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.837+0000 7fcd43400640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 0x7fcd2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.837+0000 7fcd43400640 1 -- 172.21.15.73:0/550114779 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fcd38086960 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.837+0000 7fcd4b400640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 0x7fcd2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.837+0000 7fcd4b400640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 0x7fcd2c06a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0b0000 tx=0x7fcd3c0a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:16.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.841+0000 7fcd43400640 1 -- 172.21.15.73:0/550114779 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd3801f030 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.997+0000 7fcd52200640 1 -- 172.21.15.73:0/550114779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcd4c1fba00 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:16.997+0000 7fcd43400640 1 -- 172.21.15.73:0/550114779 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fcd38056b00 con 0x7fcd4c0b3e30 2024-04-15T15:32:16.999 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 -- 172.21.15.73:0/550114779 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 msgr2=0x7fcd2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 0x7fcd2c06a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0b0000 tx=0x7fcd3c0a9070 comp rx=0 tx=0).stop 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 -- 172.21.15.73:0/550114779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c0b3e30 msgr2=0x7fcd4c15cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c0b3e30 0x7fcd4c15cd40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b410 tx=0x7fcd3800b810 comp rx=0 tx=0).stop 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 -- 172.21.15.73:0/550114779 shutdown_connections 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c15b5d0 0x7fcd4c1fab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c0b3e30 0x7fcd4c15cd40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 0x7fcd2c06a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 --2- 172.21.15.73:0/550114779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b27c0 0x7fcd4c153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 -- 172.21.15.73:0/550114779 >> 172.21.15.73:0/550114779 conn(0x7fcd4c067dd0 msgr2=0x7fcd4c071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:17.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 -- 172.21.15.73:0/550114779 shutdown_connections 2024-04-15T15:32:17.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.001+0000 7fcd52200640 1 -- 172.21.15.73:0/550114779 wait complete. 2024-04-15T15:32:17.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.157+0000 7f16d9400640 1 Processor -- start 2024-04-15T15:32:17.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.157+0000 7f16d9400640 1 -- start start 2024-04-15T15:32:17.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d9400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f16d406d570 0x7f16d406d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d9400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16d40b4b00 0x7f16d40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d9400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d406de90 con 0x7f16d415eb80 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d9400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f16d409b360 con 0x7f16d40b4b00 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d9400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f16d40cca90 con 0x7f16d406d570 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d8a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16d40b4b00 0x7f16d40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d8a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16d40b4b00 0x7f16d40cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39374/0 (socket says 172.21.15.73:39374) 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d8a00640 1 -- 172.21.15.73:0/1309060748 learned_addr learned my addr 172.21.15.73:0/1309060748 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d8a00640 1 -- 172.21.15.73:0/1309060748 >> v2:172.21.15.118:3300/0 conn(0x7f16d406d570 msgr2=0x7f16d406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d8a00640 1 --2- 172.21.15.73:0/1309060748 >> v2:172.21.15.118:3300/0 conn(0x7f16d406d570 0x7f16d406d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d8a00640 1 -- 172.21.15.73:0/1309060748 >> v1:172.21.15.118:6789/0 conn(0x7f16d415eb80 legacy=0x7f16d409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d8a00640 1 -- 172.21.15.73:0/1309060748 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d40ccd70 con 0x7f16d40b4b00 2024-04-15T15:32:17.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.161+0000 7f16d8a00640 1 --2- 172.21.15.73:0/1309060748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d40b4b00 0x7f16d40cd570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f16d4069760 tx=0x7f16cc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d779e66c2a298e61 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:17.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d3400640 1 -- 172.21.15.73:0/1309060748 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0b0070 con 0x7f16d40b4b00 2024-04-15T15:32:17.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d3400640 1 -- 172.21.15.73:0/1309060748 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16cc0ab600 con 0x7f16d40b4b00 2024-04-15T15:32:17.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d3400640 1 -- 172.21.15.73:0/1309060748 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0ab9d0 con 0x7f16d40b4b00 2024-04-15T15:32:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 -- 172.21.15.73:0/1309060748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d40b4b00 msgr2=0x7f16d40cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 --2- 172.21.15.73:0/1309060748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d40b4b00 0x7f16d40cd570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f16d4069760 tx=0x7f16cc01c450 comp rx=0 tx=0).stop 2024-04-15T15:32:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 -- 172.21.15.73:0/1309060748 shutdown_connections 2024-04-15T15:32:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 --2- 172.21.15.73:0/1309060748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d40b4b00 0x7f16d40cd570 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 --2- 172.21.15.73:0/1309060748 >> v2:172.21.15.118:3300/0 conn(0x7f16d406d570 0x7f16d406d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 -- 172.21.15.73:0/1309060748 >> 172.21.15.73:0/1309060748 conn(0x7f16d40b3e90 msgr2=0x7f16d40b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:17.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 -- 172.21.15.73:0/1309060748 shutdown_connections 2024-04-15T15:32:17.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 -- 172.21.15.73:0/1309060748 wait complete. 2024-04-15T15:32:17.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 Processor -- start 2024-04-15T15:32:17.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 -- start start 2024-04-15T15:32:17.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d406d570 0x7f16d40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d40b4b00 0x7f16d4159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16d415eb80 0x7f16d41511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f16d40ce650 con 0x7f16d406d570 2024-04-15T15:32:17.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f16d40ce4d0 con 0x7f16d40b4b00 2024-04-15T15:32:17.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d9400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f16d40ce7d0 con 0x7f16d415eb80 2024-04-15T15:32:17.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d406d570 0x7f16d40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d406d570 0x7f16d40b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39390/0 (socket says 172.21.15.73:39390) 2024-04-15T15:32:17.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d3e00640 1 -- 172.21.15.73:0/2096317586 learned_addr learned my addr 172.21.15.73:0/2096317586 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:17.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16cb400640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d40b4b00 0x7f16d4159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.165+0000 7f16d8a00640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16d415eb80 0x7f16d41511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d3e00640 1 -- 172.21.15.73:0/2096317586 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16d415eb80 msgr2=0x7f16d41511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d3e00640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16d415eb80 0x7f16d41511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d3e00640 1 -- 172.21.15.73:0/2096317586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d40b4b00 msgr2=0x7f16d4159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d3e00640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d40b4b00 0x7f16d4159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d3e00640 1 -- 172.21.15.73:0/2096317586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d415a520 con 0x7f16d406d570 2024-04-15T15:32:17.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16cb400640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d40b4b00 0x7f16d4159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:17.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d3e00640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d406d570 0x7f16d40b32e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f16c400ba50 tx=0x7f16c400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:17.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d0c00640 1 -- 172.21.15.73:0/2096317586 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4019070 con 0x7f16d406d570 2024-04-15T15:32:17.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d0c00640 1 -- 172.21.15.73:0/2096317586 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c400cc00 con 0x7f16d406d570 2024-04-15T15:32:17.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d9400640 1 -- 172.21.15.73:0/2096317586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d415a800 con 0x7f16d406d570 2024-04-15T15:32:17.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d0c00640 1 -- 172.21.15.73:0/2096317586 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4014440 con 0x7f16d406d570 2024-04-15T15:32:17.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d9400640 1 -- 172.21.15.73:0/2096317586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d415adc0 con 0x7f16d406d570 2024-04-15T15:32:17.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d9400640 1 -- 172.21.15.73:0/2096317586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d404fd60 con 0x7f16d406d570 2024-04-15T15:32:17.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d0c00640 1 -- 172.21.15.73:0/2096317586 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f16c401c070 con 0x7f16d406d570 2024-04-15T15:32:17.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d0c00640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16b0068380 0x7f16b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16d0c00640 1 -- 172.21.15.73:0/2096317586 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f16c4086c30 con 0x7f16d406d570 2024-04-15T15:32:17.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.169+0000 7f16cb400640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16b0068380 0x7f16b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.173+0000 7f16cb400640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16b0068380 0x7f16b006a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16d4159910 tx=0x7f16bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:17.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.173+0000 7f16d0c00640 1 -- 172.21.15.73:0/2096317586 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f16c4056d40 con 0x7f16d406d570 2024-04-15T15:32:17.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 -- 172.21.15.73:0/2096317586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f16d406d350 con 0x7f16d406d570 2024-04-15T15:32:17.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d0c00640 1 -- 172.21.15.73:0/2096317586 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f16c4056640 con 0x7f16d406d570 2024-04-15T15:32:17.334 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:17.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 -- 172.21.15.73:0/2096317586 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16b0068380 msgr2=0x7f16b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16b0068380 0x7f16b006a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16d4159910 tx=0x7f16bc008040 comp rx=0 tx=0).stop 2024-04-15T15:32:17.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 -- 172.21.15.73:0/2096317586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d406d570 msgr2=0x7f16d40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d406d570 0x7f16d40b32e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f16c400ba50 tx=0x7f16c400bf10 comp rx=0 tx=0).stop 2024-04-15T15:32:17.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 -- 172.21.15.73:0/2096317586 shutdown_connections 2024-04-15T15:32:17.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16b0068380 0x7f16b006a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16d415eb80 0x7f16d41511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d40b4b00 0x7f16d4159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 --2- 172.21.15.73:0/2096317586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d406d570 0x7f16d40b32e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 -- 172.21.15.73:0/2096317586 >> 172.21.15.73:0/2096317586 conn(0x7f16d40b3e90 msgr2=0x7f16d40cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:17.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 -- 172.21.15.73:0/2096317586 shutdown_connections 2024-04-15T15:32:17.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.333+0000 7f16d9400640 1 -- 172.21.15.73:0/2096317586 wait complete. 2024-04-15T15:32:17.356 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:17.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.489+0000 7f14a6800640 1 Processor -- start 2024-04-15T15:32:17.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.489+0000 7f14a6800640 1 -- start start 2024-04-15T15:32:17.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f14a6800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a015b5d0 0x7f14a015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f14a6800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f14a00b27c0 0x7f14a00b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f14a6800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a0070160 con 0x7f14a00b3e30 2024-04-15T15:32:17.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f14a6800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f14a015b9b0 con 0x7f14a00b27c0 2024-04-15T15:32:17.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f14a6800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f14a015f1f0 con 0x7f14a015b5d0 2024-04-15T15:32:17.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149ea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f14a00b3e30 0x7f14a00b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45472/0 (socket says 172.21.15.73:45472) 2024-04-15T15:32:17.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149ea00640 1 -- 172.21.15.73:0/46491284 learned_addr learned my addr 172.21.15.73:0/46491284 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:17.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149fe00640 1 --2- 172.21.15.73:0/46491284 >> v2:172.21.15.118:3300/0 conn(0x7f14a00b27c0 0x7f14a00b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149f400640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a015b5d0 0x7f14a015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156407554 0 0) 0x7f14a0070160 con 0x7f14a00b3e30 2024-04-15T15:32:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1484003530 con 0x7f14a00b3e30 2024-04-15T15:32:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3054330424 0 0) 0x7f1484003530 con 0x7f14a00b3e30 2024-04-15T15:32:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a015b5d0 msgr2=0x7f14a015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a015b5d0 0x7f14a015fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 >> v2:172.21.15.118:3300/0 conn(0x7f14a00b27c0 msgr2=0x7f14a00b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 --2- 172.21.15.73:0/46491284 >> v2:172.21.15.118:3300/0 conn(0x7f14a00b27c0 0x7f14a00b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a006fe80 con 0x7f14a00b3e30 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f148c001680 con 0x7f14a00b3e30 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 >> v1:172.21.15.73:6789/0 conn(0x7f14a00b3e30 legacy=0x7f14a00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840039c0 0x7f1484003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 0x7f1484004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a015b5d0 0x7f14840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f14a015f1f0 con 0x7f1484004810 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f148400b9d0 con 0x7f14840039c0 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f148400bbd0 con 0x7f14a015b5d0 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149fe00640 1 --2- 172.21.15.73:0/46491284 >> v2:172.21.15.118:3300/0 conn(0x7f14a00b27c0 0x7f14a00b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149ea00640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 0x7f1484004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149f400640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840039c0 0x7f1484003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149fe00640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a015b5d0 0x7f14840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149ea00640 1 -- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a015b5d0 msgr2=0x7f14840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149ea00640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a015b5d0 0x7f14840051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149ea00640 1 -- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840039c0 msgr2=0x7f1484003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149ea00640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840039c0 0x7f1484003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149ea00640 1 -- 172.21.15.73:0/46491284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1484003530 con 0x7f1484004810 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.493+0000 7f149fe00640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a015b5d0 0x7f14840051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f149ea00640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 0x7f1484004c90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f148c00c2c0 tx=0x7f148c01cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7c0d582cb3f92e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c007d60 con 0x7f1484004810 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f148c0a9020 con 0x7f1484004810 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f149e000640 1 -- 172.21.15.73:0/46491284 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c0058e0 con 0x7f1484004810 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f14a6800640 1 -- 172.21.15.73:0/46491284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 msgr2=0x7f1484004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f14a6800640 1 --2- 172.21.15.73:0/46491284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 0x7f1484004c90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f148c00c2c0 tx=0x7f148c01cd10 comp rx=0 tx=0).stop 2024-04-15T15:32:17.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f149fe00640 1 -- 172.21.15.73:0/46491284 reap_dead start 2024-04-15T15:32:17.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f14a6800640 1 -- 172.21.15.73:0/46491284 shutdown_connections 2024-04-15T15:32:17.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f14a6800640 1 -- 172.21.15.73:0/46491284 >> 172.21.15.73:0/46491284 conn(0x7f14a0067dd0 msgr2=0x7f14a00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:17.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f14a6800640 1 -- 172.21.15.73:0/46491284 shutdown_connections 2024-04-15T15:32:17.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f14a6800640 1 -- 172.21.15.73:0/46491284 wait complete. 2024-04-15T15:32:17.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.497+0000 7f14a6800640 1 Processor -- start 2024-04-15T15:32:17.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f14a6800640 1 -- start start 2024-04-15T15:32:17.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f14a6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 0x7f14a013ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f14a6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14a014f830 0x7f14a01525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f14a6800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a0152b30 0x7f14a0140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f14a6800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f14a006faa0 con 0x7f1484004810 2024-04-15T15:32:17.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f14a6800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f14a00b4250 con 0x7f14a014f830 2024-04-15T15:32:17.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f14a6800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f14a006fc20 con 0x7f14a0152b30 2024-04-15T15:32:17.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f149f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 0x7f14a013ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f149f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 0x7f14a013ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39406/0 (socket says 172.21.15.73:39406) 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f149f400640 1 -- 172.21.15.73:0/3872367435 learned_addr learned my addr 172.21.15.73:0/3872367435 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f149f400640 1 -- 172.21.15.73:0/3872367435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a0152b30 msgr2=0x7f14a0140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f149f400640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a0152b30 0x7f14a0140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f149f400640 1 -- 172.21.15.73:0/3872367435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14a014f830 msgr2=0x7f14a01525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f149f400640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14a014f830 0x7f14a01525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f149f400640 1 -- 172.21.15.73:0/3872367435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a014fcb0 con 0x7f1484004810 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f149f400640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 0x7f14a013ead0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1490009fc0 tx=0x7f149000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f1497400640 1 -- 172.21.15.73:0/3872367435 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490015430 con 0x7f1484004810 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f1497400640 1 -- 172.21.15.73:0/3872367435 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14900155d0 con 0x7f1484004810 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f1497400640 1 -- 172.21.15.73:0/3872367435 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14900159c0 con 0x7f1484004810 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f14a6800640 1 -- 172.21.15.73:0/3872367435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a0153040 con 0x7f1484004810 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f14a6800640 1 -- 172.21.15.73:0/3872367435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a015cea0 con 0x7f1484004810 2024-04-15T15:32:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.501+0000 7f14a6800640 1 -- 172.21.15.73:0/3872367435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a0068ab0 con 0x7f1484004810 2024-04-15T15:32:17.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.505+0000 7f1497400640 1 -- 172.21.15.73:0/3872367435 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1490015b60 con 0x7f1484004810 2024-04-15T15:32:17.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.505+0000 7f1497400640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1480068380 0x7f148006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.505+0000 7f1497400640 1 -- 172.21.15.73:0/3872367435 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f1490087da0 con 0x7f1484004810 2024-04-15T15:32:17.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.505+0000 7f149ea00640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1480068380 0x7f148006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.505+0000 7f149ea00640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1480068380 0x7f148006a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f148c0aa000 tx=0x7f14a0070050 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:17.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.509+0000 7f1497400640 1 -- 172.21.15.73:0/3872367435 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1490019030 con 0x7f1484004810 2024-04-15T15:32:17.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.669+0000 7f14a6800640 1 -- 172.21.15.73:0/3872367435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14a006f370 con 0x7f1484004810 2024-04-15T15:32:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.669+0000 7f1497400640 1 -- 172.21.15.73:0/3872367435 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7f1490010040 con 0x7f1484004810 2024-04-15T15:32:17.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:17.672 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 -- 172.21.15.73:0/3872367435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1480068380 msgr2=0x7f148006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1480068380 0x7f148006a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f148c0aa000 tx=0x7f14a0070050 comp rx=0 tx=0).stop 2024-04-15T15:32:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 -- 172.21.15.73:0/3872367435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 msgr2=0x7f14a013ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 0x7f14a013ead0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1490009fc0 tx=0x7f149000f580 comp rx=0 tx=0).stop 2024-04-15T15:32:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 -- 172.21.15.73:0/3872367435 shutdown_connections 2024-04-15T15:32:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1480068380 0x7f148006a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14a0152b30 0x7f14a0140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14a014f830 0x7f14a01525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 --2- 172.21.15.73:0/3872367435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1484004810 0x7f14a013ead0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 -- 172.21.15.73:0/3872367435 >> 172.21.15.73:0/3872367435 conn(0x7f14a0067dd0 msgr2=0x7f14a006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 -- 172.21.15.73:0/3872367435 shutdown_connections 2024-04-15T15:32:17.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.673+0000 7f14a6800640 1 -- 172.21.15.73:0/3872367435 wait complete. 2024-04-15T15:32:17.695 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:17.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:17.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.829+0000 7fec5be00640 1 Processor -- start 2024-04-15T15:32:17.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.829+0000 7fec5be00640 1 -- start start 2024-04-15T15:32:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec5be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 0x7fec540cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec5be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec540b20b0 0x7fec540b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec5be00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fec54071e10 0x7fec540722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec5be00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fec540cd3a0 con 0x7fec540b20b0 2024-04-15T15:32:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec5be00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fec540b5160 con 0x7fec54071e10 2024-04-15T15:32:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec5be00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fec540b40c0 con 0x7fec54146110 2024-04-15T15:32:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec58a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec540b20b0 0x7fec540b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec58a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec540b20b0 0x7fec540b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39412/0 (socket says 172.21.15.73:39412) 2024-04-15T15:32:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec58a00640 1 -- 172.21.15.73:0/869626088 learned_addr learned my addr 172.21.15.73:0/869626088 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec59e00640 1 --2- 172.21.15.73:0/869626088 >> v2:172.21.15.118:3300/0 conn(0x7fec54071e10 0x7fec540722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec59400640 1 --2- 172.21.15.73:0/869626088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 0x7fec540cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec58a00640 1 -- 172.21.15.73:0/869626088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 msgr2=0x7fec540cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec58a00640 1 --2- 172.21.15.73:0/869626088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 0x7fec540cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec58a00640 1 -- 172.21.15.73:0/869626088 >> v2:172.21.15.118:3300/0 conn(0x7fec54071e10 msgr2=0x7fec540722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec58a00640 1 --2- 172.21.15.73:0/869626088 >> v2:172.21.15.118:3300/0 conn(0x7fec54071e10 0x7fec540722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec58a00640 1 -- 172.21.15.73:0/869626088 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec540b43a0 con 0x7fec540b20b0 2024-04-15T15:32:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.833+0000 7fec59400640 1 --2- 172.21.15.73:0/869626088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 0x7fec540cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec58a00640 1 --2- 172.21.15.73:0/869626088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 0x7fec540b2530 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec54073290 tx=0x7fec4001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63777c87e54503f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec53e00640 1 -- 172.21.15.73:0/869626088 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec400b1070 con 0x7fec540b20b0 2024-04-15T15:32:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec53e00640 1 -- 172.21.15.73:0/869626088 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec400ac630 con 0x7fec540b20b0 2024-04-15T15:32:17.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec53e00640 1 -- 172.21.15.73:0/869626088 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec400a8050 con 0x7fec540b20b0 2024-04-15T15:32:17.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 -- 172.21.15.73:0/869626088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 msgr2=0x7fec540b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 --2- 172.21.15.73:0/869626088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 0x7fec540b2530 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec54073290 tx=0x7fec4001c520 comp rx=0 tx=0).stop 2024-04-15T15:32:17.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 -- 172.21.15.73:0/869626088 shutdown_connections 2024-04-15T15:32:17.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 --2- 172.21.15.73:0/869626088 >> v2:172.21.15.118:3300/0 conn(0x7fec54071e10 0x7fec540722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 --2- 172.21.15.73:0/869626088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 0x7fec540b2530 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 --2- 172.21.15.73:0/869626088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 0x7fec540cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 -- 172.21.15.73:0/869626088 >> 172.21.15.73:0/869626088 conn(0x7fec54067dd0 msgr2=0x7fec540d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 -- 172.21.15.73:0/869626088 shutdown_connections 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 -- 172.21.15.73:0/869626088 wait complete. 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 Processor -- start 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.837+0000 7fec5be00640 1 -- start start 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec5be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec54071e10 0x7fec540cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec5be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 0x7fec540c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec5be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 0x7fec540c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec5be00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec540b3d70 con 0x7fec540b20b0 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec5be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fec540b4c40 con 0x7fec54071e10 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec5be00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fec540cdcf0 con 0x7fec54146110 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec58a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 0x7fec540c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec59400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec54071e10 0x7fec540cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec58a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 0x7fec540c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39426/0 (socket says 172.21.15.73:39426) 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec58a00640 1 -- 172.21.15.73:0/1887239531 learned_addr learned my addr 172.21.15.73:0/1887239531 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec59e00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 0x7fec540c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec58a00640 1 -- 172.21.15.73:0/1887239531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 msgr2=0x7fec540c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec58a00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 0x7fec540c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec58a00640 1 -- 172.21.15.73:0/1887239531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec54071e10 msgr2=0x7fec540cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec58a00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec54071e10 0x7fec540cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec58a00640 1 -- 172.21.15.73:0/1887239531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec540c8010 con 0x7fec540b20b0 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec59e00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 0x7fec540c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec58a00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 0x7fec540c7400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec400af040 tx=0x7fec400192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec51600640 1 -- 172.21.15.73:0/1887239531 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec400bc070 con 0x7fec540b20b0 2024-04-15T15:32:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec51600640 1 -- 172.21.15.73:0/1887239531 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec400b7430 con 0x7fec540b20b0 2024-04-15T15:32:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec5be00640 1 -- 172.21.15.73:0/1887239531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec540c82f0 con 0x7fec540b20b0 2024-04-15T15:32:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec51600640 1 -- 172.21.15.73:0/1887239531 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec400b1040 con 0x7fec540b20b0 2024-04-15T15:32:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec5be00640 1 -- 172.21.15.73:0/1887239531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec54159f60 con 0x7fec540b20b0 2024-04-15T15:32:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec5be00640 1 -- 172.21.15.73:0/1887239531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec54068ab0 con 0x7fec540b20b0 2024-04-15T15:32:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.841+0000 7fec51600640 1 -- 172.21.15.73:0/1887239531 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec400bf070 con 0x7fec540b20b0 2024-04-15T15:32:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.845+0000 7fec51600640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fec34068380 0x7fec3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.845+0000 7fec51600640 1 -- 172.21.15.73:0/1887239531 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fec40120390 con 0x7fec540b20b0 2024-04-15T15:32:17.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.845+0000 7fec59400640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fec34068380 0x7fec3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:17.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.845+0000 7fec59400640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fec34068380 0x7fec3406a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fec48003b90 tx=0x7fec48009910 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:17.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:17.849+0000 7fec51600640 1 -- 172.21.15.73:0/1887239531 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec40016110 con 0x7fec540b20b0 2024-04-15T15:32:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 -- 172.21.15.73:0/1887239531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec540c87a0 con 0x7fec540b20b0 2024-04-15T15:32:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec51600640 1 -- 172.21.15.73:0/1887239531 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fec400efe50 con 0x7fec540b20b0 2024-04-15T15:32:18.006 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 -- 172.21.15.73:0/1887239531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fec34068380 msgr2=0x7fec3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fec34068380 0x7fec3406a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fec48003b90 tx=0x7fec48009910 comp rx=0 tx=0).stop 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 -- 172.21.15.73:0/1887239531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 msgr2=0x7fec540c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 0x7fec540c7400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec400af040 tx=0x7fec400192c0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 -- 172.21.15.73:0/1887239531 shutdown_connections 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fec34068380 0x7fec3406a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fec54146110 0x7fec540c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec540b20b0 0x7fec540c7400 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 --2- 172.21.15.73:0/1887239531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec54071e10 0x7fec540cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 -- 172.21.15.73:0/1887239531 >> 172.21.15.73:0/1887239531 conn(0x7fec54067dd0 msgr2=0x7fec54141e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 -- 172.21.15.73:0/1887239531 shutdown_connections 2024-04-15T15:32:18.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.005+0000 7fec5be00640 1 -- 172.21.15.73:0/1887239531 wait complete. 2024-04-15T15:32:18.026 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:18.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.165+0000 7f0f05e00640 1 Processor -- start 2024-04-15T15:32:18.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.165+0000 7f0f05e00640 1 -- start start 2024-04-15T15:32:18.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.165+0000 7f0f05e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f0015b5d0 0x7f0f0015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.165+0000 7f0f05e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0f000b3e30 0x7f0f000b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.165+0000 7f0f05e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f00070160 con 0x7f0f000b25f0 2024-04-15T15:32:18.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.165+0000 7f0f05e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0f0015b9b0 con 0x7f0f0015b5d0 2024-04-15T15:32:18.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.165+0000 7f0f05e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f0f000b2a40 con 0x7f0f000b3e30 2024-04-15T15:32:18.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0efea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f0015b5d0 0x7f0f0015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0eff400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0f000b25f0 0x7f0f000b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45482/0 (socket says 172.21.15.73:45482) 2024-04-15T15:32:18.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0eff400640 1 -- 172.21.15.73:0/1960980241 learned_addr learned my addr 172.21.15.73:0/1960980241 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:18.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0ef6000640 1 --2- 172.21.15.73:0/1960980241 >> v2:172.21.15.118:3300/0 conn(0x7f0f000b3e30 0x7f0f000b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0efea00640 1 -- 172.21.15.73:0/1960980241 >> v2:172.21.15.118:3300/0 conn(0x7f0f000b3e30 msgr2=0x7f0f000b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:18.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0efea00640 1 --2- 172.21.15.73:0/1960980241 >> v2:172.21.15.118:3300/0 conn(0x7f0f000b3e30 0x7f0f000b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0efea00640 1 -- 172.21.15.73:0/1960980241 >> v1:172.21.15.73:6789/0 conn(0x7f0f000b25f0 legacy=0x7f0f000b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0efea00640 1 -- 172.21.15.73:0/1960980241 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0015f1f0 con 0x7f0f0015b5d0 2024-04-15T15:32:18.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0efe000640 1 -- 172.21.15.73:0/1960980241 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363626822 0 0) 0x7f0f00070160 con 0x7f0f000b25f0 2024-04-15T15:32:18.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0efea00640 1 --2- 172.21.15.73:0/1960980241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 0x7f0f0015fc90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00097c0 tx=0x7f0ef001c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d0221fe5a355f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:18.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0efe000640 1 -- 172.21.15.73:0/1960980241 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00b0070 con 0x7f0f0015b5d0 2024-04-15T15:32:18.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0efe000640 1 -- 172.21.15.73:0/1960980241 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef00ab600 con 0x7f0f0015b5d0 2024-04-15T15:32:18.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.169+0000 7f0efe000640 1 -- 172.21.15.73:0/1960980241 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00ab9d0 con 0x7f0f0015b5d0 2024-04-15T15:32:18.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 -- 172.21.15.73:0/1960980241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 msgr2=0x7f0f0015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 --2- 172.21.15.73:0/1960980241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 0x7f0f0015fc90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00097c0 tx=0x7f0ef001c2e0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 -- 172.21.15.73:0/1960980241 shutdown_connections 2024-04-15T15:32:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 --2- 172.21.15.73:0/1960980241 >> v2:172.21.15.118:3300/0 conn(0x7f0f000b3e30 0x7f0f000b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 --2- 172.21.15.73:0/1960980241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 0x7f0f0015fc90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 -- 172.21.15.73:0/1960980241 >> 172.21.15.73:0/1960980241 conn(0x7f0f00067dd0 msgr2=0x7f0f000d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 -- 172.21.15.73:0/1960980241 shutdown_connections 2024-04-15T15:32:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 -- 172.21.15.73:0/1960980241 wait complete. 2024-04-15T15:32:18.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 Processor -- start 2024-04-15T15:32:18.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 -- start start 2024-04-15T15:32:18.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f000b25f0 0x7f0f0014d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f000b3e30 0x7f0f0015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 0x7f0f000ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0f000b4240 con 0x7f0f0015b5d0 2024-04-15T15:32:18.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0f000cfd00 con 0x7f0f000b25f0 2024-04-15T15:32:18.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0f05e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0006faa0 con 0x7f0f000b3e30 2024-04-15T15:32:18.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0eff400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 0x7f0f000ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0eff400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 0x7f0f000ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39438/0 (socket says 172.21.15.73:39438) 2024-04-15T15:32:18.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0eff400640 1 -- 172.21.15.73:0/2808239161 learned_addr learned my addr 172.21.15.73:0/2808239161 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:18.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0efea00640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f000b25f0 0x7f0f0014d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0ef6000640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f000b3e30 0x7f0f0015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0eff400640 1 -- 172.21.15.73:0/2808239161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f000b3e30 msgr2=0x7f0f0015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0eff400640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f000b3e30 0x7f0f0015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0eff400640 1 -- 172.21.15.73:0/2808239161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f000b25f0 msgr2=0x7f0f0014d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0eff400640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f000b25f0 0x7f0f0014d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0eff400640 1 -- 172.21.15.73:0/2808239161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0015df80 con 0x7f0f0015b5d0 2024-04-15T15:32:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0ef6000640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f000b3e30 0x7f0f0015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.173+0000 7f0eff400640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 0x7f0f000ac6a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800c780 tx=0x7f0ef800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0ef7e00640 1 -- 172.21.15.73:0/2808239161 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8018070 con 0x7f0f0015b5d0 2024-04-15T15:32:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0ef7e00640 1 -- 172.21.15.73:0/2808239161 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef800a640 con 0x7f0f0015b5d0 2024-04-15T15:32:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0ef7e00640 1 -- 172.21.15.73:0/2808239161 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef800aa30 con 0x7f0f0015b5d0 2024-04-15T15:32:18.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0f05e00640 1 -- 172.21.15.73:0/2808239161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0015e260 con 0x7f0f0015b5d0 2024-04-15T15:32:18.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0f05e00640 1 -- 172.21.15.73:0/2808239161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0014def0 con 0x7f0f0015b5d0 2024-04-15T15:32:18.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0f05e00640 1 -- 172.21.15.73:0/2808239161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f00068ab0 con 0x7f0f0015b5d0 2024-04-15T15:32:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0ef7e00640 1 -- 172.21.15.73:0/2808239161 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ef800abd0 con 0x7f0f0015b5d0 2024-04-15T15:32:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0ef7e00640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0edc068380 0x7f0edc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0ef7e00640 1 -- 172.21.15.73:0/2808239161 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f0ef80862a0 con 0x7f0f0015b5d0 2024-04-15T15:32:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0efea00640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0edc068380 0x7f0edc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.177+0000 7f0efea00640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0edc068380 0x7f0edc06a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00ad000 tx=0x7f0ef00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:18.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.181+0000 7f0ef7e00640 1 -- 172.21.15.73:0/2808239161 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0ef8055df0 con 0x7f0f0015b5d0 2024-04-15T15:32:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.337+0000 7f0f05e00640 1 -- 172.21.15.73:0/2808239161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0f0006f370 con 0x7f0f0015b5d0 2024-04-15T15:32:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.337+0000 7f0ef7e00640 1 -- 172.21.15.73:0/2808239161 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f0ef805a0f0 con 0x7f0f0015b5d0 2024-04-15T15:32:18.339 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 -- 172.21.15.73:0/2808239161 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0edc068380 msgr2=0x7f0edc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0edc068380 0x7f0edc06a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00ad000 tx=0x7f0ef00a6000 comp rx=0 tx=0).stop 2024-04-15T15:32:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 -- 172.21.15.73:0/2808239161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 msgr2=0x7f0f000ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 0x7f0f000ac6a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800c780 tx=0x7f0ef800cc40 comp rx=0 tx=0).stop 2024-04-15T15:32:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 -- 172.21.15.73:0/2808239161 shutdown_connections 2024-04-15T15:32:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0015b5d0 0x7f0f000ac6a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0edc068380 0x7f0edc06a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f000b3e30 0x7f0f0015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 --2- 172.21.15.73:0/2808239161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f000b25f0 0x7f0f0014d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 -- 172.21.15.73:0/2808239161 >> 172.21.15.73:0/2808239161 conn(0x7f0f00067dd0 msgr2=0x7f0f000b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 -- 172.21.15.73:0/2808239161 shutdown_connections 2024-04-15T15:32:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.341+0000 7f0f05e00640 1 -- 172.21.15.73:0/2808239161 wait complete. 2024-04-15T15:32:18.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:18.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.497+0000 7f865f000640 1 Processor -- start 2024-04-15T15:32:18.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.497+0000 7f865f000640 1 -- start start 2024-04-15T15:32:18.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.497+0000 7f865f000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865815b5d0 0x7f865815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.497+0000 7f865f000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86580b3e30 0x7f86580b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f865f000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8658070160 con 0x7f86580b25f0 2024-04-15T15:32:18.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f865f000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f865815b9b0 con 0x7f86580b3e30 2024-04-15T15:32:18.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f865f000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f865815f1f0 con 0x7f865815b5d0 2024-04-15T15:32:18.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8657400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86580b3e30 0x7f86580b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8657400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86580b3e30 0x7f86580b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39446/0 (socket says 172.21.15.73:39446) 2024-04-15T15:32:18.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8657400640 1 -- 172.21.15.73:0/2866811256 learned_addr learned my addr 172.21.15.73:0/2866811256 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:18.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8657400640 1 -- 172.21.15.73:0/2866811256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865815b5d0 msgr2=0x7f865815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:18.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8657400640 1 --2- 172.21.15.73:0/2866811256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865815b5d0 0x7f865815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8657400640 1 -- 172.21.15.73:0/2866811256 >> v1:172.21.15.118:6789/0 conn(0x7f86580b25f0 legacy=0x7f86580b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:18.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8657400640 1 -- 172.21.15.73:0/2866811256 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865806fe80 con 0x7f86580b3e30 2024-04-15T15:32:18.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8657400640 1 --2- 172.21.15.73:0/2866811256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 0x7f86580b20b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8640009870 tx=0x7f864001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdac0057f7e884e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8656a00640 1 -- 172.21.15.73:0/2866811256 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400b0070 con 0x7f86580b3e30 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8656a00640 1 -- 172.21.15.73:0/2866811256 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86400ab600 con 0x7f86580b3e30 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.501+0000 7f8656a00640 1 -- 172.21.15.73:0/2866811256 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400ab9d0 con 0x7f86580b3e30 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 -- 172.21.15.73:0/2866811256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 msgr2=0x7f86580b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 --2- 172.21.15.73:0/2866811256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 0x7f86580b20b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8640009870 tx=0x7f864001c3d0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 -- 172.21.15.73:0/2866811256 shutdown_connections 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 --2- 172.21.15.73:0/2866811256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 0x7f86580b20b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 --2- 172.21.15.73:0/2866811256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865815b5d0 0x7f865815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 -- 172.21.15.73:0/2866811256 >> 172.21.15.73:0/2866811256 conn(0x7f8658067dd0 msgr2=0x7f86580d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 -- 172.21.15.73:0/2866811256 shutdown_connections 2024-04-15T15:32:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 -- 172.21.15.73:0/2866811256 wait complete. 2024-04-15T15:32:18.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 Processor -- start 2024-04-15T15:32:18.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 -- start start 2024-04-15T15:32:18.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86580b25f0 0x7f86581f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 0x7f86581502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865815b5d0 0x7f86581f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f865806faa0 con 0x7f86580b3e30 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f86580cfd00 con 0x7f865815b5d0 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865f000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f865806fc20 con 0x7f86580b25f0 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f8657400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 0x7f86581502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f8657400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 0x7f86581502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39456/0 (socket says 172.21.15.73:39456) 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f8657400640 1 -- 172.21.15.73:0/967590301 learned_addr learned my addr 172.21.15.73:0/967590301 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f8657e00640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86580b25f0 0x7f86581f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.505+0000 7f865d000640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865815b5d0 0x7f86581f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f8657400640 1 -- 172.21.15.73:0/967590301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86580b25f0 msgr2=0x7f86581f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f8657400640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86580b25f0 0x7f86581f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f8657400640 1 -- 172.21.15.73:0/967590301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865815b5d0 msgr2=0x7f86581f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f8657400640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865815b5d0 0x7f86581f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f8657400640 1 -- 172.21.15.73:0/967590301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865815ffa0 con 0x7f86580b3e30 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f865d000640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865815b5d0 0x7f86581f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:18.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f8657400640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 0x7f86581502d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86400ae040 tx=0x7f8640019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:18.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f864fe00640 1 -- 172.21.15.73:0/967590301 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400b0040 con 0x7f86580b3e30 2024-04-15T15:32:18.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f864fe00640 1 -- 172.21.15.73:0/967590301 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86400b9070 con 0x7f86580b3e30 2024-04-15T15:32:18.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f865f000640 1 -- 172.21.15.73:0/967590301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865814f230 con 0x7f86580b3e30 2024-04-15T15:32:18.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f864fe00640 1 -- 172.21.15.73:0/967590301 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400b4880 con 0x7f86580b3e30 2024-04-15T15:32:18.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f865f000640 1 -- 172.21.15.73:0/967590301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865814f7f0 con 0x7f86580b3e30 2024-04-15T15:32:18.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f865f000640 1 -- 172.21.15.73:0/967590301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8658068ab0 con 0x7f86580b3e30 2024-04-15T15:32:18.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.509+0000 7f864fe00640 1 -- 172.21.15.73:0/967590301 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86400ab4c0 con 0x7f86580b3e30 2024-04-15T15:32:18.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.513+0000 7f864fe00640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8634068380 0x7f863406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.513+0000 7f864fe00640 1 -- 172.21.15.73:0/967590301 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f8640120ad0 con 0x7f86580b3e30 2024-04-15T15:32:18.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.513+0000 7f8657e00640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8634068380 0x7f863406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.513+0000 7f8657e00640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8634068380 0x7f863406a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8648009990 tx=0x7f8648009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.517+0000 7f864fe00640 1 -- 172.21.15.73:0/967590301 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8640016110 con 0x7f86580b3e30 2024-04-15T15:32:18.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 -- 172.21.15.73:0/967590301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f86580ce210 con 0x7f86580b3e30 2024-04-15T15:32:18.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f864fe00640 1 -- 172.21.15.73:0/967590301 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f86400f0c70 con 0x7f86580b3e30 2024-04-15T15:32:18.677 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 -- 172.21.15.73:0/967590301 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8634068380 msgr2=0x7f863406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8634068380 0x7f863406a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8648009990 tx=0x7f8648009110 comp rx=0 tx=0).stop 2024-04-15T15:32:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 -- 172.21.15.73:0/967590301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 msgr2=0x7f86581502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 0x7f86581502d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86400ae040 tx=0x7f8640019170 comp rx=0 tx=0).stop 2024-04-15T15:32:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 -- 172.21.15.73:0/967590301 shutdown_connections 2024-04-15T15:32:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865815b5d0 0x7f86581f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86580b3e30 0x7f86581502d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8634068380 0x7f863406a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 --2- 172.21.15.73:0/967590301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86580b25f0 0x7f86581f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 -- 172.21.15.73:0/967590301 >> 172.21.15.73:0/967590301 conn(0x7f8658067dd0 msgr2=0x7f86580b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 -- 172.21.15.73:0/967590301 shutdown_connections 2024-04-15T15:32:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.677+0000 7f865f000640 1 -- 172.21.15.73:0/967590301 wait complete. 2024-04-15T15:32:18.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:18.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.833+0000 7fa5ccc00640 1 Processor -- start 2024-04-15T15:32:18.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.833+0000 7fa5ccc00640 1 -- start start 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5ccc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5c8146110 0x7fa5c80cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5ccc00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c80b20b0 0x7fa5c80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5ccc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c80cd3a0 con 0x7fa5c8071e10 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5ccc00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c80b5160 con 0x7fa5c80b20b0 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5ccc00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c80b40c0 con 0x7fa5c8146110 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5c5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c80b20b0 0x7fa5c80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5c5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c80b20b0 0x7fa5c80b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39464/0 (socket says 172.21.15.73:39464) 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5c5400640 1 -- 172.21.15.73:0/951499720 learned_addr learned my addr 172.21.15.73:0/951499720 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5c5e00640 1 --2- 172.21.15.73:0/951499720 >> v2:172.21.15.118:3300/0 conn(0x7fa5c8146110 0x7fa5c80cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5c5400640 1 -- 172.21.15.73:0/951499720 >> v2:172.21.15.118:3300/0 conn(0x7fa5c8146110 msgr2=0x7fa5c80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5c5400640 1 --2- 172.21.15.73:0/951499720 >> v2:172.21.15.118:3300/0 conn(0x7fa5c8146110 0x7fa5c80cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5c5400640 1 -- 172.21.15.73:0/951499720 >> v1:172.21.15.118:6789/0 conn(0x7fa5c8071e10 legacy=0x7fa5c8072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:18.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.837+0000 7fa5c5400640 1 -- 172.21.15.73:0/951499720 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80b43a0 con 0x7fa5c80b20b0 2024-04-15T15:32:18.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5c5400640 1 --2- 172.21.15.73:0/951499720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c80b20b0 0x7fa5c80b2530 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80cd570 tx=0x7fa5b401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245e19962a4bcff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:18.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5c4a00640 1 -- 172.21.15.73:0/951499720 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40b1070 con 0x7fa5c80b20b0 2024-04-15T15:32:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5c4a00640 1 -- 172.21.15.73:0/951499720 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b40ac630 con 0x7fa5c80b20b0 2024-04-15T15:32:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5c4a00640 1 -- 172.21.15.73:0/951499720 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40a8050 con 0x7fa5c80b20b0 2024-04-15T15:32:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 -- 172.21.15.73:0/951499720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c80b20b0 msgr2=0x7fa5c80b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 --2- 172.21.15.73:0/951499720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c80b20b0 0x7fa5c80b2530 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80cd570 tx=0x7fa5b401c4e0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 -- 172.21.15.73:0/951499720 shutdown_connections 2024-04-15T15:32:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 --2- 172.21.15.73:0/951499720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c80b20b0 0x7fa5c80b2530 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 --2- 172.21.15.73:0/951499720 >> v2:172.21.15.118:3300/0 conn(0x7fa5c8146110 0x7fa5c80cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 -- 172.21.15.73:0/951499720 >> 172.21.15.73:0/951499720 conn(0x7fa5c8067dd0 msgr2=0x7fa5c80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 -- 172.21.15.73:0/951499720 shutdown_connections 2024-04-15T15:32:18.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 -- 172.21.15.73:0/951499720 wait complete. 2024-04-15T15:32:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 Processor -- start 2024-04-15T15:32:18.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 -- start start 2024-04-15T15:32:18.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c8071e10 0x7fa5c81572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5c80b20b0 0x7fa5c8155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5c8146110 0x7fa5c815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80cdcf0 con 0x7fa5c8071e10 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80b3d70 con 0x7fa5c80b20b0 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5ccc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c815dbe0 con 0x7fa5c8146110 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.841+0000 7fa5c5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c8071e10 0x7fa5c81572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5c5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c8071e10 0x7fa5c81572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39476/0 (socket says 172.21.15.73:39476) 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5c5e00640 1 -- 172.21.15.73:0/3744091753 learned_addr learned my addr 172.21.15.73:0/3744091753 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5c6800640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5c8146110 0x7fa5c815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5c5400640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5c80b20b0 0x7fa5c8155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5c5e00640 1 -- 172.21.15.73:0/3744091753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5c8146110 msgr2=0x7fa5c815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5c5e00640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5c8146110 0x7fa5c815c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5c5e00640 1 -- 172.21.15.73:0/3744091753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5c80b20b0 msgr2=0x7fa5c8155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5c5e00640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5c80b20b0 0x7fa5c8155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5c5e00640 1 -- 172.21.15.73:0/3744091753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c8156220 con 0x7fa5c8071e10 2024-04-15T15:32:18.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5c5e00640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c8071e10 0x7fa5c81572c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8007e40 tx=0x7fa5b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5be000640 1 -- 172.21.15.73:0/3744091753 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8014620 con 0x7fa5c8071e10 2024-04-15T15:32:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5be000640 1 -- 172.21.15.73:0/3744091753 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b8019070 con 0x7fa5c8071e10 2024-04-15T15:32:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5be000640 1 -- 172.21.15.73:0/3744091753 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8014a00 con 0x7fa5c8071e10 2024-04-15T15:32:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5ccc00640 1 -- 172.21.15.73:0/3744091753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c8156500 con 0x7fa5c8071e10 2024-04-15T15:32:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5ccc00640 1 -- 172.21.15.73:0/3744091753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c8156ac0 con 0x7fa5c8071e10 2024-04-15T15:32:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5ccc00640 1 -- 172.21.15.73:0/3744091753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c8068ab0 con 0x7fa5c8071e10 2024-04-15T15:32:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5be000640 1 -- 172.21.15.73:0/3744091753 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa5b8014ba0 con 0x7fa5c8071e10 2024-04-15T15:32:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5be000640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa5a8068380 0x7fa5a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.845+0000 7fa5be000640 1 -- 172.21.15.73:0/3744091753 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fa5b80875a0 con 0x7fa5c8071e10 2024-04-15T15:32:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.849+0000 7fa5c5400640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa5a8068380 0x7fa5a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:18.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.849+0000 7fa5c5400640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa5a8068380 0x7fa5a806a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40ae000 tx=0x7fa5b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:18.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:18.849+0000 7fa5be000640 1 -- 172.21.15.73:0/3744091753 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa5b8057060 con 0x7fa5c8071e10 2024-04-15T15:32:19.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.009+0000 7fa5ccc00640 1 -- 172.21.15.73:0/3744091753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa5c80cd6c0 con 0x7fa5c8071e10 2024-04-15T15:32:19.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.009+0000 7fa5be000640 1 -- 172.21.15.73:0/3744091753 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fa5b805b360 con 0x7fa5c8071e10 2024-04-15T15:32:19.011 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 -- 172.21.15.73:0/3744091753 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa5a8068380 msgr2=0x7fa5a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa5a8068380 0x7fa5a806a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40ae000 tx=0x7fa5b4009040 comp rx=0 tx=0).stop 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 -- 172.21.15.73:0/3744091753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c8071e10 msgr2=0x7fa5c81572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c8071e10 0x7fa5c81572c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8007e40 tx=0x7fa5b800e4b0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 -- 172.21.15.73:0/3744091753 shutdown_connections 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa5a8068380 0x7fa5a806a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5c8146110 0x7fa5c815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5c80b20b0 0x7fa5c8155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 --2- 172.21.15.73:0/3744091753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c8071e10 0x7fa5c81572c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 -- 172.21.15.73:0/3744091753 >> 172.21.15.73:0/3744091753 conn(0x7fa5c8067dd0 msgr2=0x7fa5c8145130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:19.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 -- 172.21.15.73:0/3744091753 shutdown_connections 2024-04-15T15:32:19.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.013+0000 7fa5ccc00640 1 -- 172.21.15.73:0/3744091753 wait complete. 2024-04-15T15:32:19.033 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:19.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.165+0000 7fb234400640 1 Processor -- start 2024-04-15T15:32:19.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.165+0000 7fb234400640 1 -- start start 2024-04-15T15:32:19.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.169+0000 7fb234400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb22c15b5d0 0x7fb22c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.169+0000 7fb234400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c070160 con 0x7fb22c0b27c0 2024-04-15T15:32:19.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.169+0000 7fb234400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c15f1f0 con 0x7fb22c0b3e30 2024-04-15T15:32:19.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.169+0000 7fb234400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb22c15b9b0 con 0x7fb22c15b5d0 2024-04-15T15:32:19.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.169+0000 7fb231a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb22c15b5d0 0x7fb22c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.169+0000 7fb232400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb22c0b27c0 0x7fb22c0b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45494/0 (socket says 172.21.15.73:45494) 2024-04-15T15:32:19.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.169+0000 7fb232400640 1 -- 172.21.15.73:0/228208064 learned_addr learned my addr 172.21.15.73:0/228208064 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:19.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.169+0000 7fb231a00640 1 -- 172.21.15.73:0/228208064 >> v1:172.21.15.118:6789/0 conn(0x7fb22c0b3e30 legacy=0x7fb22c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:19.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.169+0000 7fb231a00640 1 -- 172.21.15.73:0/228208064 >> v1:172.21.15.73:6789/0 conn(0x7fb22c0b27c0 legacy=0x7fb22c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.169+0000 7fb231a00640 1 -- 172.21.15.73:0/228208064 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c06fe80 con 0x7fb22c15b5d0 2024-04-15T15:32:19.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb231a00640 1 --2- 172.21.15.73:0/228208064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 0x7fb22c15fc90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb2200097f0 tx=0x7fb22001c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1098d83b02d753a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:19.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb22be00640 1 -- 172.21.15.73:0/228208064 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200b0070 con 0x7fb22c15b5d0 2024-04-15T15:32:19.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb22be00640 1 -- 172.21.15.73:0/228208064 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2200ab600 con 0x7fb22c15b5d0 2024-04-15T15:32:19.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb22be00640 1 -- 172.21.15.73:0/228208064 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200ab9d0 con 0x7fb22c15b5d0 2024-04-15T15:32:19.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 -- 172.21.15.73:0/228208064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 msgr2=0x7fb22c15fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 --2- 172.21.15.73:0/228208064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 0x7fb22c15fc90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb2200097f0 tx=0x7fb22001c2e0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 -- 172.21.15.73:0/228208064 shutdown_connections 2024-04-15T15:32:19.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 --2- 172.21.15.73:0/228208064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 0x7fb22c15fc90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 -- 172.21.15.73:0/228208064 >> 172.21.15.73:0/228208064 conn(0x7fb22c067dd0 msgr2=0x7fb22c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:19.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 -- 172.21.15.73:0/228208064 shutdown_connections 2024-04-15T15:32:19.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 -- 172.21.15.73:0/228208064 wait complete. 2024-04-15T15:32:19.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 Processor -- start 2024-04-15T15:32:19.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 -- start start 2024-04-15T15:32:19.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb22c0b27c0 0x7fb22c14a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0b3e30 0x7fb22c151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 0x7fb22c151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c06faa0 con 0x7fb22c15b5d0 2024-04-15T15:32:19.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c0cfd00 con 0x7fb22c0b3e30 2024-04-15T15:32:19.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb234400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb22c06fc20 con 0x7fb22c0b27c0 2024-04-15T15:32:19.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb232400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 0x7fb22c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb232400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 0x7fb22c151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39494/0 (socket says 172.21.15.73:39494) 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.173+0000 7fb232400640 1 -- 172.21.15.73:0/2512924256 learned_addr learned my addr 172.21.15.73:0/2512924256 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb231000640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0b3e30 0x7fb22c151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb231a00640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb22c0b27c0 0x7fb22c14a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb232400640 1 -- 172.21.15.73:0/2512924256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb22c0b27c0 msgr2=0x7fb22c14a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb232400640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb22c0b27c0 0x7fb22c14a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb232400640 1 -- 172.21.15.73:0/2512924256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0b3e30 msgr2=0x7fb22c151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb232400640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0b3e30 0x7fb22c151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb232400640 1 -- 172.21.15.73:0/2512924256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c14af50 con 0x7fb22c15b5d0 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb231000640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0b3e30 0x7fb22c151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb232400640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 0x7fb22c151960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb22400cad0 tx=0x7fb22400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb229600640 1 -- 172.21.15.73:0/2512924256 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224017070 con 0x7fb22c15b5d0 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb229600640 1 -- 172.21.15.73:0/2512924256 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22400ac30 con 0x7fb22c15b5d0 2024-04-15T15:32:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb229600640 1 -- 172.21.15.73:0/2512924256 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224012400 con 0x7fb22c15b5d0 2024-04-15T15:32:19.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb234400640 1 -- 172.21.15.73:0/2512924256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22c14b230 con 0x7fb22c15b5d0 2024-04-15T15:32:19.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb234400640 1 -- 172.21.15.73:0/2512924256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22c14b7f0 con 0x7fb22c15b5d0 2024-04-15T15:32:19.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb234400640 1 -- 172.21.15.73:0/2512924256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22c068ab0 con 0x7fb22c15b5d0 2024-04-15T15:32:19.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb229600640 1 -- 172.21.15.73:0/2512924256 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb22401a070 con 0x7fb22c15b5d0 2024-04-15T15:32:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb229600640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb20c068380 0x7fb20c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb229600640 1 -- 172.21.15.73:0/2512924256 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fb224086970 con 0x7fb22c15b5d0 2024-04-15T15:32:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.177+0000 7fb231a00640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb20c068380 0x7fb20c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.181+0000 7fb231a00640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb20c068380 0x7fb20c06a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb2200ad000 tx=0x7fb2200a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:19.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.181+0000 7fb229600640 1 -- 172.21.15.73:0/2512924256 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb2240564d0 con 0x7fb22c15b5d0 2024-04-15T15:32:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 -- 172.21.15.73:0/2512924256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb22c0b4a80 con 0x7fb22c15b5d0 2024-04-15T15:32:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb229600640 1 -- 172.21.15.73:0/2512924256 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7fb22405a7d0 con 0x7fb22c15b5d0 2024-04-15T15:32:19.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:19.343 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 -- 172.21.15.73:0/2512924256 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb20c068380 msgr2=0x7fb20c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb20c068380 0x7fb20c06a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb2200ad000 tx=0x7fb2200a6000 comp rx=0 tx=0).stop 2024-04-15T15:32:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 -- 172.21.15.73:0/2512924256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 msgr2=0x7fb22c151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 0x7fb22c151960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb22400cad0 tx=0x7fb22400cf90 comp rx=0 tx=0).stop 2024-04-15T15:32:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 -- 172.21.15.73:0/2512924256 shutdown_connections 2024-04-15T15:32:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb22c15b5d0 0x7fb22c151960 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0b3e30 0x7fb22c151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb20c068380 0x7fb20c06a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 --2- 172.21.15.73:0/2512924256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb22c0b27c0 0x7fb22c14a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.341+0000 7fb234400640 1 -- 172.21.15.73:0/2512924256 >> 172.21.15.73:0/2512924256 conn(0x7fb22c067dd0 msgr2=0x7fb22c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.345+0000 7fb234400640 1 -- 172.21.15.73:0/2512924256 shutdown_connections 2024-04-15T15:32:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.345+0000 7fb234400640 1 -- 172.21.15.73:0/2512924256 wait complete. 2024-04-15T15:32:19.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:19.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:19.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.501+0000 7fcd51400640 1 Processor -- start 2024-04-15T15:32:19.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.501+0000 7fcd51400640 1 -- start start 2024-04-15T15:32:19.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd51400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd4c146110 0x7fcd4c0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd51400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b20b0 0x7fcd4c0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd51400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd4c071e10 0x7fcd4c0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd51400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4c0cd3a0 con 0x7fcd4c071e10 2024-04-15T15:32:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd51400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4c0b5160 con 0x7fcd4c146110 2024-04-15T15:32:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd51400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c0b40c0 con 0x7fcd4c0b20b0 2024-04-15T15:32:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd4b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd4c071e10 0x7fcd4c0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd4b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd4c071e10 0x7fcd4c0722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39506/0 (socket says 172.21.15.73:39506) 2024-04-15T15:32:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd4b200640 1 -- 172.21.15.73:0/116875329 learned_addr learned my addr 172.21.15.73:0/116875329 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd41e00640 1 --2- 172.21.15.73:0/116875329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b20b0 0x7fcd4c0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd4b200640 1 -- 172.21.15.73:0/116875329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b20b0 msgr2=0x7fcd4c0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd4b200640 1 --2- 172.21.15.73:0/116875329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b20b0 0x7fcd4c0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd4a800640 1 --2- 172.21.15.73:0/116875329 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c146110 0x7fcd4c0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd4b200640 1 -- 172.21.15.73:0/116875329 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c146110 msgr2=0x7fcd4c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd4b200640 1 --2- 172.21.15.73:0/116875329 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c146110 0x7fcd4c0cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd4b200640 1 -- 172.21.15.73:0/116875329 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c0b43a0 con 0x7fcd4c071e10 2024-04-15T15:32:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd41e00640 1 --2- 172.21.15.73:0/116875329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b20b0 0x7fcd4c0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.505+0000 7fcd4a800640 1 --2- 172.21.15.73:0/116875329 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c146110 0x7fcd4c0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd4b200640 1 --2- 172.21.15.73:0/116875329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c071e10 0x7fcd4c0722a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0d0fa0 tx=0x7fcd4401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14f82ea30fcfcd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd49e00640 1 -- 172.21.15.73:0/116875329 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440a5760 con 0x7fcd4c071e10 2024-04-15T15:32:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd49e00640 1 -- 172.21.15.73:0/116875329 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd440a5900 con 0x7fcd4c071e10 2024-04-15T15:32:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd49e00640 1 -- 172.21.15.73:0/116875329 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440a5cd0 con 0x7fcd4c071e10 2024-04-15T15:32:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 -- 172.21.15.73:0/116875329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c071e10 msgr2=0x7fcd4c0722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 --2- 172.21.15.73:0/116875329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c071e10 0x7fcd4c0722a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0d0fa0 tx=0x7fcd4401c9f0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 -- 172.21.15.73:0/116875329 shutdown_connections 2024-04-15T15:32:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 --2- 172.21.15.73:0/116875329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c071e10 0x7fcd4c0722a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 --2- 172.21.15.73:0/116875329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c0b20b0 0x7fcd4c0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 --2- 172.21.15.73:0/116875329 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c146110 0x7fcd4c0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 -- 172.21.15.73:0/116875329 >> 172.21.15.73:0/116875329 conn(0x7fcd4c067dd0 msgr2=0x7fcd4c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 -- 172.21.15.73:0/116875329 shutdown_connections 2024-04-15T15:32:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 -- 172.21.15.73:0/116875329 wait complete. 2024-04-15T15:32:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 Processor -- start 2024-04-15T15:32:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.509+0000 7fcd51400640 1 -- start start 2024-04-15T15:32:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd51400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c071e10 0x7fcd4c13b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd51400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c0b20b0 0x7fcd4c13bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd51400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c146110 0x7fcd4c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd51400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0b3d70 con 0x7fcd4c146110 2024-04-15T15:32:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd51400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0b4c40 con 0x7fcd4c0b20b0 2024-04-15T15:32:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd51400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c0cdcf0 con 0x7fcd4c071e10 2024-04-15T15:32:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c146110 0x7fcd4c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c146110 0x7fcd4c0cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39514/0 (socket says 172.21.15.73:39514) 2024-04-15T15:32:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4b200640 1 -- 172.21.15.73:0/2870022264 learned_addr learned my addr 172.21.15.73:0/2870022264 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4a800640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c071e10 0x7fcd4c13b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4b200640 1 -- 172.21.15.73:0/2870022264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c071e10 msgr2=0x7fcd4c13b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd41e00640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c0b20b0 0x7fcd4c13bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4b200640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c071e10 0x7fcd4c13b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4b200640 1 -- 172.21.15.73:0/2870022264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c0b20b0 msgr2=0x7fcd4c13bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4b200640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c0b20b0 0x7fcd4c13bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4b200640 1 -- 172.21.15.73:0/2870022264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c0d06f0 con 0x7fcd4c146110 2024-04-15T15:32:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4a800640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c071e10 0x7fcd4c13b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd41e00640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c0b20b0 0x7fcd4c13bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd4b200640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c146110 0x7fcd4c0cf200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcd4401b0a0 tx=0x7fcd44019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd43400640 1 -- 172.21.15.73:0/2870022264 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440b8670 con 0x7fcd4c146110 2024-04-15T15:32:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd43400640 1 -- 172.21.15.73:0/2870022264 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd440be070 con 0x7fcd4c146110 2024-04-15T15:32:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd43400640 1 -- 172.21.15.73:0/2870022264 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440b8a70 con 0x7fcd4c146110 2024-04-15T15:32:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd51400640 1 -- 172.21.15.73:0/2870022264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c13c3e0 con 0x7fcd4c146110 2024-04-15T15:32:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd51400640 1 -- 172.21.15.73:0/2870022264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c13c9a0 con 0x7fcd4c146110 2024-04-15T15:32:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd51400640 1 -- 172.21.15.73:0/2870022264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c155810 con 0x7fcd4c146110 2024-04-15T15:32:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.513+0000 7fcd43400640 1 -- 172.21.15.73:0/2870022264 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd440b8c10 con 0x7fcd4c146110 2024-04-15T15:32:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.517+0000 7fcd43400640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd28068380 0x7fcd2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.517+0000 7fcd43400640 1 -- 172.21.15.73:0/2870022264 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fcd44122080 con 0x7fcd4c146110 2024-04-15T15:32:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.517+0000 7fcd4a800640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd28068380 0x7fcd2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.517+0000 7fcd4a800640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd28068380 0x7fcd2806a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c006fd0 tx=0x7fcd3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.521+0000 7fcd43400640 1 -- 172.21.15.73:0/2870022264 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd4c155810 con 0x7fcd4c146110 2024-04-15T15:32:19.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.677+0000 7fcd51400640 1 -- 172.21.15.73:0/2870022264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcd4c068ab0 con 0x7fcd4c146110 2024-04-15T15:32:19.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.677+0000 7fcd43400640 1 -- 172.21.15.73:0/2870022264 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fcd440165e0 con 0x7fcd4c146110 2024-04-15T15:32:19.680 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.677+0000 7fcd51400640 1 -- 172.21.15.73:0/2870022264 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd28068380 msgr2=0x7fcd2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.677+0000 7fcd51400640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd28068380 0x7fcd2806a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c006fd0 tx=0x7fcd3c008040 comp rx=0 tx=0).stop 2024-04-15T15:32:19.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.677+0000 7fcd51400640 1 -- 172.21.15.73:0/2870022264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c146110 msgr2=0x7fcd4c0cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.677+0000 7fcd51400640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c146110 0x7fcd4c0cf200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcd4401b0a0 tx=0x7fcd44019790 comp rx=0 tx=0).stop 2024-04-15T15:32:19.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.681+0000 7fcd51400640 1 -- 172.21.15.73:0/2870022264 shutdown_connections 2024-04-15T15:32:19.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.681+0000 7fcd51400640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c146110 0x7fcd4c0cf200 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.681+0000 7fcd51400640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c0b20b0 0x7fcd4c13bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.681+0000 7fcd51400640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd28068380 0x7fcd2806a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.681+0000 7fcd51400640 1 --2- 172.21.15.73:0/2870022264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c071e10 0x7fcd4c13b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.681+0000 7fcd51400640 1 -- 172.21.15.73:0/2870022264 >> 172.21.15.73:0/2870022264 conn(0x7fcd4c067dd0 msgr2=0x7fcd4c0b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:19.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.681+0000 7fcd51400640 1 -- 172.21.15.73:0/2870022264 shutdown_connections 2024-04-15T15:32:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.681+0000 7fcd51400640 1 -- 172.21.15.73:0/2870022264 wait complete. 2024-04-15T15:32:19.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0444800640 1 Processor -- start 2024-04-15T15:32:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0444800640 1 -- start start 2024-04-15T15:32:19.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0444800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f043c0b27c0 0x7f043c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0444800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043c070160 con 0x7f043c0b3e30 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0444800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043c15f1f0 con 0x7f043c15b5d0 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0444800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f043c15b9b0 con 0x7f043c0b27c0 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0442800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f043c0b3e30 0x7f043c0b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45500/0 (socket says 172.21.15.73:45500) 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0442800640 1 -- 172.21.15.73:0/2980661852 learned_addr learned my addr 172.21.15.73:0/2980661852 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0441400640 1 --2- 172.21.15.73:0/2980661852 >> v2:172.21.15.118:3300/0 conn(0x7f043c0b27c0 0x7f043c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0440a00640 1 -- 172.21.15.73:0/2980661852 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280839080 0 0) 0x7f043c070160 con 0x7f043c0b3e30 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0440a00640 1 -- 172.21.15.73:0/2980661852 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0424003530 con 0x7f043c0b3e30 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0440a00640 1 -- 172.21.15.73:0/2980661852 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790277963 0 0) 0x7f043c15f1f0 con 0x7f043c15b5d0 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0441400640 1 -- 172.21.15.73:0/2980661852 >> v1:172.21.15.118:6789/0 conn(0x7f043c15b5d0 legacy=0x7f043c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0441400640 1 -- 172.21.15.73:0/2980661852 >> v1:172.21.15.73:6789/0 conn(0x7f043c0b3e30 legacy=0x7f043c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.837+0000 7f0441400640 1 -- 172.21.15.73:0/2980661852 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c06fe80 con 0x7f043c0b27c0 2024-04-15T15:32:19.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0441400640 1 --2- 172.21.15.73:0/2980661852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f043c0b27c0 0x7f043c15fc90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f042c0097c0 tx=0x7f042c01c320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83a43caf18896a29 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:19.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0440a00640 1 -- 172.21.15.73:0/2980661852 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0b0070 con 0x7f043c0b27c0 2024-04-15T15:32:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0440a00640 1 -- 172.21.15.73:0/2980661852 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c0ab600 con 0x7f043c0b27c0 2024-04-15T15:32:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0440a00640 1 -- 172.21.15.73:0/2980661852 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0ab9b0 con 0x7f043c0b27c0 2024-04-15T15:32:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0444800640 1 -- 172.21.15.73:0/2980661852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f043c0b27c0 msgr2=0x7f043c15fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0444800640 1 --2- 172.21.15.73:0/2980661852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f043c0b27c0 0x7f043c15fc90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f042c0097c0 tx=0x7f042c01c320 comp rx=0 tx=0).stop 2024-04-15T15:32:19.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0444800640 1 -- 172.21.15.73:0/2980661852 shutdown_connections 2024-04-15T15:32:19.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0444800640 1 --2- 172.21.15.73:0/2980661852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f043c0b27c0 0x7f043c15fc90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0444800640 1 -- 172.21.15.73:0/2980661852 >> 172.21.15.73:0/2980661852 conn(0x7f043c067dd0 msgr2=0x7f043c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:19.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0444800640 1 -- 172.21.15.73:0/2980661852 shutdown_connections 2024-04-15T15:32:19.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.841+0000 7f0444800640 1 -- 172.21.15.73:0/2980661852 wait complete. 2024-04-15T15:32:19.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0444800640 1 Processor -- start 2024-04-15T15:32:19.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0444800640 1 -- start start 2024-04-15T15:32:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0444800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f043c0b27c0 0x7f043c1f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0444800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f043c0b3e30 0x7f043c155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0444800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f043c15b5d0 0x7f043c0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0444800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f043c06faa0 con 0x7f043c0b27c0 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0444800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f043c0b4240 con 0x7f043c15b5d0 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0444800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f043c06fc20 con 0x7f043c0b3e30 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0441e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f043c0b27c0 0x7f043c1f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0441e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f043c0b27c0 0x7f043c1f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39530/0 (socket says 172.21.15.73:39530) 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0441e00640 1 -- 172.21.15.73:0/3700642397 learned_addr learned my addr 172.21.15.73:0/3700642397 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0441400640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f043c0b3e30 0x7f043c155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0442800640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f043c15b5d0 0x7f043c0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0441e00640 1 -- 172.21.15.73:0/3700642397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f043c0b3e30 msgr2=0x7f043c155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0441e00640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f043c0b3e30 0x7f043c155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0441e00640 1 -- 172.21.15.73:0/3700642397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f043c15b5d0 msgr2=0x7f043c0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0441e00640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f043c15b5d0 0x7f043c0b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0441e00640 1 -- 172.21.15.73:0/3700642397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c154e80 con 0x7f043c0b27c0 2024-04-15T15:32:19.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0442800640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f043c15b5d0 0x7f043c0b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:19.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0441e00640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f043c0b27c0 0x7f043c1f67e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f043000c480 tx=0x7f043000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:19.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0436000640 1 -- 172.21.15.73:0/3700642397 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0430005480 con 0x7f043c0b27c0 2024-04-15T15:32:19.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0436000640 1 -- 172.21.15.73:0/3700642397 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0430003600 con 0x7f043c0b27c0 2024-04-15T15:32:19.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0436000640 1 -- 172.21.15.73:0/3700642397 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04300039f0 con 0x7f043c0b27c0 2024-04-15T15:32:19.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0444800640 1 -- 172.21.15.73:0/3700642397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043c155140 con 0x7f043c0b27c0 2024-04-15T15:32:19.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.845+0000 7f0444800640 1 -- 172.21.15.73:0/3700642397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043c1f6d20 con 0x7f043c0b27c0 2024-04-15T15:32:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.849+0000 7f0444800640 1 -- 172.21.15.73:0/3700642397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f043c068ab0 con 0x7f043c0b27c0 2024-04-15T15:32:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.849+0000 7f0436000640 1 -- 172.21.15.73:0/3700642397 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0430003b90 con 0x7f043c0b27c0 2024-04-15T15:32:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.849+0000 7f0436000640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0420068380 0x7f042006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.849+0000 7f0436000640 1 -- 172.21.15.73:0/3700642397 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f0430086a80 con 0x7f043c0b27c0 2024-04-15T15:32:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.849+0000 7f0441400640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0420068380 0x7f042006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.849+0000 7f0441400640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0420068380 0x7f042006a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f042c0ad000 tx=0x7f042c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:19.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:19.853+0000 7f0436000640 1 -- 172.21.15.73:0/3700642397 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0430056c20 con 0x7f043c0b27c0 2024-04-15T15:32:20.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 -- 172.21.15.73:0/3700642397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f043c06f370 con 0x7f043c0b27c0 2024-04-15T15:32:20.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0436000640 1 -- 172.21.15.73:0/3700642397 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f0430056520 con 0x7f043c0b27c0 2024-04-15T15:32:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 -- 172.21.15.73:0/3700642397 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0420068380 msgr2=0x7f042006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0420068380 0x7f042006a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f042c0ad000 tx=0x7f042c0a6000 comp rx=0 tx=0).stop 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 -- 172.21.15.73:0/3700642397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f043c0b27c0 msgr2=0x7f043c1f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f043c0b27c0 0x7f043c1f67e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f043000c480 tx=0x7f043000c940 comp rx=0 tx=0).stop 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 -- 172.21.15.73:0/3700642397 shutdown_connections 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f043c15b5d0 0x7f043c0b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0420068380 0x7f042006a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f043c0b3e30 0x7f043c155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 --2- 172.21.15.73:0/3700642397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f043c0b27c0 0x7f043c1f67e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 -- 172.21.15.73:0/3700642397 >> 172.21.15.73:0/3700642397 conn(0x7f043c067dd0 msgr2=0x7f043c0ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:20.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 -- 172.21.15.73:0/3700642397 shutdown_connections 2024-04-15T15:32:20.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.009+0000 7f0444800640 1 -- 172.21.15.73:0/3700642397 wait complete. 2024-04-15T15:32:20.031 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f033de00640 1 Processor -- start 2024-04-15T15:32:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f033de00640 1 -- start start 2024-04-15T15:32:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f033de00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b27c0 0x7f033815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f033de00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f03380b3e30 0x7f03380b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f033de00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0338070160 con 0x7f033815b5d0 2024-04-15T15:32:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f033de00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f033815b9b0 con 0x7f03380b3e30 2024-04-15T15:32:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f033de00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f033815f1f0 con 0x7f03380b27c0 2024-04-15T15:32:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0336a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f033815b5d0 0x7f03380b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45502/0 (socket says 172.21.15.73:45502) 2024-04-15T15:32:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0336a00640 1 -- 172.21.15.73:0/1273841890 learned_addr learned my addr 172.21.15.73:0/1273841890 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:20.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0337400640 1 --2- 172.21.15.73:0/1273841890 >> v2:172.21.15.118:3300/0 conn(0x7f03380b3e30 0x7f03380b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0336000640 1 --2- 172.21.15.73:0/1273841890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b27c0 0x7f033815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0335600640 1 -- 172.21.15.73:0/1273841890 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503841151 0 0) 0x7f0338070160 con 0x7f033815b5d0 2024-04-15T15:32:20.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0335600640 1 -- 172.21.15.73:0/1273841890 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f031c003530 con 0x7f033815b5d0 2024-04-15T15:32:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0335600640 1 -- 172.21.15.73:0/1273841890 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2917533968 0 0) 0x7f031c003530 con 0x7f033815b5d0 2024-04-15T15:32:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0336000640 1 -- 172.21.15.73:0/1273841890 >> v2:172.21.15.118:3300/0 conn(0x7f03380b3e30 msgr2=0x7f03380b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0336000640 1 --2- 172.21.15.73:0/1273841890 >> v2:172.21.15.118:3300/0 conn(0x7f03380b3e30 0x7f03380b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0336000640 1 -- 172.21.15.73:0/1273841890 >> v1:172.21.15.73:6789/0 conn(0x7f033815b5d0 legacy=0x7f03380b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.169+0000 7f0336000640 1 -- 172.21.15.73:0/1273841890 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033806fe80 con 0x7f03380b27c0 2024-04-15T15:32:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f0336000640 1 --2- 172.21.15.73:0/1273841890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b27c0 0x7f033815fc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03240097c0 tx=0x7f032401c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9c76198ba98dd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:20.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f0335600640 1 -- 172.21.15.73:0/1273841890 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03240b0070 con 0x7f03380b27c0 2024-04-15T15:32:20.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f0335600640 1 -- 172.21.15.73:0/1273841890 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03240ab400 con 0x7f03380b27c0 2024-04-15T15:32:20.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f0335600640 1 -- 172.21.15.73:0/1273841890 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328001680 con 0x7f03380b27c0 2024-04-15T15:32:20.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f033de00640 1 -- 172.21.15.73:0/1273841890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b27c0 msgr2=0x7f033815fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f033de00640 1 --2- 172.21.15.73:0/1273841890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b27c0 0x7f033815fc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03240097c0 tx=0x7f032401c270 comp rx=0 tx=0).stop 2024-04-15T15:32:20.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f033de00640 1 -- 172.21.15.73:0/1273841890 shutdown_connections 2024-04-15T15:32:20.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f033de00640 1 --2- 172.21.15.73:0/1273841890 >> v2:172.21.15.118:3300/0 conn(0x7f03380b3e30 0x7f03380b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f033de00640 1 --2- 172.21.15.73:0/1273841890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b27c0 0x7f033815fc90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f033de00640 1 -- 172.21.15.73:0/1273841890 >> 172.21.15.73:0/1273841890 conn(0x7f0338067dd0 msgr2=0x7f03380d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:20.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f033de00640 1 -- 172.21.15.73:0/1273841890 shutdown_connections 2024-04-15T15:32:20.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.173+0000 7f033de00640 1 -- 172.21.15.73:0/1273841890 wait complete. 2024-04-15T15:32:20.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 Processor -- start 2024-04-15T15:32:20.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 -- start start 2024-04-15T15:32:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03380b27c0 0x7f0338151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b3e30 0x7f0338148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f033815b5d0 0x7f03381507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f033806faa0 con 0x7f033815b5d0 2024-04-15T15:32:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f03380b4240 con 0x7f03380b27c0 2024-04-15T15:32:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f033806fc20 con 0x7f03380b3e30 2024-04-15T15:32:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0337400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f033815b5d0 0x7f03381507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0337400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f033815b5d0 0x7f03381507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39534/0 (socket says 172.21.15.73:39534) 2024-04-15T15:32:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0337400640 1 -- 172.21.15.73:0/301733402 learned_addr learned my addr 172.21.15.73:0/301733402 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0336000640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b3e30 0x7f0338148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0336a00640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03380b27c0 0x7f0338151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0337400640 1 -- 172.21.15.73:0/301733402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b3e30 msgr2=0x7f0338148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0337400640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b3e30 0x7f0338148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0337400640 1 -- 172.21.15.73:0/301733402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03380b27c0 msgr2=0x7f0338151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0337400640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03380b27c0 0x7f0338151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0337400640 1 -- 172.21.15.73:0/301733402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033814e4e0 con 0x7f033815b5d0 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f0337400640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f033815b5d0 0x7f03381507b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0330009dd0 tx=0x7f033000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f032f400640 1 -- 172.21.15.73:0/301733402 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330018020 con 0x7f033815b5d0 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f032f400640 1 -- 172.21.15.73:0/301733402 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0330014480 con 0x7f033815b5d0 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f032f400640 1 -- 172.21.15.73:0/301733402 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330014870 con 0x7f033815b5d0 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 -- 172.21.15.73:0/301733402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033814e7c0 con 0x7f033815b5d0 2024-04-15T15:32:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 -- 172.21.15.73:0/301733402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033814ffb0 con 0x7f033815b5d0 2024-04-15T15:32:20.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.177+0000 7f033de00640 1 -- 172.21.15.73:0/301733402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0338068ab0 con 0x7f033815b5d0 2024-04-15T15:32:20.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.181+0000 7f032f400640 1 -- 172.21.15.73:0/301733402 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f033001b020 con 0x7f033815b5d0 2024-04-15T15:32:20.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.181+0000 7f032f400640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0318068380 0x7f031806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.181+0000 7f032f400640 1 -- 172.21.15.73:0/301733402 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f0330087840 con 0x7f033815b5d0 2024-04-15T15:32:20.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.181+0000 7f0336a00640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0318068380 0x7f031806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.181+0000 7f0336a00640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0318068380 0x7f031806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03380b2790 tx=0x7f0328009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:20.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.185+0000 7f032f400640 1 -- 172.21.15.73:0/301733402 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0330022070 con 0x7f033815b5d0 2024-04-15T15:32:20.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.341+0000 7f033de00640 1 -- 172.21.15.73:0/301733402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f033806f370 con 0x7f033815b5d0 2024-04-15T15:32:20.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f032f400640 1 -- 172.21.15.73:0/301733402 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f0330010040 con 0x7f033815b5d0 2024-04-15T15:32:20.345 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:20.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 -- 172.21.15.73:0/301733402 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0318068380 msgr2=0x7f031806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0318068380 0x7f031806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03380b2790 tx=0x7f0328009040 comp rx=0 tx=0).stop 2024-04-15T15:32:20.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 -- 172.21.15.73:0/301733402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f033815b5d0 msgr2=0x7f03381507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f033815b5d0 0x7f03381507b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0330009dd0 tx=0x7f033000c490 comp rx=0 tx=0).stop 2024-04-15T15:32:20.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 -- 172.21.15.73:0/301733402 shutdown_connections 2024-04-15T15:32:20.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f033815b5d0 0x7f03381507b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0318068380 0x7f031806a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03380b3e30 0x7f0338148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 --2- 172.21.15.73:0/301733402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03380b27c0 0x7f0338151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 -- 172.21.15.73:0/301733402 >> 172.21.15.73:0/301733402 conn(0x7f0338067dd0 msgr2=0x7f03380b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:20.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 -- 172.21.15.73:0/301733402 shutdown_connections 2024-04-15T15:32:20.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.345+0000 7f033de00640 1 -- 172.21.15.73:0/301733402 wait complete. 2024-04-15T15:32:20.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:20.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8eb200640 1 Processor -- start 2024-04-15T15:32:20.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8eb200640 1 -- start start 2024-04-15T15:32:20.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8eb200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb8e415b5d0 0x7fb8e415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8eb200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e4070160 con 0x7fb8e40b27c0 2024-04-15T15:32:20.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8eb200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e415f1f0 con 0x7fb8e40b3e30 2024-04-15T15:32:20.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8eb200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e415b9b0 con 0x7fb8e415b5d0 2024-04-15T15:32:20.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e9200640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb8e40b27c0 0x7fb8e40b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45506/0 (socket says 172.21.15.73:45506) 2024-04-15T15:32:20.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e9200640 1 -- 172.21.15.73:0/3090070620 learned_addr learned my addr 172.21.15.73:0/3090070620 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:20.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3e00640 1 --2- 172.21.15.73:0/3090070620 >> v2:172.21.15.118:3300/0 conn(0x7fb8e415b5d0 0x7fb8e415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220623313 0 0) 0x7fb8e4070160 con 0x7fb8e40b27c0 2024-04-15T15:32:20.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8c8003530 con 0x7fb8e40b27c0 2024-04-15T15:32:20.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4236835318 0 0) 0x7fb8c8003530 con 0x7fb8e40b27c0 2024-04-15T15:32:20.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 >> v2:172.21.15.118:3300/0 conn(0x7fb8e415b5d0 msgr2=0x7fb8e415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:20.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 --2- 172.21.15.73:0/3090070620 >> v2:172.21.15.118:3300/0 conn(0x7fb8e415b5d0 0x7fb8e415fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 >> v1:172.21.15.118:6789/0 conn(0x7fb8e40b3e30 legacy=0x7fb8e40b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e406fe80 con 0x7fb8e40b27c0 2024-04-15T15:32:20.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7fb8dc001a00 con 0x7fb8e40b27c0 2024-04-15T15:32:20.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 >> v1:172.21.15.73:6789/0 conn(0x7fb8e40b27c0 legacy=0x7fb8e40b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8c80039c0 0x7fb8c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c8004810 0x7fb8c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c80052f0 0x7fb8c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c800c190 con 0x7fb8c8004810 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c800c340 con 0x7fb8c80052f0 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c800c540 con 0x7fb8c80039c0 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8db400640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c8004810 0x7fb8c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e3e00640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8c80039c0 0x7fb8c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.505+0000 7fb8e9200640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c80052f0 0x7fb8c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8db400640 1 -- 172.21.15.73:0/3090070620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8c80039c0 msgr2=0x7fb8c8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8db400640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8c80039c0 0x7fb8c8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8db400640 1 -- 172.21.15.73:0/3090070620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c80052f0 msgr2=0x7fb8c800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8db400640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c80052f0 0x7fb8c800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8db400640 1 -- 172.21.15.73:0/3090070620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c8003530 con 0x7fb8c8004810 2024-04-15T15:32:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8e9200640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c80052f0 0x7fb8c800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8e9200640 1 -- 172.21.15.73:0/3090070620 reap_dead start 2024-04-15T15:32:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8db400640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c8004810 0x7fb8c8004c90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc001750 tx=0x7fb8cc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae776e438bf52a29 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:20.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0013a0 con 0x7fb8c8004810 2024-04-15T15:32:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc0a4e50 con 0x7fb8c8004810 2024-04-15T15:32:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8e3400640 1 -- 172.21.15.73:0/3090070620 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc003600 con 0x7fb8c8004810 2024-04-15T15:32:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8eb200640 1 -- 172.21.15.73:0/3090070620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c8004810 msgr2=0x7fb8c8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8eb200640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c8004810 0x7fb8c8004c90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc001750 tx=0x7fb8cc01c390 comp rx=0 tx=0).stop 2024-04-15T15:32:20.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8eb200640 1 -- 172.21.15.73:0/3090070620 shutdown_connections 2024-04-15T15:32:20.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8eb200640 1 --2- 172.21.15.73:0/3090070620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8c8004810 0x7fb8c8004c90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.509+0000 7fb8eb200640 1 -- 172.21.15.73:0/3090070620 >> 172.21.15.73:0/3090070620 conn(0x7fb8e4067dd0 msgr2=0x7fb8e40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:20.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 -- 172.21.15.73:0/3090070620 shutdown_connections 2024-04-15T15:32:20.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 -- 172.21.15.73:0/3090070620 wait complete. 2024-04-15T15:32:20.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 Processor -- start 2024-04-15T15:32:20.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 -- start start 2024-04-15T15:32:20.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8004810 0x7fb8e4148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8e415cca0 0x7fb8e4156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8e41565a0 0x7fb8e415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e40b2640 con 0x7fb8e41565a0 2024-04-15T15:32:20.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e40b24c0 con 0x7fb8c8004810 2024-04-15T15:32:20.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e40b4210 con 0x7fb8e415cca0 2024-04-15T15:32:20.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8e41565a0 0x7fb8e415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8e41565a0 0x7fb8e415d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39548/0 (socket says 172.21.15.73:39548) 2024-04-15T15:32:20.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e9200640 1 -- 172.21.15.73:0/2927540379 learned_addr learned my addr 172.21.15.73:0/2927540379 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:20.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8db400640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8e415cca0 0x7fb8e4156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e3e00640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8004810 0x7fb8e4148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e9200640 1 -- 172.21.15.73:0/2927540379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8e415cca0 msgr2=0x7fb8e4156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e9200640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8e415cca0 0x7fb8e4156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e9200640 1 -- 172.21.15.73:0/2927540379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8004810 msgr2=0x7fb8e4148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e9200640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8004810 0x7fb8e4148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e9200640 1 -- 172.21.15.73:0/2927540379 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e415bc00 con 0x7fb8e41565a0 2024-04-15T15:32:20.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e3e00640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8004810 0x7fb8e4148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:20.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e9200640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8e41565a0 0x7fb8e415d7f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4072fb0 tx=0x7fb8dc007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:20.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e0c00640 1 -- 172.21.15.73:0/2927540379 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00e9f0 con 0x7fb8e41565a0 2024-04-15T15:32:20.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e0c00640 1 -- 172.21.15.73:0/2927540379 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8dc00eb90 con 0x7fb8e41565a0 2024-04-15T15:32:20.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8e0c00640 1 -- 172.21.15.73:0/2927540379 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc014430 con 0x7fb8e41565a0 2024-04-15T15:32:20.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.513+0000 7fb8eb200640 1 -- 172.21.15.73:0/2927540379 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e415bee0 con 0x7fb8e41565a0 2024-04-15T15:32:20.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.517+0000 7fb8eb200640 1 -- 172.21.15.73:0/2927540379 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e415c4a0 con 0x7fb8e41565a0 2024-04-15T15:32:20.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.517+0000 7fb8eb200640 1 -- 172.21.15.73:0/2927540379 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e4068ab0 con 0x7fb8e41565a0 2024-04-15T15:32:20.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.517+0000 7fb8e0c00640 1 -- 172.21.15.73:0/2927540379 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8dc0145d0 con 0x7fb8e41565a0 2024-04-15T15:32:20.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.517+0000 7fb8e0c00640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb8c0068380 0x7fb8c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.517+0000 7fb8e0c00640 1 -- 172.21.15.73:0/2927540379 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fb8dc086b80 con 0x7fb8e41565a0 2024-04-15T15:32:20.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.517+0000 7fb8e3e00640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb8c0068380 0x7fb8c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.517+0000 7fb8e3e00640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb8c0068380 0x7fb8c006a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009b50 tx=0x7fb8d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:20.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.521+0000 7fb8e0c00640 1 -- 172.21.15.73:0/2927540379 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb8dc056c00 con 0x7fb8e41565a0 2024-04-15T15:32:20.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.677+0000 7fb8eb200640 1 -- 172.21.15.73:0/2927540379 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb8e406f370 con 0x7fb8e41565a0 2024-04-15T15:32:20.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.677+0000 7fb8e0c00640 1 -- 172.21.15.73:0/2927540379 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fb8dc056500 con 0x7fb8e41565a0 2024-04-15T15:32:20.680 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:20.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 -- 172.21.15.73:0/2927540379 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb8c0068380 msgr2=0x7fb8c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb8c0068380 0x7fb8c006a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009b50 tx=0x7fb8d4008040 comp rx=0 tx=0).stop 2024-04-15T15:32:20.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 -- 172.21.15.73:0/2927540379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8e41565a0 msgr2=0x7fb8e415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8e41565a0 0x7fb8e415d7f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4072fb0 tx=0x7fb8dc007bc0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 -- 172.21.15.73:0/2927540379 shutdown_connections 2024-04-15T15:32:20.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8e41565a0 0x7fb8e415d7f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb8c0068380 0x7fb8c006a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8e415cca0 0x7fb8e4156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 --2- 172.21.15.73:0/2927540379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8004810 0x7fb8e4148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 -- 172.21.15.73:0/2927540379 >> 172.21.15.73:0/2927540379 conn(0x7fb8e4067dd0 msgr2=0x7fb8e40cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:20.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 -- 172.21.15.73:0/2927540379 shutdown_connections 2024-04-15T15:32:20.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.681+0000 7fb8eb200640 1 -- 172.21.15.73:0/2927540379 wait complete. 2024-04-15T15:32:20.716 INFO:tasks.cephfs_test_runner:Starting test: test_quiesce_blocked (tasks.cephfs.test_quiesce.TestQuiesce) That a file with ceph.quiesce.block is not quiesced. 2024-04-15T15:32:20.716 INFO:tasks.cephfs_test_runner:test_quiesce_blocked (tasks.cephfs.test_quiesce.TestQuiesce) 2024-04-15T15:32:20.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:20.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.849+0000 7fbdcf600640 1 Processor -- start 2024-04-15T15:32:20.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.849+0000 7fbdcf600640 1 -- start start 2024-04-15T15:32:20.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdcf600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbdc8072520 0x7fbdc80b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdcf600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc806f5a0 con 0x7fbdc815be70 2024-04-15T15:32:20.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdcf600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc815f480 con 0x7fbdc806fc90 2024-04-15T15:32:20.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdcf600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc815b9e0 con 0x7fbdc8072520 2024-04-15T15:32:20.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdcd600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbdc8072520 0x7fbdc80b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdc7e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbdc815be70 0x7fbdc8071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45518/0 (socket says 172.21.15.73:45518) 2024-04-15T15:32:20.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdcd600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbdc8072520 0x7fbdc80b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39556/0 (socket says 172.21.15.73:39556) 2024-04-15T15:32:20.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdc7e00640 1 -- 172.21.15.73:0/3666138626 learned_addr learned my addr 172.21.15.73:0/3666138626 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:20.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdcd600640 1 -- 172.21.15.73:0/3666138626 >> v1:172.21.15.118:6789/0 conn(0x7fbdc806fc90 legacy=0x7fbdc815e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdcd600640 1 -- 172.21.15.73:0/3666138626 >> v1:172.21.15.73:6789/0 conn(0x7fbdc815be70 legacy=0x7fbdc8071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.853+0000 7fbdcd600640 1 -- 172.21.15.73:0/3666138626 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc815f760 con 0x7fbdc8072520 2024-04-15T15:32:20.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdcd600640 1 --2- 172.21.15.73:0/3666138626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc8072520 0x7fbdc80b3e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbdc815bb60 tx=0x7fbdc001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1981cfe2cd5393 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:20.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdc7400640 1 -- 172.21.15.73:0/3666138626 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00b2070 con 0x7fbdc8072520 2024-04-15T15:32:20.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdc7400640 1 -- 172.21.15.73:0/3666138626 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc00a58a0 con 0x7fbdc8072520 2024-04-15T15:32:20.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdc7400640 1 -- 172.21.15.73:0/3666138626 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00a5c70 con 0x7fbdc8072520 2024-04-15T15:32:20.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdcf600640 1 -- 172.21.15.73:0/3666138626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc8072520 msgr2=0x7fbdc80b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdcf600640 1 --2- 172.21.15.73:0/3666138626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc8072520 0x7fbdc80b3e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbdc815bb60 tx=0x7fbdc001c950 comp rx=0 tx=0).stop 2024-04-15T15:32:20.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdcf600640 1 -- 172.21.15.73:0/3666138626 shutdown_connections 2024-04-15T15:32:20.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdcf600640 1 --2- 172.21.15.73:0/3666138626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc8072520 0x7fbdc80b3e10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdcf600640 1 -- 172.21.15.73:0/3666138626 >> 172.21.15.73:0/3666138626 conn(0x7fbdc8067dd0 msgr2=0x7fbdc80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:20.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdcf600640 1 -- 172.21.15.73:0/3666138626 shutdown_connections 2024-04-15T15:32:20.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdcf600640 1 -- 172.21.15.73:0/3666138626 wait complete. 2024-04-15T15:32:20.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdcf600640 1 Processor -- start 2024-04-15T15:32:20.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.857+0000 7fbdcf600640 1 -- start start 2024-04-15T15:32:20.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdcf600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc806fc90 0x7fbdc80b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdcf600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdc8072520 0x7fbdc8140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdcf600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdc815be70 0x7fbdc80cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdcf600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc815f1a0 con 0x7fbdc806fc90 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdcf600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc815f020 con 0x7fbdc815be70 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdcf600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc80b4350 con 0x7fbdc8072520 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdccc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc806fc90 0x7fbdc80b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdccc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc806fc90 0x7fbdc80b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39572/0 (socket says 172.21.15.73:39572) 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdccc00640 1 -- 172.21.15.73:0/1332945821 learned_addr learned my addr 172.21.15.73:0/1332945821 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdccc00640 1 -- 172.21.15.73:0/1332945821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdc8072520 msgr2=0x7fbdc8140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdccc00640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdc8072520 0x7fbdc8140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdccc00640 1 -- 172.21.15.73:0/1332945821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdc815be70 msgr2=0x7fbdc80cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdccc00640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdc815be70 0x7fbdc80cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:20.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdccc00640 1 -- 172.21.15.73:0/1332945821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc8141290 con 0x7fbdc806fc90 2024-04-15T15:32:20.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdccc00640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc806fc90 0x7fbdc80b4cb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800c450 tx=0x7fbdb800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:20.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdc4c00640 1 -- 172.21.15.73:0/1332945821 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb80052d0 con 0x7fbdc806fc90 2024-04-15T15:32:20.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdc4c00640 1 -- 172.21.15.73:0/1332945821 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb8005470 con 0x7fbdc806fc90 2024-04-15T15:32:20.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdc4c00640 1 -- 172.21.15.73:0/1332945821 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8007240 con 0x7fbdc806fc90 2024-04-15T15:32:20.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdcf600640 1 -- 172.21.15.73:0/1332945821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc80cf230 con 0x7fbdc806fc90 2024-04-15T15:32:20.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdcf600640 1 -- 172.21.15.73:0/1332945821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc80cf7f0 con 0x7fbdc806fc90 2024-04-15T15:32:20.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdcf600640 1 -- 172.21.15.73:0/1332945821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc8068ab0 con 0x7fbdc806fc90 2024-04-15T15:32:20.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdc4c00640 1 -- 172.21.15.73:0/1332945821 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbdb80073e0 con 0x7fbdc806fc90 2024-04-15T15:32:20.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.861+0000 7fbdc4c00640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbda8068380 0x7fbda806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:20.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.865+0000 7fbdc4c00640 1 -- 172.21.15.73:0/1332945821 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fbdb80863c0 con 0x7fbdc806fc90 2024-04-15T15:32:20.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.865+0000 7fbdc7e00640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbda8068380 0x7fbda806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:20.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.865+0000 7fbdc7e00640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbda8068380 0x7fbda806a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbdc81fa7d0 tx=0x7fbdb4007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:20.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:20.869+0000 7fbdc4c00640 1 -- 172.21.15.73:0/1332945821 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbdb80564d0 con 0x7fbdc806fc90 2024-04-15T15:32:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.025+0000 7fbdcf600640 1 -- 172.21.15.73:0/1332945821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdc80ceb40 con 0x7fbdc806fc90 2024-04-15T15:32:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.025+0000 7fbdc4c00640 1 -- 172.21.15.73:0/1332945821 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7fbdb8055dd0 con 0x7fbdc806fc90 2024-04-15T15:32:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:21.027 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 -- 172.21.15.73:0/1332945821 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbda8068380 msgr2=0x7fbda806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbda8068380 0x7fbda806a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbdc81fa7d0 tx=0x7fbdb4007a50 comp rx=0 tx=0).stop 2024-04-15T15:32:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 -- 172.21.15.73:0/1332945821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc806fc90 msgr2=0x7fbdc80b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc806fc90 0x7fbdc80b4cb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800c450 tx=0x7fbdb800c910 comp rx=0 tx=0).stop 2024-04-15T15:32:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 -- 172.21.15.73:0/1332945821 shutdown_connections 2024-04-15T15:32:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdc815be70 0x7fbdc80cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbda8068380 0x7fbda806a840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdc8072520 0x7fbdc8140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 --2- 172.21.15.73:0/1332945821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdc806fc90 0x7fbdc80b4cb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 -- 172.21.15.73:0/1332945821 >> 172.21.15.73:0/1332945821 conn(0x7fbdc8067dd0 msgr2=0x7fbdc8154f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 -- 172.21.15.73:0/1332945821 shutdown_connections 2024-04-15T15:32:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.029+0000 7fbdcf600640 1 -- 172.21.15.73:0/1332945821 wait complete. 2024-04-15T15:32:21.049 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:21.049 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:21.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.185+0000 7f17c8600640 1 Processor -- start 2024-04-15T15:32:21.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.185+0000 7f17c8600640 1 -- start start 2024-04-15T15:32:21.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.185+0000 7f17c8600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17c00b27c0 0x7f17c015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.185+0000 7f17c8600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c0070160 con 0x7f17c00b3e30 2024-04-15T15:32:21.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.185+0000 7f17c8600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c015f1f0 con 0x7f17c015b5d0 2024-04-15T15:32:21.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.185+0000 7f17c8600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f17c015b9b0 con 0x7f17c00b27c0 2024-04-15T15:32:21.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.185+0000 7f17c5200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17c00b27c0 0x7f17c015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.185+0000 7f17c6600640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f17c00b3e30 0x7f17c00b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45522/0 (socket says 172.21.15.73:45522) 2024-04-15T15:32:21.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.185+0000 7f17c6600640 1 -- 172.21.15.73:0/1883175394 learned_addr learned my addr 172.21.15.73:0/1883175394 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:21.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.189+0000 7f17c5200640 1 -- 172.21.15.73:0/1883175394 >> v1:172.21.15.118:6789/0 conn(0x7f17c015b5d0 legacy=0x7f17c00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:21.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.189+0000 7f17c5200640 1 -- 172.21.15.73:0/1883175394 >> v1:172.21.15.73:6789/0 conn(0x7f17c00b3e30 legacy=0x7f17c00b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.189+0000 7f17c5200640 1 -- 172.21.15.73:0/1883175394 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c006fe80 con 0x7f17c00b27c0 2024-04-15T15:32:21.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.189+0000 7f17c5200640 1 --2- 172.21.15.73:0/1883175394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b27c0 0x7f17c015fc90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097c0 tx=0x7f17b001e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56019b0eaed0de28 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:21.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.189+0000 7f17bfe00640 1 -- 172.21.15.73:0/1883175394 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00ac600 con 0x7f17c00b27c0 2024-04-15T15:32:21.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.189+0000 7f17bfe00640 1 -- 172.21.15.73:0/1883175394 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b00b1070 con 0x7f17c00b27c0 2024-04-15T15:32:21.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.189+0000 7f17bfe00640 1 -- 172.21.15.73:0/1883175394 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00ac9c0 con 0x7f17c00b27c0 2024-04-15T15:32:21.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 -- 172.21.15.73:0/1883175394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b27c0 msgr2=0x7f17c015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 --2- 172.21.15.73:0/1883175394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b27c0 0x7f17c015fc90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097c0 tx=0x7f17b001e4f0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 -- 172.21.15.73:0/1883175394 shutdown_connections 2024-04-15T15:32:21.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 --2- 172.21.15.73:0/1883175394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b27c0 0x7f17c015fc90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 -- 172.21.15.73:0/1883175394 >> 172.21.15.73:0/1883175394 conn(0x7f17c0067dd0 msgr2=0x7f17c00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:21.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 -- 172.21.15.73:0/1883175394 shutdown_connections 2024-04-15T15:32:21.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 -- 172.21.15.73:0/1883175394 wait complete. 2024-04-15T15:32:21.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 Processor -- start 2024-04-15T15:32:21.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 -- start start 2024-04-15T15:32:21.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00b27c0 0x7f17c00b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b3e30 0x7f17c014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17c015b5d0 0x7f17c015bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f17c006faa0 con 0x7f17c00b3e30 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f17c00b4240 con 0x7f17c00b27c0 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c8600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f17c006fc20 con 0x7f17c015b5d0 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c5200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b3e30 0x7f17c014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c5200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b3e30 0x7f17c014cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39580/0 (socket says 172.21.15.73:39580) 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c5200640 1 -- 172.21.15.73:0/1716906123 learned_addr learned my addr 172.21.15.73:0/1716906123 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c6600640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17c015b5d0 0x7f17c015bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c5c00640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00b27c0 0x7f17c00b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c5200640 1 -- 172.21.15.73:0/1716906123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17c015b5d0 msgr2=0x7f17c015bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c5200640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17c015b5d0 0x7f17c015bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c5200640 1 -- 172.21.15.73:0/1716906123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00b27c0 msgr2=0x7f17c00b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c5200640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00b27c0 0x7f17c00b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c5200640 1 -- 172.21.15.73:0/1716906123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c01534f0 con 0x7f17c00b3e30 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.193+0000 7f17c5200640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b3e30 0x7f17c014cea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097c0 tx=0x7f17b001cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:21.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17bd600640 1 -- 172.21.15.73:0/1716906123 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00bb070 con 0x7f17c00b3e30 2024-04-15T15:32:21.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17bd600640 1 -- 172.21.15.73:0/1716906123 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b00b5640 con 0x7f17c00b3e30 2024-04-15T15:32:21.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17c8600640 1 -- 172.21.15.73:0/1716906123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c01537d0 con 0x7f17c00b3e30 2024-04-15T15:32:21.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17bd600640 1 -- 172.21.15.73:0/1716906123 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00b5a30 con 0x7f17c00b3e30 2024-04-15T15:32:21.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17c8600640 1 -- 172.21.15.73:0/1716906123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c0153d90 con 0x7f17c00b3e30 2024-04-15T15:32:21.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17c8600640 1 -- 172.21.15.73:0/1716906123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c015bd20 con 0x7f17c00b3e30 2024-04-15T15:32:21.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17bd600640 1 -- 172.21.15.73:0/1716906123 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f17b00be070 con 0x7f17c00b3e30 2024-04-15T15:32:21.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17bd600640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f17a4068380 0x7f17a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17bd600640 1 -- 172.21.15.73:0/1716906123 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f17b0121260 con 0x7f17c00b3e30 2024-04-15T15:32:21.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17c5c00640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f17a4068380 0x7f17a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.197+0000 7f17c5c00640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f17a4068380 0x7f17a406a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f17c00b10c0 tx=0x7f17b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:21.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.201+0000 7f17bd600640 1 -- 172.21.15.73:0/1716906123 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17c015bd20 con 0x7f17c00b3e30 2024-04-15T15:32:21.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 -- 172.21.15.73:0/1716906123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f17c006f370 con 0x7f17c00b3e30 2024-04-15T15:32:21.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17bd600640 1 -- 172.21.15.73:0/1716906123 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f17b0018260 con 0x7f17c00b3e30 2024-04-15T15:32:21.361 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:21.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 -- 172.21.15.73:0/1716906123 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f17a4068380 msgr2=0x7f17a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f17a4068380 0x7f17a406a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f17c00b10c0 tx=0x7f17b4009040 comp rx=0 tx=0).stop 2024-04-15T15:32:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 -- 172.21.15.73:0/1716906123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b3e30 msgr2=0x7f17c014cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b3e30 0x7f17c014cea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097c0 tx=0x7f17b001cd30 comp rx=0 tx=0).stop 2024-04-15T15:32:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 -- 172.21.15.73:0/1716906123 shutdown_connections 2024-04-15T15:32:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f17a4068380 0x7f17a406a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17c015b5d0 0x7f17c015bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17c00b3e30 0x7f17c014cea0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 --2- 172.21.15.73:0/1716906123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00b27c0 0x7f17c00b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 -- 172.21.15.73:0/1716906123 >> 172.21.15.73:0/1716906123 conn(0x7f17c0067dd0 msgr2=0x7f17c0158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 -- 172.21.15.73:0/1716906123 shutdown_connections 2024-04-15T15:32:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.361+0000 7f17c8600640 1 -- 172.21.15.73:0/1716906123 wait complete. 2024-04-15T15:32:21.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c48400640 1 Processor -- start 2024-04-15T15:32:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c48400640 1 -- start start 2024-04-15T15:32:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c48400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 0x7f8c4015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c48400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c400b3e30 0x7f8c400b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c48400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c40070160 con 0x7f8c4015b5d0 2024-04-15T15:32:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c48400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4015b9b0 con 0x7f8c400b3e30 2024-04-15T15:32:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c48400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4015f1f0 con 0x7f8c400b27c0 2024-04-15T15:32:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c45000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 0x7f8c4015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c45a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8c4015b5d0 0x7f8c400b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:43886/0 (socket says 172.21.15.73:43886) 2024-04-15T15:32:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c46400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c400b3e30 0x7f8c400b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c45a00640 1 -- 172.21.15.73:0/1939086073 learned_addr learned my addr 172.21.15.73:0/1939086073 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c3fe00640 1 -- 172.21.15.73:0/1939086073 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293341788 0 0) 0x7f8c40070160 con 0x7f8c4015b5d0 2024-04-15T15:32:21.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c3fe00640 1 -- 172.21.15.73:0/1939086073 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c28003530 con 0x7f8c4015b5d0 2024-04-15T15:32:21.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c45000640 1 -- 172.21.15.73:0/1939086073 >> v2:172.21.15.118:3300/0 conn(0x7f8c400b3e30 msgr2=0x7f8c400b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:21.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c45000640 1 --2- 172.21.15.73:0/1939086073 >> v2:172.21.15.118:3300/0 conn(0x7f8c400b3e30 0x7f8c400b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c45000640 1 -- 172.21.15.73:0/1939086073 >> v1:172.21.15.118:6789/0 conn(0x7f8c4015b5d0 legacy=0x7f8c400b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c45000640 1 -- 172.21.15.73:0/1939086073 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4006fe80 con 0x7f8c400b27c0 2024-04-15T15:32:21.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.521+0000 7f8c46400640 1 --2- 172.21.15.73:0/1939086073 >> v2:172.21.15.118:3300/0 conn(0x7f8c400b3e30 0x7f8c400b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:21.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c45000640 1 --2- 172.21.15.73:0/1939086073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 0x7f8c4015fc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097c0 tx=0x7f8c2c01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c304b59fc8507722 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:21.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c3fe00640 1 -- 172.21.15.73:0/1939086073 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0b0070 con 0x7f8c400b27c0 2024-04-15T15:32:21.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c3fe00640 1 -- 172.21.15.73:0/1939086073 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2c004030 con 0x7f8c400b27c0 2024-04-15T15:32:21.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c3fe00640 1 -- 172.21.15.73:0/1939086073 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c004440 con 0x7f8c400b27c0 2024-04-15T15:32:21.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c48400640 1 -- 172.21.15.73:0/1939086073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 msgr2=0x7f8c4015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c48400640 1 --2- 172.21.15.73:0/1939086073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 0x7f8c4015fc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097c0 tx=0x7f8c2c01c350 comp rx=0 tx=0).stop 2024-04-15T15:32:21.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c48400640 1 -- 172.21.15.73:0/1939086073 shutdown_connections 2024-04-15T15:32:21.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c48400640 1 --2- 172.21.15.73:0/1939086073 >> v2:172.21.15.118:3300/0 conn(0x7f8c400b3e30 0x7f8c400b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c48400640 1 --2- 172.21.15.73:0/1939086073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 0x7f8c4015fc90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c48400640 1 -- 172.21.15.73:0/1939086073 >> 172.21.15.73:0/1939086073 conn(0x7f8c40067dd0 msgr2=0x7f8c400d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:21.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c48400640 1 -- 172.21.15.73:0/1939086073 shutdown_connections 2024-04-15T15:32:21.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.525+0000 7f8c48400640 1 -- 172.21.15.73:0/1939086073 wait complete. 2024-04-15T15:32:21.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c48400640 1 Processor -- start 2024-04-15T15:32:21.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c48400640 1 -- start start 2024-04-15T15:32:21.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c48400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 0x7f8c401468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c48400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c400b3e30 0x7f8c4014bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c48400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c4015b5d0 0x7f8c4014c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c48400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4006faa0 con 0x7f8c4015b5d0 2024-04-15T15:32:21.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c48400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8c400b4240 con 0x7f8c400b3e30 2024-04-15T15:32:21.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c48400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4006fc20 con 0x7f8c400b27c0 2024-04-15T15:32:21.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c46400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c4015b5d0 0x7f8c4014c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c46400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c4015b5d0 0x7f8c4014c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39592/0 (socket says 172.21.15.73:39592) 2024-04-15T15:32:21.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c46400640 1 -- 172.21.15.73:0/900729357 learned_addr learned my addr 172.21.15.73:0/900729357 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:21.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c45a00640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 0x7f8c401468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c45000640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c400b3e30 0x7f8c4014bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c46400640 1 -- 172.21.15.73:0/900729357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 msgr2=0x7f8c401468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c46400640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 0x7f8c401468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c46400640 1 -- 172.21.15.73:0/900729357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c400b3e30 msgr2=0x7f8c4014bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c46400640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c400b3e30 0x7f8c4014bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c46400640 1 -- 172.21.15.73:0/900729357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c40164e80 con 0x7f8c4015b5d0 2024-04-15T15:32:21.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c45a00640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 0x7f8c401468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:21.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c45000640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c400b3e30 0x7f8c4014bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c46400640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c4015b5d0 0x7f8c4014c310 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800e930 tx=0x7f8c3800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c3d600640 1 -- 172.21.15.73:0/900729357 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38017070 con 0x7f8c4015b5d0 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c3d600640 1 -- 172.21.15.73:0/900729357 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c38004020 con 0x7f8c4015b5d0 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c48400640 1 -- 172.21.15.73:0/900729357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c40165160 con 0x7f8c4015b5d0 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c3d600640 1 -- 172.21.15.73:0/900729357 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38004430 con 0x7f8c4015b5d0 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.529+0000 7f8c48400640 1 -- 172.21.15.73:0/900729357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c40165720 con 0x7f8c4015b5d0 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.533+0000 7f8c48400640 1 -- 172.21.15.73:0/900729357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c40068ab0 con 0x7f8c4015b5d0 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.533+0000 7f8c3d600640 1 -- 172.21.15.73:0/900729357 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8c3800c940 con 0x7f8c4015b5d0 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.533+0000 7f8c3d600640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c20068380 0x7f8c2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.533+0000 7f8c3d600640 1 -- 172.21.15.73:0/900729357 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f8c38086fe0 con 0x7f8c4015b5d0 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.533+0000 7f8c45a00640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c20068380 0x7f8c2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.533+0000 7f8c45a00640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c20068380 0x7f8c2006a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c34005c10 tx=0x7f8c34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:21.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.537+0000 7f8c3d600640 1 -- 172.21.15.73:0/900729357 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8c38057130 con 0x7f8c4015b5d0 2024-04-15T15:32:21.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 -- 172.21.15.73:0/900729357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8c40166020 con 0x7f8c4015b5d0 2024-04-15T15:32:21.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c3d600640 1 -- 172.21.15.73:0/900729357 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f8c38056a30 con 0x7f8c4015b5d0 2024-04-15T15:32:21.700 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:21.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 -- 172.21.15.73:0/900729357 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c20068380 msgr2=0x7f8c2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c20068380 0x7f8c2006a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c34005c10 tx=0x7f8c34009040 comp rx=0 tx=0).stop 2024-04-15T15:32:21.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 -- 172.21.15.73:0/900729357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c4015b5d0 msgr2=0x7f8c4014c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c4015b5d0 0x7f8c4014c310 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800e930 tx=0x7f8c3800edf0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 -- 172.21.15.73:0/900729357 shutdown_connections 2024-04-15T15:32:21.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c4015b5d0 0x7f8c4014c310 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c400b3e30 0x7f8c4014bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8c20068380 0x7f8c2006a840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 --2- 172.21.15.73:0/900729357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c400b27c0 0x7f8c401468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 -- 172.21.15.73:0/900729357 >> 172.21.15.73:0/900729357 conn(0x7f8c40067dd0 msgr2=0x7f8c400b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:21.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 -- 172.21.15.73:0/900729357 shutdown_connections 2024-04-15T15:32:21.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.697+0000 7f8c48400640 1 -- 172.21.15.73:0/900729357 wait complete. 2024-04-15T15:32:21.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:21.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd53800640 1 Processor -- start 2024-04-15T15:32:21.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd53800640 1 -- start start 2024-04-15T15:32:21.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd53800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd4c06d170 0x7fcd4c073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd53800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd4c070130 0x7fcd4c06e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd53800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd4c0b4810 con 0x7fcd4c15e760 2024-04-15T15:32:21.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd53800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4c0cd2f0 con 0x7fcd4c070130 2024-04-15T15:32:21.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd53800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4c0b45c0 con 0x7fcd4c06d170 2024-04-15T15:32:21.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd50e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcd4c15e760 0x7fcd4c06ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45536/0 (socket says 172.21.15.73:45536) 2024-04-15T15:32:21.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd50e00640 1 -- 172.21.15.73:0/11696623 learned_addr learned my addr 172.21.15.73:0/11696623 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:21.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd51800640 1 --2- 172.21.15.73:0/11696623 >> v2:172.21.15.73:3300/0 conn(0x7fcd4c070130 0x7fcd4c06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd4b400640 1 -- 172.21.15.73:0/11696623 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1574393530 0 0) 0x7fcd4c0b4810 con 0x7fcd4c15e760 2024-04-15T15:32:21.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd4be00640 1 --2- 172.21.15.73:0/11696623 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c06d170 0x7fcd4c073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd4b400640 1 -- 172.21.15.73:0/11696623 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd30003530 con 0x7fcd4c15e760 2024-04-15T15:32:21.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd51800640 1 -- 172.21.15.73:0/11696623 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c06d170 msgr2=0x7fcd4c073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:21.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd51800640 1 --2- 172.21.15.73:0/11696623 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c06d170 0x7fcd4c073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd51800640 1 -- 172.21.15.73:0/11696623 >> v1:172.21.15.73:6789/0 conn(0x7fcd4c15e760 legacy=0x7fcd4c06ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd51800640 1 -- 172.21.15.73:0/11696623 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c0b4af0 con 0x7fcd4c070130 2024-04-15T15:32:21.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.857+0000 7fcd4be00640 1 --2- 172.21.15.73:0/11696623 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c06d170 0x7fcd4c073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:21.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd51800640 1 --2- 172.21.15.73:0/11696623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c070130 0x7fcd4c06e740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0b5f80 tx=0x7fcd4401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110b40d12f6c028c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:21.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd4b400640 1 -- 172.21.15.73:0/11696623 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440b1070 con 0x7fcd4c070130 2024-04-15T15:32:21.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd4b400640 1 -- 172.21.15.73:0/11696623 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd440ac620 con 0x7fcd4c070130 2024-04-15T15:32:21.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd4b400640 1 -- 172.21.15.73:0/11696623 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440ac9f0 con 0x7fcd4c070130 2024-04-15T15:32:21.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd53800640 1 -- 172.21.15.73:0/11696623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c070130 msgr2=0x7fcd4c06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd53800640 1 --2- 172.21.15.73:0/11696623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c070130 0x7fcd4c06e740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0b5f80 tx=0x7fcd4401c3c0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd53800640 1 -- 172.21.15.73:0/11696623 shutdown_connections 2024-04-15T15:32:21.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd53800640 1 --2- 172.21.15.73:0/11696623 >> v2:172.21.15.118:3300/0 conn(0x7fcd4c06d170 0x7fcd4c073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd53800640 1 --2- 172.21.15.73:0/11696623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c070130 0x7fcd4c06e740 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd53800640 1 -- 172.21.15.73:0/11696623 >> 172.21.15.73:0/11696623 conn(0x7fcd4c072590 msgr2=0x7fcd4c072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd53800640 1 -- 172.21.15.73:0/11696623 shutdown_connections 2024-04-15T15:32:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.861+0000 7fcd53800640 1 -- 172.21.15.73:0/11696623 wait complete. 2024-04-15T15:32:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 Processor -- start 2024-04-15T15:32:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 -- start start 2024-04-15T15:32:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c06d170 0x7fcd4c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c070130 0x7fcd4c0cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15e760 0x7fcd4c0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c06f490 con 0x7fcd4c15e760 2024-04-15T15:32:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c15ed50 con 0x7fcd4c06d170 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c06f610 con 0x7fcd4c070130 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd51800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15e760 0x7fcd4c0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd51800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15e760 0x7fcd4c0cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39622/0 (socket says 172.21.15.73:39622) 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd51800640 1 -- 172.21.15.73:0/25843531 learned_addr learned my addr 172.21.15.73:0/25843531 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd50e00640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c06d170 0x7fcd4c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd51800640 1 -- 172.21.15.73:0/25843531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c070130 msgr2=0x7fcd4c0cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd4be00640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c070130 0x7fcd4c0cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd51800640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c070130 0x7fcd4c0cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd51800640 1 -- 172.21.15.73:0/25843531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c06d170 msgr2=0x7fcd4c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd51800640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c06d170 0x7fcd4c0cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd51800640 1 -- 172.21.15.73:0/25843531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c0b25e0 con 0x7fcd4c15e760 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd50e00640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c06d170 0x7fcd4c0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd4be00640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c070130 0x7fcd4c0cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:21.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd51800640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15e760 0x7fcd4c0cdfc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcd440af040 tx=0x7fcd44019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:21.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd48c00640 1 -- 172.21.15.73:0/25843531 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440b9020 con 0x7fcd4c15e760 2024-04-15T15:32:21.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd48c00640 1 -- 172.21.15.73:0/25843531 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd440b5410 con 0x7fcd4c15e760 2024-04-15T15:32:21.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd48c00640 1 -- 172.21.15.73:0/25843531 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440b1040 con 0x7fcd4c15e760 2024-04-15T15:32:21.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 -- 172.21.15.73:0/25843531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c0ce660 con 0x7fcd4c15e760 2024-04-15T15:32:21.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 -- 172.21.15.73:0/25843531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c0cec20 con 0x7fcd4c15e760 2024-04-15T15:32:21.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.865+0000 7fcd53800640 1 -- 172.21.15.73:0/25843531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c068ab0 con 0x7fcd4c15e760 2024-04-15T15:32:21.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.869+0000 7fcd48c00640 1 -- 172.21.15.73:0/25843531 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd440bc020 con 0x7fcd4c15e760 2024-04-15T15:32:21.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.869+0000 7fcd48c00640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 0x7fcd2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:21.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.869+0000 7fcd48c00640 1 -- 172.21.15.73:0/25843531 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fcd441209c0 con 0x7fcd4c15e760 2024-04-15T15:32:21.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.869+0000 7fcd50e00640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 0x7fcd2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:21.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.869+0000 7fcd50e00640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 0x7fcd2c06a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c005c10 tx=0x7fcd3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:21.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:21.873+0000 7fcd48c00640 1 -- 172.21.15.73:0/25843531 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd44122e20 con 0x7fcd4c15e760 2024-04-15T15:32:22.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.029+0000 7fcd53800640 1 -- 172.21.15.73:0/25843531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcd4c073260 con 0x7fcd4c15e760 2024-04-15T15:32:22.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.029+0000 7fcd48c00640 1 -- 172.21.15.73:0/25843531 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fcd440c3030 con 0x7fcd4c15e760 2024-04-15T15:32:22.031 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 -- 172.21.15.73:0/25843531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 msgr2=0x7fcd2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 0x7fcd2c06a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c005c10 tx=0x7fcd3c009040 comp rx=0 tx=0).stop 2024-04-15T15:32:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 -- 172.21.15.73:0/25843531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15e760 msgr2=0x7fcd4c0cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15e760 0x7fcd4c0cdfc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcd440af040 tx=0x7fcd44019160 comp rx=0 tx=0).stop 2024-04-15T15:32:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 -- 172.21.15.73:0/25843531 shutdown_connections 2024-04-15T15:32:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd4c15e760 0x7fcd4c0cdfc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcd2c068380 0x7fcd2c06a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd4c070130 0x7fcd4c0cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 --2- 172.21.15.73:0/25843531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd4c06d170 0x7fcd4c0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 -- 172.21.15.73:0/25843531 >> 172.21.15.73:0/25843531 conn(0x7fcd4c072590 msgr2=0x7fcd4c15ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:22.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 -- 172.21.15.73:0/25843531 shutdown_connections 2024-04-15T15:32:22.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.033+0000 7fcd53800640 1 -- 172.21.15.73:0/25843531 wait complete. 2024-04-15T15:32:22.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:22.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc9600640 1 Processor -- start 2024-04-15T15:32:22.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc9600640 1 -- start start 2024-04-15T15:32:22.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc9600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7effc406fc90 0x7effc415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc9600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 0x7effc415edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc9600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc406f5a0 con 0x7effc415e910 2024-04-15T15:32:22.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc9600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7effc415b9e0 con 0x7effc406fc90 2024-04-15T15:32:22.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc9600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7effc415f480 con 0x7effc4072520 2024-04-15T15:32:22.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc3400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 0x7effc415edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc2a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7effc406fc90 0x7effc415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc3400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 0x7effc415edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:47794/0 (socket says 172.21.15.73:47794) 2024-04-15T15:32:22.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc2000640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7effc415e910 0x7effc4071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:43902/0 (socket says 172.21.15.73:43902) 2024-04-15T15:32:22.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.189+0000 7effc3400640 1 -- 172.21.15.73:0/2160112503 learned_addr learned my addr 172.21.15.73:0/2160112503 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:22.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc3400640 1 -- 172.21.15.73:0/2160112503 >> v2:172.21.15.118:3300/0 conn(0x7effc406fc90 msgr2=0x7effc415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:22.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc3400640 1 --2- 172.21.15.73:0/2160112503 >> v2:172.21.15.118:3300/0 conn(0x7effc406fc90 0x7effc415be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc3400640 1 -- 172.21.15.73:0/2160112503 >> v1:172.21.15.118:6789/0 conn(0x7effc415e910 legacy=0x7effc4071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc3400640 1 -- 172.21.15.73:0/2160112503 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc415f760 con 0x7effc4072520 2024-04-15T15:32:22.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc2a00640 1 --2- 172.21.15.73:0/2160112503 >> v2:172.21.15.118:3300/0 conn(0x7effc406fc90 0x7effc415be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:22.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc3400640 1 --2- 172.21.15.73:0/2160112503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 0x7effc415edc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7effbc009870 tx=0x7effbc01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b3275024e76882f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:22.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc1600640 1 -- 172.21.15.73:0/2160112503 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc0a9610 con 0x7effc4072520 2024-04-15T15:32:22.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc1600640 1 -- 172.21.15.73:0/2160112503 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effbc0a97b0 con 0x7effc4072520 2024-04-15T15:32:22.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc1600640 1 -- 172.21.15.73:0/2160112503 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc0a9b80 con 0x7effc4072520 2024-04-15T15:32:22.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc9600640 1 -- 172.21.15.73:0/2160112503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 msgr2=0x7effc415edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.193+0000 7effc9600640 1 --2- 172.21.15.73:0/2160112503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 0x7effc415edc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7effbc009870 tx=0x7effbc01c530 comp rx=0 tx=0).stop 2024-04-15T15:32:22.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 -- 172.21.15.73:0/2160112503 shutdown_connections 2024-04-15T15:32:22.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 --2- 172.21.15.73:0/2160112503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 0x7effc415edc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 --2- 172.21.15.73:0/2160112503 >> v2:172.21.15.118:3300/0 conn(0x7effc406fc90 0x7effc415be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 -- 172.21.15.73:0/2160112503 >> 172.21.15.73:0/2160112503 conn(0x7effc4067dd0 msgr2=0x7effc40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:22.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 -- 172.21.15.73:0/2160112503 shutdown_connections 2024-04-15T15:32:22.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 -- 172.21.15.73:0/2160112503 wait complete. 2024-04-15T15:32:22.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 Processor -- start 2024-04-15T15:32:22.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 -- start start 2024-04-15T15:32:22.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc406fc90 0x7effc4154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 0x7effc406de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effc415e910 0x7effc406e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7effc40b47a0 con 0x7effc406fc90 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7effc40b4620 con 0x7effc415e910 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7effc40b4920 con 0x7effc4072520 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc2a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc406fc90 0x7effc4154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc2a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc406fc90 0x7effc4154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39636/0 (socket says 172.21.15.73:39636) 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc2a00640 1 -- 172.21.15.73:0/1111532008 learned_addr learned my addr 172.21.15.73:0/1111532008 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc3400640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effc415e910 0x7effc406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc2000640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 0x7effc406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc2a00640 1 -- 172.21.15.73:0/1111532008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 msgr2=0x7effc406de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc2a00640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 0x7effc406de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc2a00640 1 -- 172.21.15.73:0/1111532008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effc415e910 msgr2=0x7effc406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc2a00640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effc415e910 0x7effc406e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc2a00640 1 -- 172.21.15.73:0/1111532008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc4157770 con 0x7effc406fc90 2024-04-15T15:32:22.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc2a00640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc406fc90 0x7effc4154f30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7effb400efc0 tx=0x7effb400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:22.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effbaa00640 1 -- 172.21.15.73:0/1111532008 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4018020 con 0x7effc406fc90 2024-04-15T15:32:22.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effbaa00640 1 -- 172.21.15.73:0/1111532008 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb4014680 con 0x7effc406fc90 2024-04-15T15:32:22.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effbaa00640 1 -- 172.21.15.73:0/1111532008 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4014a50 con 0x7effc406fc90 2024-04-15T15:32:22.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.197+0000 7effc9600640 1 -- 172.21.15.73:0/1111532008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc4157a50 con 0x7effc406fc90 2024-04-15T15:32:22.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.201+0000 7effc9600640 1 -- 172.21.15.73:0/1111532008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc4158010 con 0x7effc406fc90 2024-04-15T15:32:22.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.201+0000 7effc9600640 1 -- 172.21.15.73:0/1111532008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc4068ab0 con 0x7effc406fc90 2024-04-15T15:32:22.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.201+0000 7effbaa00640 1 -- 172.21.15.73:0/1111532008 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7effb401b020 con 0x7effc406fc90 2024-04-15T15:32:22.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.201+0000 7effbaa00640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7effa40683b0 0x7effa406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.201+0000 7effbaa00640 1 -- 172.21.15.73:0/1111532008 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7effb4087c80 con 0x7effc406fc90 2024-04-15T15:32:22.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.201+0000 7effc2000640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7effa40683b0 0x7effa406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.201+0000 7effc2000640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7effa40683b0 0x7effa406a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7effc4154e60 tx=0x7effb0007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:22.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.205+0000 7effbaa00640 1 -- 172.21.15.73:0/1111532008 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7effb4022020 con 0x7effc406fc90 2024-04-15T15:32:22.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.361+0000 7effc9600640 1 -- 172.21.15.73:0/1111532008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7effc41569a0 con 0x7effc406fc90 2024-04-15T15:32:22.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.361+0000 7effbaa00640 1 -- 172.21.15.73:0/1111532008 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7effb4010040 con 0x7effc406fc90 2024-04-15T15:32:22.364 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:22.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 -- 172.21.15.73:0/1111532008 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7effa40683b0 msgr2=0x7effa406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7effa40683b0 0x7effa406a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7effc4154e60 tx=0x7effb0007e90 comp rx=0 tx=0).stop 2024-04-15T15:32:22.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 -- 172.21.15.73:0/1111532008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc406fc90 msgr2=0x7effc4154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc406fc90 0x7effc4154f30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7effb400efc0 tx=0x7effb400c490 comp rx=0 tx=0).stop 2024-04-15T15:32:22.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 -- 172.21.15.73:0/1111532008 shutdown_connections 2024-04-15T15:32:22.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effc415e910 0x7effc406e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7effa40683b0 0x7effa406a870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effc4072520 0x7effc406de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 --2- 172.21.15.73:0/1111532008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc406fc90 0x7effc4154f30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 -- 172.21.15.73:0/1111532008 >> 172.21.15.73:0/1111532008 conn(0x7effc4067dd0 msgr2=0x7effc4071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:22.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 -- 172.21.15.73:0/1111532008 shutdown_connections 2024-04-15T15:32:22.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.365+0000 7effc9600640 1 -- 172.21.15.73:0/1111532008 wait complete. 2024-04-15T15:32:22.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quiesce.TestQuiesce.test_quiesce_blocked' 2024-04-15T15:32:22.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cbb400640 1 Processor -- start 2024-04-15T15:32:22.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cbb400640 1 -- start start 2024-04-15T15:32:22.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cbb400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cb4146110 0x7f1cb40cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cbb400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1cb40b20b0 0x7f1cb40b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cbb400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb40cd3a0 con 0x7f1cb4071e10 2024-04-15T15:32:22.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cbb400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1cb40b5160 con 0x7f1cb40b20b0 2024-04-15T15:32:22.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cbb400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1cb40b40c0 con 0x7f1cb4146110 2024-04-15T15:32:22.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cb9400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1cb4071e10 0x7f1cb40722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45546/0 (socket says 172.21.15.73:45546) 2024-04-15T15:32:22.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cabe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1cb40b20b0 0x7f1cb40b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cb9400640 1 -- 172.21.15.73:0/3550990459 learned_addr learned my addr 172.21.15.73:0/3550990459 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:22.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cb8a00640 1 --2- 172.21.15.73:0/3550990459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cb4146110 0x7f1cb40cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cabe00640 1 -- 172.21.15.73:0/3550990459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cb4146110 msgr2=0x7f1cb40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:22.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cabe00640 1 --2- 172.21.15.73:0/3550990459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cb4146110 0x7f1cb40cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cabe00640 1 -- 172.21.15.73:0/3550990459 >> v1:172.21.15.73:6789/0 conn(0x7f1cb4071e10 legacy=0x7f1cb40722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cb3e00640 1 -- 172.21.15.73:0/3550990459 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1396914145 0 0) 0x7f1cb40cd3a0 con 0x7f1cb4071e10 2024-04-15T15:32:22.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.525+0000 7f1cabe00640 1 -- 172.21.15.73:0/3550990459 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb40b43a0 con 0x7f1cb40b20b0 2024-04-15T15:32:22.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cabe00640 1 --2- 172.21.15.73:0/3550990459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 0x7f1cb40b2530 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0097c0 tx=0x7f1c9c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f1fa7d15241e29 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:22.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cb3e00640 1 -- 172.21.15.73:0/3550990459 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0b2070 con 0x7f1cb40b20b0 2024-04-15T15:32:22.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cb3e00640 1 -- 172.21.15.73:0/3550990459 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c0ad640 con 0x7f1cb40b20b0 2024-04-15T15:32:22.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cb3e00640 1 -- 172.21.15.73:0/3550990459 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0ada10 con 0x7f1cb40b20b0 2024-04-15T15:32:22.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cbb400640 1 -- 172.21.15.73:0/3550990459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 msgr2=0x7f1cb40b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cbb400640 1 --2- 172.21.15.73:0/3550990459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 0x7f1cb40b2530 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0097c0 tx=0x7f1c9c01c4a0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cbb400640 1 -- 172.21.15.73:0/3550990459 shutdown_connections 2024-04-15T15:32:22.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cbb400640 1 --2- 172.21.15.73:0/3550990459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 0x7f1cb40b2530 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cbb400640 1 --2- 172.21.15.73:0/3550990459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cb4146110 0x7f1cb40cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cbb400640 1 -- 172.21.15.73:0/3550990459 >> 172.21.15.73:0/3550990459 conn(0x7f1cb4067dd0 msgr2=0x7f1cb40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:22.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cbb400640 1 -- 172.21.15.73:0/3550990459 shutdown_connections 2024-04-15T15:32:22.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.529+0000 7f1cbb400640 1 -- 172.21.15.73:0/3550990459 wait complete. 2024-04-15T15:32:22.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 Processor -- start 2024-04-15T15:32:22.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 -- start start 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cb4071e10 0x7f1cb4142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 0x7f1cb413bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cb4146110 0x7f1cb413d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb40cdcf0 con 0x7f1cb40b20b0 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb40b3d70 con 0x7f1cb4071e10 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1cb415dbe0 con 0x7f1cb4146110 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cabe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 0x7f1cb413bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cabe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 0x7f1cb413bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39654/0 (socket says 172.21.15.73:39654) 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cabe00640 1 -- 172.21.15.73:0/3376972554 learned_addr learned my addr 172.21.15.73:0/3376972554 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cb9400640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cb4146110 0x7f1cb413d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cb8a00640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cb4071e10 0x7f1cb4142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cabe00640 1 -- 172.21.15.73:0/3376972554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cb4146110 msgr2=0x7f1cb413d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cabe00640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cb4146110 0x7f1cb413d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cabe00640 1 -- 172.21.15.73:0/3376972554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cb4071e10 msgr2=0x7f1cb4142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cabe00640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cb4071e10 0x7f1cb4142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cabe00640 1 -- 172.21.15.73:0/3376972554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb413c580 con 0x7f1cb40b20b0 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cabe00640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 0x7f1cb413bef0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0b0040 tx=0x7f1c9c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cb1600640 1 -- 172.21.15.73:0/3376972554 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0b2040 con 0x7f1cb40b20b0 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cb1600640 1 -- 172.21.15.73:0/3376972554 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c0bd070 con 0x7f1cb40b20b0 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cb1600640 1 -- 172.21.15.73:0/3376972554 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0b6670 con 0x7f1cb40b20b0 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 -- 172.21.15.73:0/3376972554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb413c860 con 0x7f1cb40b20b0 2024-04-15T15:32:22.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 -- 172.21.15.73:0/3376972554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb413ce20 con 0x7f1cb40b20b0 2024-04-15T15:32:22.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.533+0000 7f1cbb400640 1 -- 172.21.15.73:0/3376972554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb4068ab0 con 0x7f1cb40b20b0 2024-04-15T15:32:22.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.537+0000 7f1cb1600640 1 -- 172.21.15.73:0/3376972554 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1c9c0b6810 con 0x7f1cb40b20b0 2024-04-15T15:32:22.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.537+0000 7f1cb1600640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1c90068380 0x7f1c9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:22.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.537+0000 7f1cb1600640 1 -- 172.21.15.73:0/3376972554 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f1c9c120eb0 con 0x7f1cb40b20b0 2024-04-15T15:32:22.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.537+0000 7f1cb8a00640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1c90068380 0x7f1c9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:22.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.537+0000 7f1cb8a00640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1c90068380 0x7f1c9006a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009af0 tx=0x7f1ca4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:22.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.541+0000 7f1cb1600640 1 -- 172.21.15.73:0/3376972554 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c9c016090 con 0x7f1cb40b20b0 2024-04-15T15:32:22.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:22.753+0000 7f1cbb400640 1 -- 172.21.15.73:0/3376972554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quiesce.TestQuiesce.test_quiesce_blocked"]} v 0) -- 0x7f1cb40ae3f0 con 0x7f1cb40b20b0 2024-04-15T15:32:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.605+0000 7f1cb1600640 1 -- 172.21.15.73:0/3376972554 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quiesce.TestQuiesce.test_quiesce_blocked"]}]=0 v74) ==== 140+0+0 (secure 0 0 0) 0x7f1c9c0f0f30 con 0x7f1cb40b20b0 2024-04-15T15:32:23.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 -- 172.21.15.73:0/3376972554 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1c90068380 msgr2=0x7f1c9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:23.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1c90068380 0x7f1c9006a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009af0 tx=0x7f1ca4008040 comp rx=0 tx=0).stop 2024-04-15T15:32:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 -- 172.21.15.73:0/3376972554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 msgr2=0x7f1cb413bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 0x7f1cb413bef0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0b0040 tx=0x7f1c9c019240 comp rx=0 tx=0).stop 2024-04-15T15:32:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 -- 172.21.15.73:0/3376972554 shutdown_connections 2024-04-15T15:32:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1c90068380 0x7f1c9006a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1cb4146110 0x7f1cb413d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb40b20b0 0x7f1cb413bef0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 --2- 172.21.15.73:0/3376972554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1cb4071e10 0x7f1cb4142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 -- 172.21.15.73:0/3376972554 >> 172.21.15.73:0/3376972554 conn(0x7f1cb4067dd0 msgr2=0x7f1cb4141fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 -- 172.21.15.73:0/3376972554 shutdown_connections 2024-04-15T15:32:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.609+0000 7f1cbb400640 1 -- 172.21.15.73:0/3376972554 wait complete. 2024-04-15T15:32:23.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-15T15:32:23.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.765+0000 7f0abea00640 1 Processor -- start 2024-04-15T15:32:23.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.765+0000 7f0abea00640 1 -- start start 2024-04-15T15:32:23.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0abea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 0x7f0ab80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:23.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0abea00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0ab815cbd0 0x7f0ab815d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:23.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0abea00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab80cd3a0 con 0x7f0ab8146110 2024-04-15T15:32:23.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0abea00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f0ab80b5160 con 0x7f0ab815cbd0 2024-04-15T15:32:23.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0abea00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab80b40c0 con 0x7f0ab80b20b0 2024-04-15T15:32:23.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0ab7400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 0x7f0ab80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:23.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0ab7400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 0x7f0ab80b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:47836/0 (socket says 172.21.15.73:47836) 2024-04-15T15:32:23.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0ab7400640 1 -- 172.21.15.73:0/1243340862 learned_addr learned my addr 172.21.15.73:0/1243340862 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:23.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0abca00640 1 --2- 172.21.15.73:0/1243340862 >> v2:172.21.15.118:3300/0 conn(0x7f0ab815cbd0 0x7f0ab815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:23.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0ab7400640 1 -- 172.21.15.73:0/1243340862 >> v2:172.21.15.118:3300/0 conn(0x7f0ab815cbd0 msgr2=0x7f0ab815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:23.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0ab7400640 1 --2- 172.21.15.73:0/1243340862 >> v2:172.21.15.118:3300/0 conn(0x7f0ab815cbd0 0x7f0ab815d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0ab7400640 1 -- 172.21.15.73:0/1243340862 >> v1:172.21.15.118:6789/0 conn(0x7f0ab8146110 legacy=0x7f0ab80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:23.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.769+0000 7f0ab7400640 1 -- 172.21.15.73:0/1243340862 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab80b43a0 con 0x7f0ab80b20b0 2024-04-15T15:32:23.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0ab7400640 1 --2- 172.21.15.73:0/1243340862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 0x7f0ab80b2530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009870 tx=0x7f0aa401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fc01ff33de39b94 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:23.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0ab6a00640 1 -- 172.21.15.73:0/1243340862 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40ab650 con 0x7f0ab80b20b0 2024-04-15T15:32:23.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0ab6a00640 1 -- 172.21.15.73:0/1243340862 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa40b0070 con 0x7f0ab80b20b0 2024-04-15T15:32:23.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0ab6a00640 1 -- 172.21.15.73:0/1243340862 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40aba10 con 0x7f0ab80b20b0 2024-04-15T15:32:23.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0abea00640 1 -- 172.21.15.73:0/1243340862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 msgr2=0x7f0ab80b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:23.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0abea00640 1 --2- 172.21.15.73:0/1243340862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 0x7f0ab80b2530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009870 tx=0x7f0aa401c560 comp rx=0 tx=0).stop 2024-04-15T15:32:23.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0abea00640 1 -- 172.21.15.73:0/1243340862 shutdown_connections 2024-04-15T15:32:23.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0abea00640 1 --2- 172.21.15.73:0/1243340862 >> v2:172.21.15.118:3300/0 conn(0x7f0ab815cbd0 0x7f0ab815d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0abea00640 1 --2- 172.21.15.73:0/1243340862 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 0x7f0ab80b2530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0abea00640 1 -- 172.21.15.73:0/1243340862 >> 172.21.15.73:0/1243340862 conn(0x7f0ab8067dd0 msgr2=0x7f0ab80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:23.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0abea00640 1 -- 172.21.15.73:0/1243340862 shutdown_connections 2024-04-15T15:32:23.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0abea00640 1 -- 172.21.15.73:0/1243340862 wait complete. 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0abea00640 1 Processor -- start 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.773+0000 7f0abea00640 1 -- start start 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0abea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 0x7f0ab80cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0abea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8146110 0x7f0ab813d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0abea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ab815cbd0 0x7f0ab8142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0abea00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8169210 con 0x7f0ab8146110 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0abea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab80b3d70 con 0x7f0ab815cbd0 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0abea00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab8169390 con 0x7f0ab80b20b0 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0ab7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8146110 0x7f0ab813d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0ab7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8146110 0x7f0ab813d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39670/0 (socket says 172.21.15.73:39670) 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0ab7400640 1 -- 172.21.15.73:0/4040990332 learned_addr learned my addr 172.21.15.73:0/4040990332 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0abca00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ab815cbd0 0x7f0ab8142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:23.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0ab7e00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 0x7f0ab80cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0ab7400640 1 -- 172.21.15.73:0/4040990332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 msgr2=0x7f0ab80cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0ab7400640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 0x7f0ab80cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0ab7400640 1 -- 172.21.15.73:0/4040990332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ab815cbd0 msgr2=0x7f0ab8142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0ab7400640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ab815cbd0 0x7f0ab8142030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0ab7400640 1 -- 172.21.15.73:0/4040990332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab813d850 con 0x7f0ab8146110 2024-04-15T15:32:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0ab7400640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8146110 0x7f0ab813d310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40ad040 tx=0x7f0aa401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0aafe00640 1 -- 172.21.15.73:0/4040990332 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40abe60 con 0x7f0ab8146110 2024-04-15T15:32:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0aafe00640 1 -- 172.21.15.73:0/4040990332 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa40be610 con 0x7f0ab8146110 2024-04-15T15:32:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0aafe00640 1 -- 172.21.15.73:0/4040990332 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40bea00 con 0x7f0ab8146110 2024-04-15T15:32:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0abea00640 1 -- 172.21.15.73:0/4040990332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab8145950 con 0x7f0ab8146110 2024-04-15T15:32:23.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0abea00640 1 -- 172.21.15.73:0/4040990332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab81450b0 con 0x7f0ab8146110 2024-04-15T15:32:23.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.777+0000 7f0abea00640 1 -- 172.21.15.73:0/4040990332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab8068ab0 con 0x7f0ab8146110 2024-04-15T15:32:23.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.781+0000 7f0aafe00640 1 -- 172.21.15.73:0/4040990332 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0aa40b43f0 con 0x7f0ab8146110 2024-04-15T15:32:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.781+0000 7f0aafe00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0a98068380 0x7f0a9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.781+0000 7f0aafe00640 1 -- 172.21.15.73:0/4040990332 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f0aa4121310 con 0x7f0ab8146110 2024-04-15T15:32:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.781+0000 7f0ab7e00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0a98068380 0x7f0a9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.781+0000 7f0ab7e00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0a98068380 0x7f0a9806a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8001d50 tx=0x7f0aa8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:23.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.785+0000 7f0aafe00640 1 -- 172.21.15.73:0/4040990332 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0aa4016150 con 0x7f0ab8146110 2024-04-15T15:32:23.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.941+0000 7f0abea00640 1 -- 172.21.15.73:0/4040990332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0ab80d04f0 con 0x7f0ab8146110 2024-04-15T15:32:23.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.945+0000 7f0aafe00640 1 -- 172.21.15.73:0/4040990332 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f0aa40f0e60 con 0x7f0ab8146110 2024-04-15T15:32:23.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 -- 172.21.15.73:0/4040990332 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0a98068380 msgr2=0x7f0a9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:23.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0a98068380 0x7f0a9806a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8001d50 tx=0x7f0aa8009040 comp rx=0 tx=0).stop 2024-04-15T15:32:23.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 -- 172.21.15.73:0/4040990332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8146110 msgr2=0x7f0ab813d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:23.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8146110 0x7f0ab813d310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40ad040 tx=0x7f0aa401ada0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 -- 172.21.15.73:0/4040990332 shutdown_connections 2024-04-15T15:32:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ab815cbd0 0x7f0ab8142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8146110 0x7f0ab813d310 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0a98068380 0x7f0a9806a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 --2- 172.21.15.73:0/4040990332 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0ab80b20b0 0x7f0ab80cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 -- 172.21.15.73:0/4040990332 >> 172.21.15.73:0/4040990332 conn(0x7f0ab8067dd0 msgr2=0x7f0ab80b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 -- 172.21.15.73:0/4040990332 shutdown_connections 2024-04-15T15:32:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:23.949+0000 7f0abea00640 1 -- 172.21.15.73:0/4040990332 wait complete. 2024-04-15T15:32:23.968 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-15T15:32:23.968 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-15T15:32:24.055 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-15T15:32:24.162 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-15T15:32:24.162 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:24.162 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:24.171 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:24.171 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:24.220 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:24.220 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:24.272 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:24.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.449+0000 7f7ec2c00640 1 Processor -- start 2024-04-15T15:32:24.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.449+0000 7f7ec2c00640 1 -- start start 2024-04-15T15:32:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.449+0000 7f7ec2c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b27c0 0x7f7ebc15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.449+0000 7f7ec2c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7ebc0b3e30 0x7f7ebc0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.449+0000 7f7ec2c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ebc070160 con 0x7f7ebc15b5d0 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.449+0000 7f7ec2c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f7ebc15b9b0 con 0x7f7ebc0b3e30 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.449+0000 7f7ec2c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7ebc15f1f0 con 0x7f7ebc0b27c0 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.449+0000 7f7ebbe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7ebc15b5d0 0x7f7ebc0b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45550/0 (socket says 172.21.15.73:45550) 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.449+0000 7f7ebbe00640 1 -- 172.21.15.73:0/3393256751 learned_addr learned my addr 172.21.15.73:0/3393256751 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ec0c00640 1 --2- 172.21.15.73:0/3393256751 >> v2:172.21.15.118:3300/0 conn(0x7f7ebc0b3e30 0x7f7ebc0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebb400640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b27c0 0x7f7ebc15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2207946293 0 0) 0x7f7ebc070160 con 0x7f7ebc15b5d0 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ea0003530 con 0x7f7ebc15b5d0 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2336797917 0 0) 0x7f7ea0003530 con 0x7f7ebc15b5d0 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b27c0 msgr2=0x7f7ebc15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b27c0 0x7f7ebc15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 >> v2:172.21.15.118:3300/0 conn(0x7f7ebc0b3e30 msgr2=0x7f7ebc0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 --2- 172.21.15.73:0/3393256751 >> v2:172.21.15.118:3300/0 conn(0x7f7ebc0b3e30 0x7f7ebc0b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc06fe80 con 0x7f7ebc15b5d0 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f7eac001680 con 0x7f7ebc15b5d0 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ec0c00640 1 --2- 172.21.15.73:0/3393256751 >> v2:172.21.15.118:3300/0 conn(0x7f7ebc0b3e30 0x7f7ebc0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 >> v1:172.21.15.73:6789/0 conn(0x7f7ebc15b5d0 legacy=0x7f7ebc0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b27c0 0x7f7ea00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea0003f40 0x7f7ea0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea0004d50 0x7f7ea00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc15f1f0 con 0x7f7ea0004d50 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea000ba30 con 0x7f7ea0003f40 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea000bc30 con 0x7f7ebc0b27c0 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebbe00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b27c0 0x7f7ea00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ec0c00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea0004d50 0x7f7ea00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebb400640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea0003f40 0x7f7ea0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebbe00640 1 -- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea0003f40 msgr2=0x7f7ea0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:24.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebbe00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea0003f40 0x7f7ea0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebbe00640 1 -- 172.21.15.73:0/3393256751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea0004d50 msgr2=0x7f7ea00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:24.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebbe00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea0004d50 0x7f7ea00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ebbe00640 1 -- 172.21.15.73:0/3393256751 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea0003530 con 0x7f7ebc0b27c0 2024-04-15T15:32:24.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.453+0000 7f7ec0c00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ea0004d50 0x7f7ea00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ebbe00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b27c0 0x7f7ea00039c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00c2c0 tx=0x7f7eac01cd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=752ec2f44d49389f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac007d60 con 0x7f7ebc0b27c0 2024-04-15T15:32:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eac0a9020 con 0x7f7ebc0b27c0 2024-04-15T15:32:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ebaa00640 1 -- 172.21.15.73:0/3393256751 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0058e0 con 0x7f7ebc0b27c0 2024-04-15T15:32:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ec2c00640 1 -- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b27c0 msgr2=0x7f7ea00039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ec2c00640 1 --2- 172.21.15.73:0/3393256751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b27c0 0x7f7ea00039c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00c2c0 tx=0x7f7eac01cd10 comp rx=0 tx=0).stop 2024-04-15T15:32:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ec0c00640 1 -- 172.21.15.73:0/3393256751 reap_dead start 2024-04-15T15:32:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ec2c00640 1 -- 172.21.15.73:0/3393256751 shutdown_connections 2024-04-15T15:32:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ec2c00640 1 -- 172.21.15.73:0/3393256751 >> 172.21.15.73:0/3393256751 conn(0x7f7ebc067dd0 msgr2=0x7f7ebc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ec2c00640 1 -- 172.21.15.73:0/3393256751 shutdown_connections 2024-04-15T15:32:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ec2c00640 1 -- 172.21.15.73:0/3393256751 wait complete. 2024-04-15T15:32:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ec2c00640 1 Processor -- start 2024-04-15T15:32:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.457+0000 7f7ec2c00640 1 -- start start 2024-04-15T15:32:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec2c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ebc0b27c0 0x7f7ebc0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec2c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ebc15da50 0x7f7ebc15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec2c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b0090 0x7f7ebc0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec2c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc06faa0 con 0x7f7ebc15da50 2024-04-15T15:32:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec2c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc0b4240 con 0x7f7ebc0b27c0 2024-04-15T15:32:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec2c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7ebc06fc20 con 0x7f7ebc0b0090 2024-04-15T15:32:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ebb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ebc15da50 0x7f7ebc15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ebb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ebc15da50 0x7f7ebc15ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39702/0 (socket says 172.21.15.73:39702) 2024-04-15T15:32:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ebb400640 1 -- 172.21.15.73:0/635111435 learned_addr learned my addr 172.21.15.73:0/635111435 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ebbe00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ebc0b27c0 0x7f7ebc0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec0c00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b0090 0x7f7ebc0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ebb400640 1 -- 172.21.15.73:0/635111435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b0090 msgr2=0x7f7ebc0b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ebb400640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b0090 0x7f7ebc0b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ebb400640 1 -- 172.21.15.73:0/635111435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ebc0b27c0 msgr2=0x7f7ebc0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ebb400640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ebc0b27c0 0x7f7ebc0cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ebb400640 1 -- 172.21.15.73:0/635111435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc15cbf0 con 0x7f7ebc15da50 2024-04-15T15:32:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec0c00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b0090 0x7f7ebc0b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ebb400640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ebc15da50 0x7f7ebc15ded0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8011960 tx=0x7f7ea8011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7eb3e00640 1 -- 172.21.15.73:0/635111435 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea800faf0 con 0x7f7ebc15da50 2024-04-15T15:32:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7eb3e00640 1 -- 172.21.15.73:0/635111435 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea800fc90 con 0x7f7ebc15da50 2024-04-15T15:32:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7eb3e00640 1 -- 172.21.15.73:0/635111435 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8014440 con 0x7f7ebc15da50 2024-04-15T15:32:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec2c00640 1 -- 172.21.15.73:0/635111435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ebc15bb50 con 0x7f7ebc15da50 2024-04-15T15:32:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec2c00640 1 -- 172.21.15.73:0/635111435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ebc15c110 con 0x7f7ebc15da50 2024-04-15T15:32:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7ec2c00640 1 -- 172.21.15.73:0/635111435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ebc068ab0 con 0x7f7ebc15da50 2024-04-15T15:32:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7eb3e00640 1 -- 172.21.15.73:0/635111435 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ea8012040 con 0x7f7ebc15da50 2024-04-15T15:32:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.461+0000 7f7eb3e00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7e9c068380 0x7f7e9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.465+0000 7f7eb3e00640 1 -- 172.21.15.73:0/635111435 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f7ea80874b0 con 0x7f7ebc15da50 2024-04-15T15:32:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.465+0000 7f7ebbe00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7e9c068380 0x7f7e9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.465+0000 7f7ebbe00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7e9c068380 0x7f7e9c06a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0aa000 tx=0x7f7eac0b0040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.469+0000 7f7eb3e00640 1 -- 172.21.15.73:0/635111435 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7ea8019030 con 0x7f7ebc15da50 2024-04-15T15:32:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.629+0000 7f7ec2c00640 1 -- 172.21.15.73:0/635111435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ebc166450 con 0x7f7ebc15da50 2024-04-15T15:32:24.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.629+0000 7f7eb3e00640 1 -- 172.21.15.73:0/635111435 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7f7ea80575c0 con 0x7f7ebc15da50 2024-04-15T15:32:24.630 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:24.630 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:24.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 -- 172.21.15.73:0/635111435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7e9c068380 msgr2=0x7f7e9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7e9c068380 0x7f7e9c06a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0aa000 tx=0x7f7eac0b0040 comp rx=0 tx=0).stop 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 -- 172.21.15.73:0/635111435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ebc15da50 msgr2=0x7f7ebc15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ebc15da50 0x7f7ebc15ded0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8011960 tx=0x7f7ea8011e20 comp rx=0 tx=0).stop 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 -- 172.21.15.73:0/635111435 shutdown_connections 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7e9c068380 0x7f7e9c06a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ebc0b0090 0x7f7ebc0b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ebc15da50 0x7f7ebc15ded0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 --2- 172.21.15.73:0/635111435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ebc0b27c0 0x7f7ebc0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 -- 172.21.15.73:0/635111435 >> 172.21.15.73:0/635111435 conn(0x7f7ebc067dd0 msgr2=0x7f7ebc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 -- 172.21.15.73:0/635111435 shutdown_connections 2024-04-15T15:32:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.633+0000 7f7ec2c00640 1 -- 172.21.15.73:0/635111435 wait complete. 2024-04-15T15:32:24.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:24.652 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a35200640 1 Processor -- start 2024-04-15T15:32:24.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a35200640 1 -- start start 2024-04-15T15:32:24.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a35200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a300b27c0 0x7f1a3015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a35200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a300b3e30 0x7f1a300b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a35200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a30070160 con 0x7f1a3015b5d0 2024-04-15T15:32:24.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a35200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1a3015b9b0 con 0x7f1a300b27c0 2024-04-15T15:32:24.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a35200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3015f1f0 con 0x7f1a300b3e30 2024-04-15T15:32:24.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a2d400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a300b27c0 0x7f1a3015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a2de00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1a3015b5d0 0x7f1a300b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45564/0 (socket says 172.21.15.73:45564) 2024-04-15T15:32:24.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a2de00640 1 -- 172.21.15.73:0/395529754 learned_addr learned my addr 172.21.15.73:0/395529754 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:24.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a2e800640 1 --2- 172.21.15.73:0/395529754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a300b3e30 0x7f1a300b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a2d400640 1 -- 172.21.15.73:0/395529754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a300b3e30 msgr2=0x7f1a300b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:24.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a2d400640 1 --2- 172.21.15.73:0/395529754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a300b3e30 0x7f1a300b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a2d400640 1 -- 172.21.15.73:0/395529754 >> v1:172.21.15.73:6789/0 conn(0x7f1a3015b5d0 legacy=0x7f1a300b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.789+0000 7f1a2d400640 1 -- 172.21.15.73:0/395529754 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3006fe80 con 0x7f1a300b27c0 2024-04-15T15:32:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.793+0000 7f1a2d400640 1 --2- 172.21.15.73:0/395529754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b27c0 0x7f1a3015fc90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097c0 tx=0x7f1a1c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a675b0f257ab4b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.793+0000 7f1a2ca00640 1 -- 172.21.15.73:0/395529754 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0b0070 con 0x7f1a300b27c0 2024-04-15T15:32:24.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.793+0000 7f1a2ca00640 1 -- 172.21.15.73:0/395529754 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c004030 con 0x7f1a300b27c0 2024-04-15T15:32:24.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.793+0000 7f1a2ca00640 1 -- 172.21.15.73:0/395529754 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c004440 con 0x7f1a300b27c0 2024-04-15T15:32:24.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.793+0000 7f1a35200640 1 -- 172.21.15.73:0/395529754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b27c0 msgr2=0x7f1a3015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.793+0000 7f1a35200640 1 --2- 172.21.15.73:0/395529754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b27c0 0x7f1a3015fc90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097c0 tx=0x7f1a1c01c350 comp rx=0 tx=0).stop 2024-04-15T15:32:24.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.793+0000 7f1a35200640 1 -- 172.21.15.73:0/395529754 shutdown_connections 2024-04-15T15:32:24.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.793+0000 7f1a35200640 1 --2- 172.21.15.73:0/395529754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a300b3e30 0x7f1a300b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.793+0000 7f1a35200640 1 --2- 172.21.15.73:0/395529754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b27c0 0x7f1a3015fc90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.793+0000 7f1a35200640 1 -- 172.21.15.73:0/395529754 >> 172.21.15.73:0/395529754 conn(0x7f1a30067dd0 msgr2=0x7f1a300d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:24.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 -- 172.21.15.73:0/395529754 shutdown_connections 2024-04-15T15:32:24.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 -- 172.21.15.73:0/395529754 wait complete. 2024-04-15T15:32:24.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 Processor -- start 2024-04-15T15:32:24.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 -- start start 2024-04-15T15:32:24.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a300b27c0 0x7f1a3014db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b3e30 0x7f1a3015c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a3015b5d0 0x7f1a30154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3006faa0 con 0x7f1a300b3e30 2024-04-15T15:32:24.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1a300b4240 con 0x7f1a300b27c0 2024-04-15T15:32:24.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3006fc20 con 0x7f1a3015b5d0 2024-04-15T15:32:24.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b3e30 0x7f1a3015c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b3e30 0x7f1a3015c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39708/0 (socket says 172.21.15.73:39708) 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2d400640 1 -- 172.21.15.73:0/2976461832 learned_addr learned my addr 172.21.15.73:0/2976461832 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2e800640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a3015b5d0 0x7f1a30154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2de00640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a300b27c0 0x7f1a3014db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2d400640 1 -- 172.21.15.73:0/2976461832 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a3015b5d0 msgr2=0x7f1a30154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2d400640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a3015b5d0 0x7f1a30154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2d400640 1 -- 172.21.15.73:0/2976461832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a300b27c0 msgr2=0x7f1a3014db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2d400640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a300b27c0 0x7f1a3014db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2d400640 1 -- 172.21.15.73:0/2976461832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3015dfe0 con 0x7f1a300b3e30 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a2d400640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b3e30 0x7f1a3015c500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c019f80 tx=0x7f1a1c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a26000640 1 -- 172.21.15.73:0/2976461832 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0b9020 con 0x7f1a300b3e30 2024-04-15T15:32:24.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a26000640 1 -- 172.21.15.73:0/2976461832 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c003b40 con 0x7f1a300b3e30 2024-04-15T15:32:24.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a26000640 1 -- 172.21.15.73:0/2976461832 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0b0040 con 0x7f1a300b3e30 2024-04-15T15:32:24.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 -- 172.21.15.73:0/2976461832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3015e2c0 con 0x7f1a300b3e30 2024-04-15T15:32:24.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.797+0000 7f1a35200640 1 -- 172.21.15.73:0/2976461832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3015e880 con 0x7f1a300b3e30 2024-04-15T15:32:24.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.801+0000 7f1a35200640 1 -- 172.21.15.73:0/2976461832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a30068ab0 con 0x7f1a300b3e30 2024-04-15T15:32:24.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.801+0000 7f1a26000640 1 -- 172.21.15.73:0/2976461832 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a1c0bc020 con 0x7f1a300b3e30 2024-04-15T15:32:24.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.801+0000 7f1a26000640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1a10068380 0x7f1a1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:24.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.801+0000 7f1a26000640 1 -- 172.21.15.73:0/2976461832 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f1a1c120d70 con 0x7f1a300b3e30 2024-04-15T15:32:24.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.801+0000 7f1a2de00640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1a10068380 0x7f1a1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:24.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.801+0000 7f1a2de00640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1a10068380 0x7f1a1006a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a30152d30 tx=0x7f1a20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:24.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.805+0000 7f1a26000640 1 -- 172.21.15.73:0/2976461832 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a1c0c3030 con 0x7f1a300b3e30 2024-04-15T15:32:24.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.961+0000 7f1a35200640 1 -- 172.21.15.73:0/2976461832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1a3006f370 con 0x7f1a300b3e30 2024-04-15T15:32:24.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a26000640 1 -- 172.21.15.73:0/2976461832 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f1a1c016090 con 0x7f1a300b3e30 2024-04-15T15:32:24.965 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 -- 172.21.15.73:0/2976461832 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1a10068380 msgr2=0x7f1a1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1a10068380 0x7f1a1006a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a30152d30 tx=0x7f1a20009040 comp rx=0 tx=0).stop 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 -- 172.21.15.73:0/2976461832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b3e30 msgr2=0x7f1a3015c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b3e30 0x7f1a3015c500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c019f80 tx=0x7f1a1c0190f0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 -- 172.21.15.73:0/2976461832 shutdown_connections 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1a10068380 0x7f1a1006a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a3015b5d0 0x7f1a30154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a300b3e30 0x7f1a3015c500 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 --2- 172.21.15.73:0/2976461832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a300b27c0 0x7f1a3014db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 -- 172.21.15.73:0/2976461832 >> 172.21.15.73:0/2976461832 conn(0x7f1a30067dd0 msgr2=0x7f1a300ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:24.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 -- 172.21.15.73:0/2976461832 shutdown_connections 2024-04-15T15:32:24.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:24.965+0000 7f1a35200640 1 -- 172.21.15.73:0/2976461832 wait complete. 2024-04-15T15:32:24.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.121+0000 7fcd18a00640 1 Processor -- start 2024-04-15T15:32:25.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.121+0000 7fcd18a00640 1 -- start start 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.121+0000 7fcd18a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd14146110 0x7fcd140cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.121+0000 7fcd18a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd140b20b0 0x7fcd140b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd18a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd14071e10 0x7fcd140722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd18a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcd140cd3a0 con 0x7fcd14146110 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd18a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fcd140b5160 con 0x7fcd140b20b0 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd18a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcd140b40c0 con 0x7fcd14071e10 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd14146110 0x7fcd140cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd14146110 0x7fcd140cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39714/0 (socket says 172.21.15.73:39714) 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11e00640 1 -- 172.21.15.73:0/4063579577 learned_addr learned my addr 172.21.15.73:0/4063579577 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd09400640 1 --2- 172.21.15.73:0/4063579577 >> v2:172.21.15.118:3300/0 conn(0x7fcd140b20b0 0x7fcd140b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd12800640 1 --2- 172.21.15.73:0/4063579577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd14071e10 0x7fcd140722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11e00640 1 -- 172.21.15.73:0/4063579577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd14071e10 msgr2=0x7fcd140722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:25.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11e00640 1 --2- 172.21.15.73:0/4063579577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd14071e10 0x7fcd140722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11e00640 1 -- 172.21.15.73:0/4063579577 >> v2:172.21.15.118:3300/0 conn(0x7fcd140b20b0 msgr2=0x7fcd140b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:25.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11e00640 1 --2- 172.21.15.73:0/4063579577 >> v2:172.21.15.118:3300/0 conn(0x7fcd140b20b0 0x7fcd140b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11e00640 1 -- 172.21.15.73:0/4063579577 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd140b43a0 con 0x7fcd14146110 2024-04-15T15:32:25.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11e00640 1 --2- 172.21.15.73:0/4063579577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd14146110 0x7fcd140cd7b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcd140701c0 tx=0x7fcd0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c9862483e8379b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:25.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11400640 1 -- 172.21.15.73:0/4063579577 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd040b1070 con 0x7fcd14146110 2024-04-15T15:32:25.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11400640 1 -- 172.21.15.73:0/4063579577 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd040ac630 con 0x7fcd14146110 2024-04-15T15:32:25.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.125+0000 7fcd11400640 1 -- 172.21.15.73:0/4063579577 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd040a8050 con 0x7fcd14146110 2024-04-15T15:32:25.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 -- 172.21.15.73:0/4063579577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd14146110 msgr2=0x7fcd140cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 --2- 172.21.15.73:0/4063579577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd14146110 0x7fcd140cd7b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcd140701c0 tx=0x7fcd0401c520 comp rx=0 tx=0).stop 2024-04-15T15:32:25.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 -- 172.21.15.73:0/4063579577 shutdown_connections 2024-04-15T15:32:25.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 --2- 172.21.15.73:0/4063579577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd14071e10 0x7fcd140722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 --2- 172.21.15.73:0/4063579577 >> v2:172.21.15.118:3300/0 conn(0x7fcd140b20b0 0x7fcd140b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 --2- 172.21.15.73:0/4063579577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd14146110 0x7fcd140cd7b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 -- 172.21.15.73:0/4063579577 >> 172.21.15.73:0/4063579577 conn(0x7fcd14067dd0 msgr2=0x7fcd140d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:25.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 -- 172.21.15.73:0/4063579577 shutdown_connections 2024-04-15T15:32:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 -- 172.21.15.73:0/4063579577 wait complete. 2024-04-15T15:32:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 Processor -- start 2024-04-15T15:32:25.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 -- start start 2024-04-15T15:32:25.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd14071e10 0x7fcd14139840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140b20b0 0x7fcd1415a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd14146110 0x7fcd1413a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcd140b3d70 con 0x7fcd140b20b0 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcd140b4c40 con 0x7fcd14071e10 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd18a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcd140cdcf0 con 0x7fcd14146110 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd09400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140b20b0 0x7fcd1415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd09400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140b20b0 0x7fcd1415a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39726/0 (socket says 172.21.15.73:39726) 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd09400640 1 -- 172.21.15.73:0/595767512 learned_addr learned my addr 172.21.15.73:0/595767512 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd11e00640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd14071e10 0x7fcd14139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd09400640 1 -- 172.21.15.73:0/595767512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd14146110 msgr2=0x7fcd1413a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd09400640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd14146110 0x7fcd1413a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd09400640 1 -- 172.21.15.73:0/595767512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd14071e10 msgr2=0x7fcd14139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd09400640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd14071e10 0x7fcd14139840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.129+0000 7fcd09400640 1 -- 172.21.15.73:0/595767512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1415a6b0 con 0x7fcd140b20b0 2024-04-15T15:32:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd09400640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140b20b0 0x7fcd1415a170 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00d620 tx=0x7fccfc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd0aa00640 1 -- 172.21.15.73:0/595767512 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00b620 con 0x7fcd140b20b0 2024-04-15T15:32:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd0aa00640 1 -- 172.21.15.73:0/595767512 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccfc019070 con 0x7fcd140b20b0 2024-04-15T15:32:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd0aa00640 1 -- 172.21.15.73:0/595767512 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00b9e0 con 0x7fcd140b20b0 2024-04-15T15:32:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd18a00640 1 -- 172.21.15.73:0/595767512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1413aa80 con 0x7fcd140b20b0 2024-04-15T15:32:25.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd18a00640 1 -- 172.21.15.73:0/595767512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1413b040 con 0x7fcd140b20b0 2024-04-15T15:32:25.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd18a00640 1 -- 172.21.15.73:0/595767512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd14068ab0 con 0x7fcd140b20b0 2024-04-15T15:32:25.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd0aa00640 1 -- 172.21.15.73:0/595767512 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fccfc00bb80 con 0x7fcd140b20b0 2024-04-15T15:32:25.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd0aa00640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fccf00683b0 0x7fccf006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd0aa00640 1 -- 172.21.15.73:0/595767512 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fccfc087120 con 0x7fcd140b20b0 2024-04-15T15:32:25.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.133+0000 7fcd11e00640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fccf00683b0 0x7fccf006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.137+0000 7fcd11e00640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fccf00683b0 0x7fccf006a870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd040ae000 tx=0x7fcd04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:25.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.137+0000 7fcd0aa00640 1 -- 172.21.15.73:0/595767512 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fccfc0572c0 con 0x7fcd140b20b0 2024-04-15T15:32:25.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 -- 172.21.15.73:0/595767512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcd1413a790 con 0x7fcd140b20b0 2024-04-15T15:32:25.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd0aa00640 1 -- 172.21.15.73:0/595767512 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fccfc056bc0 con 0x7fcd140b20b0 2024-04-15T15:32:25.297 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 -- 172.21.15.73:0/595767512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fccf00683b0 msgr2=0x7fccf006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fccf00683b0 0x7fccf006a870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd040ae000 tx=0x7fcd04008040 comp rx=0 tx=0).stop 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 -- 172.21.15.73:0/595767512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140b20b0 msgr2=0x7fcd1415a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140b20b0 0x7fcd1415a170 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00d620 tx=0x7fccfc00dae0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 -- 172.21.15.73:0/595767512 shutdown_connections 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fccf00683b0 0x7fccf006a870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd14146110 0x7fcd1413a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140b20b0 0x7fcd1415a170 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 --2- 172.21.15.73:0/595767512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd14071e10 0x7fcd14139840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 -- 172.21.15.73:0/595767512 >> 172.21.15.73:0/595767512 conn(0x7fcd14067dd0 msgr2=0x7fcd141435f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 -- 172.21.15.73:0/595767512 shutdown_connections 2024-04-15T15:32:25.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.297+0000 7fcd18a00640 1 -- 172.21.15.73:0/595767512 wait complete. 2024-04-15T15:32:25.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:25.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff441e00640 1 Processor -- start 2024-04-15T15:32:25.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff441e00640 1 -- start start 2024-04-15T15:32:25.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff441e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff43c15b5d0 0x7ff43c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff441e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff43c0b3e30 0x7ff43c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff441e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c070160 con 0x7ff43c0b25f0 2024-04-15T15:32:25.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff441e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff43c15b9b0 con 0x7ff43c0b3e30 2024-04-15T15:32:25.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff441e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ff43c0b2a40 con 0x7ff43c15b5d0 2024-04-15T15:32:25.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff43a000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff43c0b3e30 0x7ff43c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff43a000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff43c0b3e30 0x7ff43c0b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39734/0 (socket says 172.21.15.73:39734) 2024-04-15T15:32:25.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff43a000640 1 -- 172.21.15.73:0/1379732995 learned_addr learned my addr 172.21.15.73:0/1379732995 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:25.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff43aa00640 1 --2- 172.21.15.73:0/1379732995 >> v2:172.21.15.118:3300/0 conn(0x7ff43c15b5d0 0x7ff43c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff43a000640 1 -- 172.21.15.73:0/1379732995 >> v2:172.21.15.118:3300/0 conn(0x7ff43c15b5d0 msgr2=0x7ff43c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:25.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff43a000640 1 --2- 172.21.15.73:0/1379732995 >> v2:172.21.15.118:3300/0 conn(0x7ff43c15b5d0 0x7ff43c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff43a000640 1 -- 172.21.15.73:0/1379732995 >> v1:172.21.15.118:6789/0 conn(0x7ff43c0b25f0 legacy=0x7ff43c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:25.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.457+0000 7ff43a000640 1 -- 172.21.15.73:0/1379732995 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c15f1f0 con 0x7ff43c0b3e30 2024-04-15T15:32:25.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff43a000640 1 --2- 172.21.15.73:0/1379732995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff43c0b3e30 0x7ff43c0b20b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff428009870 tx=0x7ff42801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9b3534db19dd1e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:25.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff439600640 1 -- 172.21.15.73:0/1379732995 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4280b0070 con 0x7ff43c0b3e30 2024-04-15T15:32:25.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff439600640 1 -- 172.21.15.73:0/1379732995 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4280ab600 con 0x7ff43c0b3e30 2024-04-15T15:32:25.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff439600640 1 -- 172.21.15.73:0/1379732995 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4280ab9d0 con 0x7ff43c0b3e30 2024-04-15T15:32:25.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff441e00640 1 -- 172.21.15.73:0/1379732995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff43c0b3e30 msgr2=0x7ff43c0b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff441e00640 1 --2- 172.21.15.73:0/1379732995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff43c0b3e30 0x7ff43c0b20b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff428009870 tx=0x7ff42801c3a0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff441e00640 1 -- 172.21.15.73:0/1379732995 shutdown_connections 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff441e00640 1 --2- 172.21.15.73:0/1379732995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff43c0b3e30 0x7ff43c0b20b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff441e00640 1 --2- 172.21.15.73:0/1379732995 >> v2:172.21.15.118:3300/0 conn(0x7ff43c15b5d0 0x7ff43c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff441e00640 1 -- 172.21.15.73:0/1379732995 >> 172.21.15.73:0/1379732995 conn(0x7ff43c067dd0 msgr2=0x7ff43c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff441e00640 1 -- 172.21.15.73:0/1379732995 shutdown_connections 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.461+0000 7ff441e00640 1 -- 172.21.15.73:0/1379732995 wait complete. 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 Processor -- start 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 -- start start 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff43c0b25f0 0x7ff43c1f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff43c0b3e30 0x7ff43c15db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff43c15b5d0 0x7ff43c15e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c0cfd00 con 0x7ff43c15b5d0 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c0b42c0 con 0x7ff43c0b25f0 2024-04-15T15:32:25.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c06faa0 con 0x7ff43c0b3e30 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff43c15b5d0 0x7ff43c15e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43a000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff43c0b3e30 0x7ff43c15db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43a000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff43c0b3e30 0x7ff43c15db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:47918/0 (socket says 172.21.15.73:47918) 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff43c0b25f0 0x7ff43c1f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43a000640 1 -- 172.21.15.73:0/1685551143 learned_addr learned my addr 172.21.15.73:0/1685551143 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43b400640 1 -- 172.21.15.73:0/1685551143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff43c0b3e30 msgr2=0x7ff43c15db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43b400640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff43c0b3e30 0x7ff43c15db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43b400640 1 -- 172.21.15.73:0/1685551143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff43c0b25f0 msgr2=0x7ff43c1f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43b400640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff43c0b25f0 0x7ff43c1f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43b400640 1 -- 172.21.15.73:0/1685551143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c1590b0 con 0x7ff43c15b5d0 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43a000640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff43c0b3e30 0x7ff43c15db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff43b400640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff43c15b5d0 0x7ff43c15e090 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c390 tx=0x7ff43400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff433400640 1 -- 172.21.15.73:0/1685551143 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff434017070 con 0x7ff43c15b5d0 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff433400640 1 -- 172.21.15.73:0/1685551143 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4340052d0 con 0x7ff43c15b5d0 2024-04-15T15:32:25.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff433400640 1 -- 172.21.15.73:0/1685551143 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff434003840 con 0x7ff43c15b5d0 2024-04-15T15:32:25.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 -- 172.21.15.73:0/1685551143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c159390 con 0x7ff43c15b5d0 2024-04-15T15:32:25.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 -- 172.21.15.73:0/1685551143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c159950 con 0x7ff43c15b5d0 2024-04-15T15:32:25.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.465+0000 7ff441e00640 1 -- 172.21.15.73:0/1685551143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43c068ab0 con 0x7ff43c15b5d0 2024-04-15T15:32:25.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.469+0000 7ff433400640 1 -- 172.21.15.73:0/1685551143 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff43401a070 con 0x7ff43c15b5d0 2024-04-15T15:32:25.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.469+0000 7ff433400640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff41c068380 0x7ff41c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.469+0000 7ff433400640 1 -- 172.21.15.73:0/1685551143 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7ff434085f10 con 0x7ff43c15b5d0 2024-04-15T15:32:25.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.469+0000 7ff43aa00640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff41c068380 0x7ff41c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.469+0000 7ff43aa00640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff41c068380 0x7ff41c06a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0af200 tx=0x7ff42c009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:25.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.473+0000 7ff433400640 1 -- 172.21.15.73:0/1685551143 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff434005480 con 0x7ff43c15b5d0 2024-04-15T15:32:25.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 -- 172.21.15.73:0/1685551143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff43c0b48e0 con 0x7ff43c15b5d0 2024-04-15T15:32:25.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff433400640 1 -- 172.21.15.73:0/1685551143 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ff434055a60 con 0x7ff43c15b5d0 2024-04-15T15:32:25.633 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 -- 172.21.15.73:0/1685551143 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff41c068380 msgr2=0x7ff41c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff41c068380 0x7ff41c06a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0af200 tx=0x7ff42c009830 comp rx=0 tx=0).stop 2024-04-15T15:32:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 -- 172.21.15.73:0/1685551143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff43c15b5d0 msgr2=0x7ff43c15e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff43c15b5d0 0x7ff43c15e090 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c390 tx=0x7ff43400c850 comp rx=0 tx=0).stop 2024-04-15T15:32:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 -- 172.21.15.73:0/1685551143 shutdown_connections 2024-04-15T15:32:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff43c15b5d0 0x7ff43c15e090 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff41c068380 0x7ff41c06a840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff43c0b3e30 0x7ff43c15db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 --2- 172.21.15.73:0/1685551143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff43c0b25f0 0x7ff43c1f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 -- 172.21.15.73:0/1685551143 >> 172.21.15.73:0/1685551143 conn(0x7ff43c067dd0 msgr2=0x7ff43c0b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 -- 172.21.15.73:0/1685551143 shutdown_connections 2024-04-15T15:32:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.633+0000 7ff441e00640 1 -- 172.21.15.73:0/1685551143 wait complete. 2024-04-15T15:32:25.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:25.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.789+0000 7f1ecb600640 1 Processor -- start 2024-04-15T15:32:25.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.789+0000 7f1ecb600640 1 -- start start 2024-04-15T15:32:25.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.793+0000 7f1ecb600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ec4146110 0x7f1ec40cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.793+0000 7f1ecb600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec4072c30 con 0x7f1ec40b20b0 2024-04-15T15:32:25.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.793+0000 7f1ecb600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec40cd3a0 con 0x7f1ec40b2530 2024-04-15T15:32:25.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.793+0000 7f1ecb600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1ec40b5160 con 0x7f1ec4146110 2024-04-15T15:32:25.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.793+0000 7f1ec8c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ec4146110 0x7f1ec40cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.793+0000 7f1ec3e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1ec40b20b0 0x7f1ec4071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45576/0 (socket says 172.21.15.73:45576) 2024-04-15T15:32:25.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.793+0000 7f1ec3e00640 1 -- 172.21.15.73:0/1007274220 learned_addr learned my addr 172.21.15.73:0/1007274220 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:25.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.793+0000 7f1ec8c00640 1 -- 172.21.15.73:0/1007274220 >> v1:172.21.15.118:6789/0 conn(0x7f1ec40b2530 legacy=0x7f1ec4072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:25.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.793+0000 7f1ec8c00640 1 -- 172.21.15.73:0/1007274220 >> v1:172.21.15.73:6789/0 conn(0x7f1ec40b20b0 legacy=0x7f1ec4071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.793+0000 7f1ec8c00640 1 -- 172.21.15.73:0/1007274220 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec40b40c0 con 0x7f1ec4146110 2024-04-15T15:32:25.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ec8c00640 1 --2- 172.21.15.73:0/1007274220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 0x7f1ec40cd7b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40cd570 tx=0x7f1eb401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256c2d242c5f2217 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:25.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ec3400640 1 -- 172.21.15.73:0/1007274220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40b2070 con 0x7f1ec4146110 2024-04-15T15:32:25.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ec3400640 1 -- 172.21.15.73:0/1007274220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb40a59a0 con 0x7f1ec4146110 2024-04-15T15:32:25.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ec3400640 1 -- 172.21.15.73:0/1007274220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40a5d70 con 0x7f1ec4146110 2024-04-15T15:32:25.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ecb600640 1 -- 172.21.15.73:0/1007274220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 msgr2=0x7f1ec40cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ecb600640 1 --2- 172.21.15.73:0/1007274220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 0x7f1ec40cd7b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40cd570 tx=0x7f1eb401c8e0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ecb600640 1 -- 172.21.15.73:0/1007274220 shutdown_connections 2024-04-15T15:32:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ecb600640 1 --2- 172.21.15.73:0/1007274220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 0x7f1ec40cd7b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ecb600640 1 -- 172.21.15.73:0/1007274220 >> 172.21.15.73:0/1007274220 conn(0x7f1ec4067dd0 msgr2=0x7f1ec40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ecb600640 1 -- 172.21.15.73:0/1007274220 shutdown_connections 2024-04-15T15:32:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ecb600640 1 -- 172.21.15.73:0/1007274220 wait complete. 2024-04-15T15:32:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ecb600640 1 Processor -- start 2024-04-15T15:32:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.797+0000 7f1ecb600640 1 -- start start 2024-04-15T15:32:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ecb600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ec40b20b0 0x7f1ec40cf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ecb600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ec40b2530 0x7f1ec40cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ecb600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 0x7f1ec41f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ecb600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec40b2980 con 0x7f1ec4146110 2024-04-15T15:32:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ecb600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec40b4c40 con 0x7f1ec40b20b0 2024-04-15T15:32:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ecb600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec40b3d70 con 0x7f1ec40b2530 2024-04-15T15:32:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec9600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 0x7f1ec41f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec9600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 0x7f1ec41f7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39752/0 (socket says 172.21.15.73:39752) 2024-04-15T15:32:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec9600640 1 -- 172.21.15.73:0/1104641986 learned_addr learned my addr 172.21.15.73:0/1104641986 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec8c00640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ec40b20b0 0x7f1ec40cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec3e00640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ec40b2530 0x7f1ec40cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec9600640 1 -- 172.21.15.73:0/1104641986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ec40b2530 msgr2=0x7f1ec40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec9600640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ec40b2530 0x7f1ec40cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec9600640 1 -- 172.21.15.73:0/1104641986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ec40b20b0 msgr2=0x7f1ec40cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec9600640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ec40b20b0 0x7f1ec40cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec9600640 1 -- 172.21.15.73:0/1104641986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec41f7fd0 con 0x7f1ec4146110 2024-04-15T15:32:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec9600640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 0x7f1ec41f7250 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c410 tx=0x7f1ebc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec0c00640 1 -- 172.21.15.73:0/1104641986 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc017070 con 0x7f1ec4146110 2024-04-15T15:32:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec0c00640 1 -- 172.21.15.73:0/1104641986 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ebc003600 con 0x7f1ec4146110 2024-04-15T15:32:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec0c00640 1 -- 172.21.15.73:0/1104641986 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc003a30 con 0x7f1ec4146110 2024-04-15T15:32:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ecb600640 1 -- 172.21.15.73:0/1104641986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec4137d40 con 0x7f1ec4146110 2024-04-15T15:32:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ecb600640 1 -- 172.21.15.73:0/1104641986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec4138300 con 0x7f1ec4146110 2024-04-15T15:32:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ecb600640 1 -- 172.21.15.73:0/1104641986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec4068ab0 con 0x7f1ec4146110 2024-04-15T15:32:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.801+0000 7f1ec0c00640 1 -- 172.21.15.73:0/1104641986 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ebc003bd0 con 0x7f1ec4146110 2024-04-15T15:32:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.805+0000 7f1ec0c00640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ea40683b0 0x7f1ea406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.805+0000 7f1ec0c00640 1 -- 172.21.15.73:0/1104641986 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f1ebc085f80 con 0x7f1ec4146110 2024-04-15T15:32:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.805+0000 7f1ec8c00640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ea40683b0 0x7f1ea406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.805+0000 7f1ec8c00640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ea40683b0 0x7f1ea406a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40af000 tx=0x7f1eb40a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:25.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.809+0000 7f1ec0c00640 1 -- 172.21.15.73:0/1104641986 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ebc055a40 con 0x7f1ec4146110 2024-04-15T15:32:25.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.961+0000 7f1ecb600640 1 -- 172.21.15.73:0/1104641986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1ec4142720 con 0x7f1ec4146110 2024-04-15T15:32:25.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ec0c00640 1 -- 172.21.15.73:0/1104641986 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f1ebc059d40 con 0x7f1ec4146110 2024-04-15T15:32:25.967 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 -- 172.21.15.73:0/1104641986 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ea40683b0 msgr2=0x7f1ea406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ea40683b0 0x7f1ea406a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40af000 tx=0x7f1eb40a7070 comp rx=0 tx=0).stop 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 -- 172.21.15.73:0/1104641986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 msgr2=0x7f1ec41f7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 0x7f1ec41f7250 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c410 tx=0x7f1ebc00c8d0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 -- 172.21.15.73:0/1104641986 shutdown_connections 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec4146110 0x7f1ec41f7250 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1ea40683b0 0x7f1ea406a870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ec40b2530 0x7f1ec40cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 --2- 172.21.15.73:0/1104641986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ec40b20b0 0x7f1ec40cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 -- 172.21.15.73:0/1104641986 >> 172.21.15.73:0/1104641986 conn(0x7f1ec4067dd0 msgr2=0x7f1ec413d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 -- 172.21.15.73:0/1104641986 shutdown_connections 2024-04-15T15:32:25.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:25.965+0000 7f1ecb600640 1 -- 172.21.15.73:0/1104641986 wait complete. 2024-04-15T15:32:25.986 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:32:26.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb38e400640 1 Processor -- start 2024-04-15T15:32:26.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb38e400640 1 -- start start 2024-04-15T15:32:26.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb38e400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388146110 0x7fb3880cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb38e400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3880b2530 0x7fb388072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb38e400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3880cd3a0 con 0x7fb3880b20b0 2024-04-15T15:32:26.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb38e400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb3880b29c0 con 0x7fb3880b2530 2024-04-15T15:32:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb38e400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb3880b5160 con 0x7fb388146110 2024-04-15T15:32:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb387e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3880b2530 0x7fb388072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb386a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb3880b20b0 0x7fb388071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45584/0 (socket says 172.21.15.73:45584) 2024-04-15T15:32:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb386a00640 1 -- 172.21.15.73:0/4200638156 learned_addr learned my addr 172.21.15.73:0/4200638156 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:26.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.121+0000 7fb387400640 1 --2- 172.21.15.73:0/4200638156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388146110 0x7fb3880cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb387e00640 1 -- 172.21.15.73:0/4200638156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388146110 msgr2=0x7fb3880cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:26.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb387e00640 1 --2- 172.21.15.73:0/4200638156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388146110 0x7fb3880cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb387e00640 1 -- 172.21.15.73:0/4200638156 >> v1:172.21.15.73:6789/0 conn(0x7fb3880b20b0 legacy=0x7fb388071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb387e00640 1 -- 172.21.15.73:0/4200638156 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3880b40c0 con 0x7fb3880b2530 2024-04-15T15:32:26.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb387e00640 1 --2- 172.21.15.73:0/4200638156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 0x7fb388072520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb3800097c0 tx=0x7fb38001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ee11e4f3fbc18e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:26.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb386000640 1 -- 172.21.15.73:0/4200638156 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3800a7070 con 0x7fb3880b2530 2024-04-15T15:32:26.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb386000640 1 -- 172.21.15.73:0/4200638156 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3800b0070 con 0x7fb3880b2530 2024-04-15T15:32:26.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb386000640 1 -- 172.21.15.73:0/4200638156 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3800ab890 con 0x7fb3880b2530 2024-04-15T15:32:26.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb38e400640 1 -- 172.21.15.73:0/4200638156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 msgr2=0x7fb388072520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb38e400640 1 --2- 172.21.15.73:0/4200638156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 0x7fb388072520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb3800097c0 tx=0x7fb38001c470 comp rx=0 tx=0).stop 2024-04-15T15:32:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb38e400640 1 -- 172.21.15.73:0/4200638156 shutdown_connections 2024-04-15T15:32:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb38e400640 1 --2- 172.21.15.73:0/4200638156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 0x7fb388072520 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb38e400640 1 --2- 172.21.15.73:0/4200638156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388146110 0x7fb3880cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb38e400640 1 -- 172.21.15.73:0/4200638156 >> 172.21.15.73:0/4200638156 conn(0x7fb388067dd0 msgr2=0x7fb3880d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb38e400640 1 -- 172.21.15.73:0/4200638156 shutdown_connections 2024-04-15T15:32:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.125+0000 7fb38e400640 1 -- 172.21.15.73:0/4200638156 wait complete. 2024-04-15T15:32:26.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb38e400640 1 Processor -- start 2024-04-15T15:32:26.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb38e400640 1 -- start start 2024-04-15T15:32:26.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb38e400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3880b20b0 0x7fb3881415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb38e400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 0x7fb3881398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb38e400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388146110 0x7fb38815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb38e400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb3880b3d70 con 0x7fb3880b2530 2024-04-15T15:32:26.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb38e400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb3880b4c40 con 0x7fb3880b20b0 2024-04-15T15:32:26.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb38e400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb3880cdcf0 con 0x7fb388146110 2024-04-15T15:32:26.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb386a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 0x7fb3881398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb386a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 0x7fb3881398c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39780/0 (socket says 172.21.15.73:39780) 2024-04-15T15:32:26.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb386a00640 1 -- 172.21.15.73:0/2611324935 learned_addr learned my addr 172.21.15.73:0/2611324935 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:26.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb387e00640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388146110 0x7fb38815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb387400640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3880b20b0 0x7fb3881415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb386a00640 1 -- 172.21.15.73:0/2611324935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388146110 msgr2=0x7fb38815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb386a00640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388146110 0x7fb38815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb386a00640 1 -- 172.21.15.73:0/2611324935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3880b20b0 msgr2=0x7fb3881415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb386a00640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3880b20b0 0x7fb3881415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb386a00640 1 -- 172.21.15.73:0/2611324935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb388141b20 con 0x7fb3880b2530 2024-04-15T15:32:26.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb386a00640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 0x7fb3881398c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb37400c420 tx=0x7fb37400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:26.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb37f400640 1 -- 172.21.15.73:0/2611324935 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374017070 con 0x7fb3880b2530 2024-04-15T15:32:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb37f400640 1 -- 172.21.15.73:0/2611324935 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb374005cf0 con 0x7fb3880b2530 2024-04-15T15:32:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb38e400640 1 -- 172.21.15.73:0/2611324935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb388139e00 con 0x7fb3880b2530 2024-04-15T15:32:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb37f400640 1 -- 172.21.15.73:0/2611324935 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3740072f0 con 0x7fb3880b2530 2024-04-15T15:32:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.129+0000 7fb38e400640 1 -- 172.21.15.73:0/2611324935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb38813a380 con 0x7fb3880b2530 2024-04-15T15:32:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.133+0000 7fb38e400640 1 -- 172.21.15.73:0/2611324935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb388068ab0 con 0x7fb3880b2530 2024-04-15T15:32:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.133+0000 7fb37f400640 1 -- 172.21.15.73:0/2611324935 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb37401a070 con 0x7fb3880b2530 2024-04-15T15:32:26.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.133+0000 7fb37f400640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb368068380 0x7fb36806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.133+0000 7fb37f400640 1 -- 172.21.15.73:0/2611324935 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fb374086180 con 0x7fb3880b2530 2024-04-15T15:32:26.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.133+0000 7fb387400640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb368068380 0x7fb36806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.133+0000 7fb387400640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb368068380 0x7fb36806a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb38813f960 tx=0x7fb378009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:26.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.137+0000 7fb37f400640 1 -- 172.21.15.73:0/2611324935 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb374055c40 con 0x7fb3880b2530 2024-04-15T15:32:26.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.305+0000 7fb38e400640 1 -- 172.21.15.73:0/2611324935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb3880b3050 con 0x7fb3880b2530 2024-04-15T15:32:26.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.305+0000 7fb37f400640 1 -- 172.21.15.73:0/2611324935 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fb374059f40 con 0x7fb3880b2530 2024-04-15T15:32:26.308 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-15T15:32:26.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 -- 172.21.15.73:0/2611324935 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb368068380 msgr2=0x7fb36806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb368068380 0x7fb36806a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb38813f960 tx=0x7fb378009830 comp rx=0 tx=0).stop 2024-04-15T15:32:26.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 -- 172.21.15.73:0/2611324935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 msgr2=0x7fb3881398c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 0x7fb3881398c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb37400c420 tx=0x7fb37400c8e0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 -- 172.21.15.73:0/2611324935 shutdown_connections 2024-04-15T15:32:26.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb368068380 0x7fb36806a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb388146110 0x7fb38815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3880b2530 0x7fb3881398c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 --2- 172.21.15.73:0/2611324935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3880b20b0 0x7fb3881415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 -- 172.21.15.73:0/2611324935 >> 172.21.15.73:0/2611324935 conn(0x7fb388067dd0 msgr2=0x7fb38813bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:26.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 -- 172.21.15.73:0/2611324935 shutdown_connections 2024-04-15T15:32:26.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.309+0000 7fb38e400640 1 -- 172.21.15.73:0/2611324935 wait complete. 2024-04-15T15:32:26.330 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-15T15:32:26.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:26.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-15T15:32:26.374 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:32:26.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:26.375 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-15T15:32:26.428 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:32:26.429 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:26.438 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:32:26.439 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:26.488 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:32:26.488 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:26.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:26.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.681+0000 7f5f14c00640 1 Processor -- start 2024-04-15T15:32:26.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.681+0000 7f5f14c00640 1 -- start start 2024-04-15T15:32:26.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.681+0000 7f5f14c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f1015be70 0x7f5f10071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.681+0000 7f5f14c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5f10072350 0x7f5f100b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.681+0000 7f5f14c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1006f5a0 con 0x7f5f1006fc90 2024-04-15T15:32:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.681+0000 7f5f14c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f5f100727c0 con 0x7f5f10072350 2024-04-15T15:32:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.681+0000 7f5f14c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1015c2f0 con 0x7f5f1015be70 2024-04-15T15:32:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.681+0000 7f5f0e800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5f10072350 0x7f5f100b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.681+0000 7f5f0e800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5f10072350 0x7f5f100b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39796/0 (socket says 172.21.15.73:39796) 2024-04-15T15:32:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.681+0000 7f5f0e800640 1 -- 172.21.15.73:0/1980677166 learned_addr learned my addr 172.21.15.73:0/1980677166 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f05400640 1 --2- 172.21.15.73:0/1980677166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f1015be70 0x7f5f10071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f0e800640 1 -- 172.21.15.73:0/1980677166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f1015be70 msgr2=0x7f5f10071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f0e800640 1 --2- 172.21.15.73:0/1980677166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f1015be70 0x7f5f10071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f0e800640 1 -- 172.21.15.73:0/1980677166 >> v1:172.21.15.118:6789/0 conn(0x7f5f1006fc90 legacy=0x7f5f1015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:26.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f0e800640 1 -- 172.21.15.73:0/1980677166 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1015f480 con 0x7f5f10072350 2024-04-15T15:32:26.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f0e800640 1 --2- 172.21.15.73:0/1980677166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f10072350 0x7f5f100b3e10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800aa10 tx=0x7f5f0801d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fbaa16a0cb6887 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:26.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f0d400640 1 -- 172.21.15.73:0/1980677166 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800b040 con 0x7f5f10072350 2024-04-15T15:32:26.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f0d400640 1 -- 172.21.15.73:0/1980677166 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f080a9660 con 0x7f5f10072350 2024-04-15T15:32:26.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f0d400640 1 -- 172.21.15.73:0/1980677166 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f080a9a30 con 0x7f5f10072350 2024-04-15T15:32:26.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f14c00640 1 -- 172.21.15.73:0/1980677166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f10072350 msgr2=0x7f5f100b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f14c00640 1 --2- 172.21.15.73:0/1980677166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f10072350 0x7f5f100b3e10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800aa10 tx=0x7f5f0801d710 comp rx=0 tx=0).stop 2024-04-15T15:32:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f14c00640 1 -- 172.21.15.73:0/1980677166 shutdown_connections 2024-04-15T15:32:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f14c00640 1 --2- 172.21.15.73:0/1980677166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f10072350 0x7f5f100b3e10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f14c00640 1 --2- 172.21.15.73:0/1980677166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f1015be70 0x7f5f10071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.685+0000 7f5f14c00640 1 -- 172.21.15.73:0/1980677166 >> 172.21.15.73:0/1980677166 conn(0x7f5f10067dd0 msgr2=0x7f5f100d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f14c00640 1 -- 172.21.15.73:0/1980677166 shutdown_connections 2024-04-15T15:32:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f14c00640 1 -- 172.21.15.73:0/1980677166 wait complete. 2024-04-15T15:32:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f14c00640 1 Processor -- start 2024-04-15T15:32:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f14c00640 1 -- start start 2024-04-15T15:32:26.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f14c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1006fc90 0x7f5f10140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f14c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f10072350 0x7f5f100b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f14c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f1015be70 0x7f5f101559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f14c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1015f020 con 0x7f5f1006fc90 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f14c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5f10070070 con 0x7f5f1015be70 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f14c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1015f1a0 con 0x7f5f10072350 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f0de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1006fc90 0x7f5f10140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f0de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1006fc90 0x7f5f10140b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39798/0 (socket says 172.21.15.73:39798) 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f0de00640 1 -- 172.21.15.73:0/3583215347 learned_addr learned my addr 172.21.15.73:0/3583215347 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f0e800640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f1015be70 0x7f5f101559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f05400640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f10072350 0x7f5f100b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f0de00640 1 -- 172.21.15.73:0/3583215347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f10072350 msgr2=0x7f5f100b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f0de00640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f10072350 0x7f5f100b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f0de00640 1 -- 172.21.15.73:0/3583215347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f1015be70 msgr2=0x7f5f101559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f0de00640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f1015be70 0x7f5f101559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f0de00640 1 -- 172.21.15.73:0/3583215347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f10141060 con 0x7f5f1006fc90 2024-04-15T15:32:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.689+0000 7f5f0de00640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1006fc90 0x7f5f10140b20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000ba50 tx=0x7f5f0000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f06a00640 1 -- 172.21.15.73:0/3583215347 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00019070 con 0x7f5f1006fc90 2024-04-15T15:32:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f06a00640 1 -- 172.21.15.73:0/3583215347 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0000cc20 con 0x7f5f1006fc90 2024-04-15T15:32:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f06a00640 1 -- 172.21.15.73:0/3583215347 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00014440 con 0x7f5f1006fc90 2024-04-15T15:32:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f14c00640 1 -- 172.21.15.73:0/3583215347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f100b4a50 con 0x7f5f1006fc90 2024-04-15T15:32:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f14c00640 1 -- 172.21.15.73:0/3583215347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f101419b0 con 0x7f5f1006fc90 2024-04-15T15:32:26.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f14c00640 1 -- 172.21.15.73:0/3583215347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f10068ab0 con 0x7f5f1006fc90 2024-04-15T15:32:26.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f06a00640 1 -- 172.21.15.73:0/3583215347 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5f0001c070 con 0x7f5f1006fc90 2024-04-15T15:32:26.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f06a00640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5eec068380 0x7f5eec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:26.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f06a00640 1 -- 172.21.15.73:0/3583215347 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f5f00086a60 con 0x7f5f1006fc90 2024-04-15T15:32:26.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f05400640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5eec068380 0x7f5eec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:26.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.693+0000 7f5f05400640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5eec068380 0x7f5eec06a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5f100c69b0 tx=0x7f5ef8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:26.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.697+0000 7f5f06a00640 1 -- 172.21.15.73:0/3583215347 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5f000565b0 con 0x7f5f1006fc90 2024-04-15T15:32:26.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.861+0000 7f5f14c00640 1 -- 172.21.15.73:0/3583215347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f10142340 con 0x7f5f1006fc90 2024-04-15T15:32:26.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.861+0000 7f5f06a00640 1 -- 172.21.15.73:0/3583215347 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7f5f0005a8b0 con 0x7f5f1006fc90 2024-04-15T15:32:26.863 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:26.863 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 -- 172.21.15.73:0/3583215347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5eec068380 msgr2=0x7f5eec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5eec068380 0x7f5eec06a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5f100c69b0 tx=0x7f5ef8008040 comp rx=0 tx=0).stop 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 -- 172.21.15.73:0/3583215347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1006fc90 msgr2=0x7f5f10140b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1006fc90 0x7f5f10140b20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000ba50 tx=0x7f5f0000bf10 comp rx=0 tx=0).stop 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 -- 172.21.15.73:0/3583215347 shutdown_connections 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f1015be70 0x7f5f101559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5eec068380 0x7f5eec06a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f10072350 0x7f5f100b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 --2- 172.21.15.73:0/3583215347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f1006fc90 0x7f5f10140b20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 -- 172.21.15.73:0/3583215347 >> 172.21.15.73:0/3583215347 conn(0x7f5f10067dd0 msgr2=0x7f5f10154ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 -- 172.21.15.73:0/3583215347 shutdown_connections 2024-04-15T15:32:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:26.865+0000 7f5f14c00640 1 -- 172.21.15.73:0/3583215347 wait complete. 2024-04-15T15:32:26.885 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:26.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:27.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f7277000640 1 Processor -- start 2024-04-15T15:32:27.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f7277000640 1 -- start start 2024-04-15T15:32:27.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f7277000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f727015eff0 0x7f72700ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f7277000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727009b0a0 0x7f72700d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f7277000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72700d0850 con 0x7f727009acc0 2024-04-15T15:32:27.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f7277000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f72700d0e60 con 0x7f727015eff0 2024-04-15T15:32:27.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f7277000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f727009b7a0 con 0x7f727009b0a0 2024-04-15T15:32:27.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f726f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f727015eff0 0x7f72700ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f726f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f727015eff0 0x7f72700ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39810/0 (socket says 172.21.15.73:39810) 2024-04-15T15:32:27.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f726f400640 1 -- 172.21.15.73:0/338763665 learned_addr learned my addr 172.21.15.73:0/338763665 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:27.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f7275000640 1 --2- 172.21.15.73:0/338763665 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727009b0a0 0x7f72700d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f726f400640 1 -- 172.21.15.73:0/338763665 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727009b0a0 msgr2=0x7f72700d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:27.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f726f400640 1 --2- 172.21.15.73:0/338763665 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727009b0a0 0x7f72700d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f726f400640 1 -- 172.21.15.73:0/338763665 >> v1:172.21.15.73:6789/0 conn(0x7f727009acc0 legacy=0x7f727015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.025+0000 7f726f400640 1 -- 172.21.15.73:0/338763665 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727009ba60 con 0x7f727015eff0 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f726f400640 1 --2- 172.21.15.73:0/338763665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727015eff0 0x7f72700ccbd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f725c009870 tx=0x7f725c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652ca1e615c12e82 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f726ea00640 1 -- 172.21.15.73:0/338763665 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0a7070 con 0x7f727015eff0 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f726ea00640 1 -- 172.21.15.73:0/338763665 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c0b0070 con 0x7f727015eff0 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f726ea00640 1 -- 172.21.15.73:0/338763665 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0ab890 con 0x7f727015eff0 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f7277000640 1 -- 172.21.15.73:0/338763665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727015eff0 msgr2=0x7f72700ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f7277000640 1 --2- 172.21.15.73:0/338763665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727015eff0 0x7f72700ccbd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f725c009870 tx=0x7f725c01c560 comp rx=0 tx=0).stop 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f7277000640 1 -- 172.21.15.73:0/338763665 shutdown_connections 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f7277000640 1 --2- 172.21.15.73:0/338763665 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727009b0a0 0x7f72700d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f7277000640 1 --2- 172.21.15.73:0/338763665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727015eff0 0x7f72700ccbd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f7277000640 1 -- 172.21.15.73:0/338763665 >> 172.21.15.73:0/338763665 conn(0x7f72700b4070 msgr2=0x7f72700b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:27.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f7277000640 1 -- 172.21.15.73:0/338763665 shutdown_connections 2024-04-15T15:32:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.029+0000 7f7277000640 1 -- 172.21.15.73:0/338763665 wait complete. 2024-04-15T15:32:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 Processor -- start 2024-04-15T15:32:27.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 -- start start 2024-04-15T15:32:27.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727009acc0 0x7f7270154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727009b0a0 0x7f727015f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727015eff0 0x7f727015fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f727016c050 con 0x7f727009b0a0 2024-04-15T15:32:27.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f727016bed0 con 0x7f727009acc0 2024-04-15T15:32:27.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f727016c1d0 con 0x7f727015eff0 2024-04-15T15:32:27.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727009b0a0 0x7f727015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727009b0a0 0x7f727015f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39824/0 (socket says 172.21.15.73:39824) 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726f400640 1 -- 172.21.15.73:0/698082628 learned_addr learned my addr 172.21.15.73:0/698082628 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7275000640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727015eff0 0x7f727015fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726fe00640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727009acc0 0x7f7270154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726f400640 1 -- 172.21.15.73:0/698082628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727015eff0 msgr2=0x7f727015fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726f400640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727015eff0 0x7f727015fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726f400640 1 -- 172.21.15.73:0/698082628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727009acc0 msgr2=0x7f7270154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726f400640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727009acc0 0x7f7270154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726f400640 1 -- 172.21.15.73:0/698082628 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72701548d0 con 0x7f727009b0a0 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726fe00640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727009acc0 0x7f7270154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:27.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7275000640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727015eff0 0x7f727015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:27.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f726f400640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727009b0a0 0x7f727015f630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f725c0ad040 tx=0x7f725c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:27.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7267e00640 1 -- 172.21.15.73:0/698082628 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0bf610 con 0x7f727009b0a0 2024-04-15T15:32:27.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7267e00640 1 -- 172.21.15.73:0/698082628 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c0bf7d0 con 0x7f727009b0a0 2024-04-15T15:32:27.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 -- 172.21.15.73:0/698082628 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72701f8480 con 0x7f727009b0a0 2024-04-15T15:32:27.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7267e00640 1 -- 172.21.15.73:0/698082628 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0bfbc0 con 0x7f727009b0a0 2024-04-15T15:32:27.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 -- 172.21.15.73:0/698082628 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72701f8a40 con 0x7f727009b0a0 2024-04-15T15:32:27.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.033+0000 7f7277000640 1 -- 172.21.15.73:0/698082628 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7270068ab0 con 0x7f727009b0a0 2024-04-15T15:32:27.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.037+0000 7f7267e00640 1 -- 172.21.15.73:0/698082628 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f725c0bd020 con 0x7f727009b0a0 2024-04-15T15:32:27.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.037+0000 7f7267e00640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7250068380 0x7f725006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.037+0000 7f7267e00640 1 -- 172.21.15.73:0/698082628 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f725c120dc0 con 0x7f727009b0a0 2024-04-15T15:32:27.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.037+0000 7f726fe00640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7250068380 0x7f725006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.037+0000 7f726fe00640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7250068380 0x7f725006a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7270071a00 tx=0x7f7260009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:27.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.041+0000 7f7267e00640 1 -- 172.21.15.73:0/698082628 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f725c0c6070 con 0x7f727009b0a0 2024-04-15T15:32:27.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 -- 172.21.15.73:0/698082628 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7270162490 con 0x7f727009b0a0 2024-04-15T15:32:27.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7267e00640 1 -- 172.21.15.73:0/698082628 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f725c016150 con 0x7f727009b0a0 2024-04-15T15:32:27.201 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 -- 172.21.15.73:0/698082628 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7250068380 msgr2=0x7f725006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7250068380 0x7f725006a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7270071a00 tx=0x7f7260009040 comp rx=0 tx=0).stop 2024-04-15T15:32:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 -- 172.21.15.73:0/698082628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727009b0a0 msgr2=0x7f727015f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727009b0a0 0x7f727015f630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f725c0ad040 tx=0x7f725c019300 comp rx=0 tx=0).stop 2024-04-15T15:32:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 -- 172.21.15.73:0/698082628 shutdown_connections 2024-04-15T15:32:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7250068380 0x7f725006a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f727015eff0 0x7f727015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f727009b0a0 0x7f727015f630 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 --2- 172.21.15.73:0/698082628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727009acc0 0x7f7270154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 -- 172.21.15.73:0/698082628 >> 172.21.15.73:0/698082628 conn(0x7f72700b4070 msgr2=0x7f7270157ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:27.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 -- 172.21.15.73:0/698082628 shutdown_connections 2024-04-15T15:32:27.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.201+0000 7f7277000640 1 -- 172.21.15.73:0/698082628 wait complete. 2024-04-15T15:32:27.224 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:27.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc107400640 1 Processor -- start 2024-04-15T15:32:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc107400640 1 -- start start 2024-04-15T15:32:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc107400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc10006ba50 0x7fc10006be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc107400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10006c3a0 con 0x7fc10006c5f0 2024-04-15T15:32:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc107400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1000b5e10 con 0x7fc10015ebe0 2024-04-15T15:32:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc107400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc1000b49f0 con 0x7fc10006ba50 2024-04-15T15:32:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc0ffe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc10006c5f0 0x7fc1000d1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57790/0 (socket says 172.21.15.73:57790) 2024-04-15T15:32:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc0ffe00640 1 -- 172.21.15.73:0/990989409 learned_addr learned my addr 172.21.15.73:0/990989409 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc105400640 1 --2- 172.21.15.73:0/990989409 >> v2:172.21.15.118:3300/0 conn(0x7fc10006ba50 0x7fc10006be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc0ff400640 1 -- 172.21.15.73:0/990989409 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097749374 0 0) 0x7fc0ec001120 con 0x7fc10006c5f0 2024-04-15T15:32:27.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc0ff400640 1 -- 172.21.15.73:0/990989409 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0e4003530 con 0x7fc10006c5f0 2024-04-15T15:32:27.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc0ff400640 1 -- 172.21.15.73:0/990989409 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595940431 0 0) 0x7fc1000b5e10 con 0x7fc10015ebe0 2024-04-15T15:32:27.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc0ff400640 1 -- 172.21.15.73:0/990989409 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0ec001120 con 0x7fc10015ebe0 2024-04-15T15:32:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc105400640 1 -- 172.21.15.73:0/990989409 >> v1:172.21.15.118:6789/0 conn(0x7fc10015ebe0 legacy=0x7fc1000709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc105400640 1 -- 172.21.15.73:0/990989409 >> v1:172.21.15.73:6789/0 conn(0x7fc10006c5f0 legacy=0x7fc1000d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.361+0000 7fc105400640 1 -- 172.21.15.73:0/990989409 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1000b4430 con 0x7fc10006ba50 2024-04-15T15:32:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc105400640 1 --2- 172.21.15.73:0/990989409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc10006ba50 0x7fc10006be60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80097c0 tx=0x7fc0f801c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfe5ae9140bc60b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc0ff400640 1 -- 172.21.15.73:0/990989409 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80b0070 con 0x7fc10006ba50 2024-04-15T15:32:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc0ff400640 1 -- 172.21.15.73:0/990989409 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f80ab600 con 0x7fc10006ba50 2024-04-15T15:32:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc0ff400640 1 -- 172.21.15.73:0/990989409 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80ab9d0 con 0x7fc10006ba50 2024-04-15T15:32:27.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc107400640 1 -- 172.21.15.73:0/990989409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc10006ba50 msgr2=0x7fc10006be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc107400640 1 --2- 172.21.15.73:0/990989409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc10006ba50 0x7fc10006be60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80097c0 tx=0x7fc0f801c350 comp rx=0 tx=0).stop 2024-04-15T15:32:27.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc107400640 1 -- 172.21.15.73:0/990989409 shutdown_connections 2024-04-15T15:32:27.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc107400640 1 --2- 172.21.15.73:0/990989409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc10006ba50 0x7fc10006be60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc107400640 1 -- 172.21.15.73:0/990989409 >> 172.21.15.73:0/990989409 conn(0x7fc1000b6820 msgr2=0x7fc1000b6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:27.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc107400640 1 -- 172.21.15.73:0/990989409 shutdown_connections 2024-04-15T15:32:27.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.365+0000 7fc107400640 1 -- 172.21.15.73:0/990989409 wait complete. 2024-04-15T15:32:27.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc107400640 1 Processor -- start 2024-04-15T15:32:27.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc107400640 1 -- start start 2024-04-15T15:32:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc107400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc10006ba50 0x7fc100151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc107400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc10006c5f0 0x7fc1001592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc107400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10015ebe0 0x7fc100157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc107400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc10006f870 con 0x7fc10015ebe0 2024-04-15T15:32:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc107400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc10006f6f0 con 0x7fc10006ba50 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc107400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc10016c770 con 0x7fc10006c5f0 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc105400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10015ebe0 0x7fc100157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc105400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10015ebe0 0x7fc100157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58324/0 (socket says 172.21.15.73:58324) 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc105400640 1 -- 172.21.15.73:0/885825410 learned_addr learned my addr 172.21.15.73:0/885825410 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc0ffe00640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc10006c5f0 0x7fc1001592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc104a00640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc10006ba50 0x7fc100151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc105400640 1 -- 172.21.15.73:0/885825410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc10006c5f0 msgr2=0x7fc1001592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc105400640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc10006c5f0 0x7fc1001592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc105400640 1 -- 172.21.15.73:0/885825410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc10006ba50 msgr2=0x7fc100151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc105400640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc10006ba50 0x7fc100151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc105400640 1 -- 172.21.15.73:0/885825410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1000af640 con 0x7fc10015ebe0 2024-04-15T15:32:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc105400640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10015ebe0 0x7fc100157650 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ae040 tx=0x7fc0f801ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:27.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc0fcc00640 1 -- 172.21.15.73:0/885825410 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80b0050 con 0x7fc10015ebe0 2024-04-15T15:32:27.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc0fcc00640 1 -- 172.21.15.73:0/885825410 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f80bc070 con 0x7fc10015ebe0 2024-04-15T15:32:27.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc0fcc00640 1 -- 172.21.15.73:0/885825410 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80b5810 con 0x7fc10015ebe0 2024-04-15T15:32:27.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc107400640 1 -- 172.21.15.73:0/885825410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc100152610 con 0x7fc10015ebe0 2024-04-15T15:32:27.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.369+0000 7fc107400640 1 -- 172.21.15.73:0/885825410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc100152bd0 con 0x7fc10015ebe0 2024-04-15T15:32:27.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.373+0000 7fc107400640 1 -- 172.21.15.73:0/885825410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc100068ab0 con 0x7fc10015ebe0 2024-04-15T15:32:27.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.373+0000 7fc0fcc00640 1 -- 172.21.15.73:0/885825410 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0f80b59b0 con 0x7fc10015ebe0 2024-04-15T15:32:27.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.373+0000 7fc0fcc00640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e0068380 0x7fc0e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.373+0000 7fc0fcc00640 1 -- 172.21.15.73:0/885825410 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fc0f8121430 con 0x7fc10015ebe0 2024-04-15T15:32:27.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.373+0000 7fc104a00640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e0068380 0x7fc0e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.373+0000 7fc104a00640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e0068380 0x7fc0e006a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0007fd0 tx=0x7fc0f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:27.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.377+0000 7fc0fcc00640 1 -- 172.21.15.73:0/885825410 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0f8016090 con 0x7fc10015ebe0 2024-04-15T15:32:27.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.533+0000 7fc107400640 1 -- 172.21.15.73:0/885825410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc1000b0e10 con 0x7fc10015ebe0 2024-04-15T15:32:27.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.533+0000 7fc0fcc00640 1 -- 172.21.15.73:0/885825410 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fc0f80f0ef0 con 0x7fc10015ebe0 2024-04-15T15:32:27.536 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:27.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 -- 172.21.15.73:0/885825410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e0068380 msgr2=0x7fc0e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e0068380 0x7fc0e006a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0007fd0 tx=0x7fc0f0009040 comp rx=0 tx=0).stop 2024-04-15T15:32:27.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 -- 172.21.15.73:0/885825410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10015ebe0 msgr2=0x7fc100157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10015ebe0 0x7fc100157650 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ae040 tx=0x7fc0f801ab90 comp rx=0 tx=0).stop 2024-04-15T15:32:27.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 -- 172.21.15.73:0/885825410 shutdown_connections 2024-04-15T15:32:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10015ebe0 0x7fc100157650 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e0068380 0x7fc0e006a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc10006c5f0 0x7fc1001592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 --2- 172.21.15.73:0/885825410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc10006ba50 0x7fc100151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 -- 172.21.15.73:0/885825410 >> 172.21.15.73:0/885825410 conn(0x7fc1000b6820 msgr2=0x7fc1000b6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 -- 172.21.15.73:0/885825410 shutdown_connections 2024-04-15T15:32:27.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.537+0000 7fc107400640 1 -- 172.21.15.73:0/885825410 wait complete. 2024-04-15T15:32:27.557 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:27.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e4400640 1 Processor -- start 2024-04-15T15:32:27.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e4400640 1 -- start start 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e4400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83dc15b5d0 0x7f83dc15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e4400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83dc070160 con 0x7f83dc0b3e30 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e4400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83dc15f1f0 con 0x7f83dc0b27c0 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e4400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f83dc15b9b0 con 0x7f83dc15b5d0 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e1000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f83dc0b3e30 0x7f83dc0b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57804/0 (socket says 172.21.15.73:57804) 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e1000640 1 -- 172.21.15.73:0/21280713 learned_addr learned my addr 172.21.15.73:0/21280713 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e1a00640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83dc15b5d0 0x7f83dc15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304785595 0 0) 0x7f83dc070160 con 0x7f83dc0b3e30 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c4005740 con 0x7f83dc0b3e30 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3172069517 0 0) 0x7f83c4005740 con 0x7f83dc0b3e30 2024-04-15T15:32:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83dc15b5d0 msgr2=0x7f83dc15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83dc15b5d0 0x7f83dc15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 >> v1:172.21.15.118:6789/0 conn(0x7f83dc0b27c0 legacy=0x7f83dc0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc06fe80 con 0x7f83dc0b3e30 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f83c8001680 con 0x7f83dc0b3e30 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 >> v1:172.21.15.73:6789/0 conn(0x7f83dc0b3e30 legacy=0x7f83dc0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83dc15b5d0 0x7f83c4005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83c4006140 0x7f83c4006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83c4006f60 0x7f83c40073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f83c400dda0 con 0x7f83c4006140 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f83c400df50 con 0x7f83c4006f60 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f83c400e150 con 0x7f83dc15b5d0 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e1000640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83c4006140 0x7f83c4006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e1a00640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83dc15b5d0 0x7f83c4005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e2400640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83c4006f60 0x7f83c40073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e1000640 1 -- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83dc15b5d0 msgr2=0x7f83c4005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e1000640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83dc15b5d0 0x7f83c4005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e1000640 1 -- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83c4006f60 msgr2=0x7f83c40073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e1000640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83c4006f60 0x7f83c40073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.697+0000 7f83e1000640 1 -- 172.21.15.73:0/21280713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c4005740 con 0x7f83c4006140 2024-04-15T15:32:27.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83e1000640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83c4006140 0x7f83c4006a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83c800c190 tx=0x7f83c801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2268587357d091 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:27.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8007c70 con 0x7f83c4006140 2024-04-15T15:32:27.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c80a9070 con 0x7f83c4006140 2024-04-15T15:32:27.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83dbe00640 1 -- 172.21.15.73:0/21280713 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8005d60 con 0x7f83c4006140 2024-04-15T15:32:27.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83e4400640 1 -- 172.21.15.73:0/21280713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83c4006140 msgr2=0x7f83c4006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83e4400640 1 --2- 172.21.15.73:0/21280713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83c4006140 0x7f83c4006a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83c800c190 tx=0x7f83c801cb90 comp rx=0 tx=0).stop 2024-04-15T15:32:27.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83e2400640 1 -- 172.21.15.73:0/21280713 reap_dead start 2024-04-15T15:32:27.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83e4400640 1 -- 172.21.15.73:0/21280713 shutdown_connections 2024-04-15T15:32:27.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83e4400640 1 -- 172.21.15.73:0/21280713 >> 172.21.15.73:0/21280713 conn(0x7f83dc067dd0 msgr2=0x7f83dc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:27.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83e4400640 1 -- 172.21.15.73:0/21280713 shutdown_connections 2024-04-15T15:32:27.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.701+0000 7f83e4400640 1 -- 172.21.15.73:0/21280713 wait complete. 2024-04-15T15:32:27.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e4400640 1 Processor -- start 2024-04-15T15:32:27.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e4400640 1 -- start start 2024-04-15T15:32:27.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e4400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4006140 0x7f83dc0af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e4400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc1fb1a0 0x7f83dc1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e4400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83dc1587f0 0x7f83dc0ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e4400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc06faa0 con 0x7f83dc1587f0 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e4400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc0b4250 con 0x7f83dc1fb1a0 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e4400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f83dc06fc20 con 0x7f83c4006140 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e2400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83dc1587f0 0x7f83dc0ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e2400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83dc1587f0 0x7f83dc0ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58342/0 (socket says 172.21.15.73:58342) 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e2400640 1 -- 172.21.15.73:0/531072096 learned_addr learned my addr 172.21.15.73:0/531072096 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e1a00640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4006140 0x7f83dc0af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e1000640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc1fb1a0 0x7f83dc1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e2400640 1 -- 172.21.15.73:0/531072096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4006140 msgr2=0x7f83dc0af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e2400640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4006140 0x7f83dc0af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e2400640 1 -- 172.21.15.73:0/531072096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc1fb1a0 msgr2=0x7f83dc1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e2400640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc1fb1a0 0x7f83dc1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e2400640 1 -- 172.21.15.73:0/531072096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc1574f0 con 0x7f83dc1587f0 2024-04-15T15:32:27.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e1a00640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4006140 0x7f83dc0af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:27.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e2400640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83dc1587f0 0x7f83dc0ad8d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f83d400e700 tx=0x7f83d400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:27.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83d9600640 1 -- 172.21.15.73:0/531072096 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4003980 con 0x7f83dc1587f0 2024-04-15T15:32:27.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83d9600640 1 -- 172.21.15.73:0/531072096 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d4018070 con 0x7f83dc1587f0 2024-04-15T15:32:27.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83d9600640 1 -- 172.21.15.73:0/531072096 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4003d60 con 0x7f83dc1587f0 2024-04-15T15:32:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e4400640 1 -- 172.21.15.73:0/531072096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83dc1577d0 con 0x7f83dc1587f0 2024-04-15T15:32:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.705+0000 7f83e4400640 1 -- 172.21.15.73:0/531072096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83dc157d90 con 0x7f83dc1587f0 2024-04-15T15:32:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.709+0000 7f83e4400640 1 -- 172.21.15.73:0/531072096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83dc068ab0 con 0x7f83dc1587f0 2024-04-15T15:32:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.709+0000 7f83d9600640 1 -- 172.21.15.73:0/531072096 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f83d40050d0 con 0x7f83dc1587f0 2024-04-15T15:32:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.709+0000 7f83d9600640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f83bc0683b0 0x7f83bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:27.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.709+0000 7f83d9600640 1 -- 172.21.15.73:0/531072096 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f83d4086bd0 con 0x7f83dc1587f0 2024-04-15T15:32:27.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.709+0000 7f83e1a00640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f83bc0683b0 0x7f83bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:27.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.709+0000 7f83e1a00640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f83bc0683b0 0x7f83bc06a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83dc156bf0 tx=0x7f83d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:27.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.713+0000 7f83d9600640 1 -- 172.21.15.73:0/531072096 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f83d4056ce0 con 0x7f83dc1587f0 2024-04-15T15:32:27.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.869+0000 7f83e4400640 1 -- 172.21.15.73:0/531072096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f83dc06f370 con 0x7f83dc1587f0 2024-04-15T15:32:27.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.869+0000 7f83d9600640 1 -- 172.21.15.73:0/531072096 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f83d401be40 con 0x7f83dc1587f0 2024-04-15T15:32:27.871 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:27.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 -- 172.21.15.73:0/531072096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f83bc0683b0 msgr2=0x7f83bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f83bc0683b0 0x7f83bc06a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83dc156bf0 tx=0x7f83d0008040 comp rx=0 tx=0).stop 2024-04-15T15:32:27.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 -- 172.21.15.73:0/531072096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83dc1587f0 msgr2=0x7f83dc0ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:27.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83dc1587f0 0x7f83dc0ad8d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f83d400e700 tx=0x7f83d400ebc0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 -- 172.21.15.73:0/531072096 shutdown_connections 2024-04-15T15:32:27.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83dc1587f0 0x7f83dc0ad8d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc1fb1a0 0x7f83dc1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f83bc0683b0 0x7f83bc06a870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 --2- 172.21.15.73:0/531072096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4006140 0x7f83dc0af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:27.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 -- 172.21.15.73:0/531072096 >> 172.21.15.73:0/531072096 conn(0x7f83dc067dd0 msgr2=0x7f83dc154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:27.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 -- 172.21.15.73:0/531072096 shutdown_connections 2024-04-15T15:32:27.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:27.873+0000 7f83e4400640 1 -- 172.21.15.73:0/531072096 wait complete. 2024-04-15T15:32:27.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:28.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a2e00640 1 Processor -- start 2024-04-15T15:32:28.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a2e00640 1 -- start start 2024-04-15T15:32:28.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a2e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f889c0b27c0 0x7f889c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a2e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f889c0b3e30 0x7f889c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a2e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889c070160 con 0x7f889c15b5d0 2024-04-15T15:32:28.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a2e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f889c15b9b0 con 0x7f889c0b3e30 2024-04-15T15:32:28.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a2e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f889c15f1f0 con 0x7f889c0b27c0 2024-04-15T15:32:28.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a0e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f889c0b3e30 0x7f889c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a0e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f889c0b3e30 0x7f889c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58356/0 (socket says 172.21.15.73:58356) 2024-04-15T15:32:28.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a0e00640 1 -- 172.21.15.73:0/921984896 learned_addr learned my addr 172.21.15.73:0/921984896 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:28.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f889b400640 1 --2- 172.21.15.73:0/921984896 >> v2:172.21.15.118:3300/0 conn(0x7f889c0b27c0 0x7f889c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a0e00640 1 -- 172.21.15.73:0/921984896 >> v2:172.21.15.118:3300/0 conn(0x7f889c0b27c0 msgr2=0x7f889c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:28.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a0e00640 1 --2- 172.21.15.73:0/921984896 >> v2:172.21.15.118:3300/0 conn(0x7f889c0b27c0 0x7f889c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a0e00640 1 -- 172.21.15.73:0/921984896 >> v1:172.21.15.118:6789/0 conn(0x7f889c15b5d0 legacy=0x7f889c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.029+0000 7f88a0e00640 1 -- 172.21.15.73:0/921984896 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c06fe80 con 0x7f889c0b3e30 2024-04-15T15:32:28.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f88a0e00640 1 --2- 172.21.15.73:0/921984896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b3e30 0x7f889c0b4740 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f889c0b2c50 tx=0x7f889401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d319e995481cb10 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:28.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f889aa00640 1 -- 172.21.15.73:0/921984896 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940b1070 con 0x7f889c0b3e30 2024-04-15T15:32:28.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f889aa00640 1 -- 172.21.15.73:0/921984896 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88940ac430 con 0x7f889c0b3e30 2024-04-15T15:32:28.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f889aa00640 1 -- 172.21.15.73:0/921984896 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940a8050 con 0x7f889c0b3e30 2024-04-15T15:32:28.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f88a2e00640 1 -- 172.21.15.73:0/921984896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b3e30 msgr2=0x7f889c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f88a2e00640 1 --2- 172.21.15.73:0/921984896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b3e30 0x7f889c0b4740 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f889c0b2c50 tx=0x7f889401c3d0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f88a2e00640 1 -- 172.21.15.73:0/921984896 shutdown_connections 2024-04-15T15:32:28.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f88a2e00640 1 --2- 172.21.15.73:0/921984896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b3e30 0x7f889c0b4740 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f88a2e00640 1 --2- 172.21.15.73:0/921984896 >> v2:172.21.15.118:3300/0 conn(0x7f889c0b27c0 0x7f889c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f88a2e00640 1 -- 172.21.15.73:0/921984896 >> 172.21.15.73:0/921984896 conn(0x7f889c067dd0 msgr2=0x7f889c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:28.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f88a2e00640 1 -- 172.21.15.73:0/921984896 shutdown_connections 2024-04-15T15:32:28.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.033+0000 7f88a2e00640 1 -- 172.21.15.73:0/921984896 wait complete. 2024-04-15T15:32:28.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 Processor -- start 2024-04-15T15:32:28.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 -- start start 2024-04-15T15:32:28.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b27c0 0x7f889c165d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f889c0b3e30 0x7f889c0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f889c15b5d0 0x7f889c1f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f889c06faa0 con 0x7f889c0b27c0 2024-04-15T15:32:28.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f889c0b4240 con 0x7f889c0b3e30 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f889c06fc20 con 0x7f889c15b5d0 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f889be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b27c0 0x7f889c165d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f889be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b27c0 0x7f889c165d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58366/0 (socket says 172.21.15.73:58366) 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f889be00640 1 -- 172.21.15.73:0/1814582851 learned_addr learned my addr 172.21.15.73:0/1814582851 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f889be00640 1 -- 172.21.15.73:0/1814582851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f889c15b5d0 msgr2=0x7f889c1f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f889be00640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f889c15b5d0 0x7f889c1f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f889be00640 1 -- 172.21.15.73:0/1814582851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f889c0b3e30 msgr2=0x7f889c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f889be00640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f889c0b3e30 0x7f889c0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f889be00640 1 -- 172.21.15.73:0/1814582851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c0ae380 con 0x7f889c0b27c0 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f889be00640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b27c0 0x7f889c165d60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c790 tx=0x7f888c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f8893e00640 1 -- 172.21.15.73:0/1814582851 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c016020 con 0x7f889c0b27c0 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f8893e00640 1 -- 172.21.15.73:0/1814582851 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888c006d60 con 0x7f889c0b27c0 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f8893e00640 1 -- 172.21.15.73:0/1814582851 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c003bc0 con 0x7f889c0b27c0 2024-04-15T15:32:28.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 -- 172.21.15.73:0/1814582851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c0ae660 con 0x7f889c0b27c0 2024-04-15T15:32:28.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 -- 172.21.15.73:0/1814582851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c0aec20 con 0x7f889c0b27c0 2024-04-15T15:32:28.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.037+0000 7f88a2e00640 1 -- 172.21.15.73:0/1814582851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c068ab0 con 0x7f889c0b27c0 2024-04-15T15:32:28.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.041+0000 7f8893e00640 1 -- 172.21.15.73:0/1814582851 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f888c00a850 con 0x7f889c0b27c0 2024-04-15T15:32:28.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.041+0000 7f8893e00640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f887c068380 0x7f887c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.041+0000 7f8893e00640 1 -- 172.21.15.73:0/1814582851 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f888c086b60 con 0x7f889c0b27c0 2024-04-15T15:32:28.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.041+0000 7f889b400640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f887c068380 0x7f887c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.041+0000 7f889b400640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f887c068380 0x7f887c06a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f889c0cf7a0 tx=0x7f8888008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:28.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.045+0000 7f8893e00640 1 -- 172.21.15.73:0/1814582851 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f888c020020 con 0x7f889c0b27c0 2024-04-15T15:32:28.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 -- 172.21.15.73:0/1814582851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f889c06f370 con 0x7f889c0b27c0 2024-04-15T15:32:28.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f8893e00640 1 -- 172.21.15.73:0/1814582851 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f888c019310 con 0x7f889c0b27c0 2024-04-15T15:32:28.202 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 -- 172.21.15.73:0/1814582851 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f887c068380 msgr2=0x7f887c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f887c068380 0x7f887c06a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f889c0cf7a0 tx=0x7f8888008040 comp rx=0 tx=0).stop 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 -- 172.21.15.73:0/1814582851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b27c0 msgr2=0x7f889c165d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b27c0 0x7f889c165d60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c790 tx=0x7f888c00cc50 comp rx=0 tx=0).stop 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 -- 172.21.15.73:0/1814582851 shutdown_connections 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f887c068380 0x7f887c06a840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f889c15b5d0 0x7f889c1f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f889c0b3e30 0x7f889c0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 --2- 172.21.15.73:0/1814582851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f889c0b27c0 0x7f889c165d60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 -- 172.21.15.73:0/1814582851 >> 172.21.15.73:0/1814582851 conn(0x7f889c067dd0 msgr2=0x7f889c15a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:28.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 -- 172.21.15.73:0/1814582851 shutdown_connections 2024-04-15T15:32:28.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.201+0000 7f88a2e00640 1 -- 172.21.15.73:0/1814582851 wait complete. 2024-04-15T15:32:28.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:32:28.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc284200640 1 Processor -- start 2024-04-15T15:32:28.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc284200640 1 -- start start 2024-04-15T15:32:28.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc284200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc27c15b5d0 0x7fc27c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc284200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc27c0b3e30 0x7fc27c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc284200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc27c0b25f0 0x7fc27c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc284200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc27c15b9b0 con 0x7fc27c0b25f0 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc284200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc27c070160 con 0x7fc27c0b3e30 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc284200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc27c15f1f0 con 0x7fc27c15b5d0 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc282200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc27c0b25f0 0x7fc27c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc282200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc27c0b25f0 0x7fc27c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58378/0 (socket says 172.21.15.73:58378) 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.357+0000 7fc282200640 1 -- 172.21.15.73:0/947310535 learned_addr learned my addr 172.21.15.73:0/947310535 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc280e00640 1 --2- 172.21.15.73:0/947310535 >> v2:172.21.15.118:3300/0 conn(0x7fc27c0b3e30 0x7fc27c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc281800640 1 --2- 172.21.15.73:0/947310535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc27c15b5d0 0x7fc27c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc282200640 1 -- 172.21.15.73:0/947310535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc27c15b5d0 msgr2=0x7fc27c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc282200640 1 --2- 172.21.15.73:0/947310535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc27c15b5d0 0x7fc27c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc282200640 1 -- 172.21.15.73:0/947310535 >> v2:172.21.15.118:3300/0 conn(0x7fc27c0b3e30 msgr2=0x7fc27c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc282200640 1 --2- 172.21.15.73:0/947310535 >> v2:172.21.15.118:3300/0 conn(0x7fc27c0b3e30 0x7fc27c0b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc282200640 1 -- 172.21.15.73:0/947310535 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c06fe80 con 0x7fc27c0b25f0 2024-04-15T15:32:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc282200640 1 --2- 172.21.15.73:0/947310535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b25f0 0x7fc27c0b4740 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0731e0 tx=0x7fc27401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ec7c71780d9d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc27be00640 1 -- 172.21.15.73:0/947310535 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2740090d0 con 0x7fc27c0b25f0 2024-04-15T15:32:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc27be00640 1 -- 172.21.15.73:0/947310535 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2740a5640 con 0x7fc27c0b25f0 2024-04-15T15:32:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc27be00640 1 -- 172.21.15.73:0/947310535 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc274009270 con 0x7fc27c0b25f0 2024-04-15T15:32:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc284200640 1 -- 172.21.15.73:0/947310535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b25f0 msgr2=0x7fc27c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc284200640 1 --2- 172.21.15.73:0/947310535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b25f0 0x7fc27c0b4740 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0731e0 tx=0x7fc27401c8d0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc284200640 1 -- 172.21.15.73:0/947310535 shutdown_connections 2024-04-15T15:32:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.361+0000 7fc284200640 1 --2- 172.21.15.73:0/947310535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b25f0 0x7fc27c0b4740 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 --2- 172.21.15.73:0/947310535 >> v2:172.21.15.118:3300/0 conn(0x7fc27c0b3e30 0x7fc27c0b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 --2- 172.21.15.73:0/947310535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc27c15b5d0 0x7fc27c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 -- 172.21.15.73:0/947310535 >> 172.21.15.73:0/947310535 conn(0x7fc27c067dd0 msgr2=0x7fc27c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 -- 172.21.15.73:0/947310535 shutdown_connections 2024-04-15T15:32:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 -- 172.21.15.73:0/947310535 wait complete. 2024-04-15T15:32:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 Processor -- start 2024-04-15T15:32:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 -- start start 2024-04-15T15:32:28.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc27c0b25f0 0x7fc27c0ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b3e30 0x7fc27c156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc27c15b5d0 0x7fc27c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c0b4390 con 0x7fc27c0b3e30 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c0b4210 con 0x7fc27c15b5d0 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc284200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc27c06faa0 con 0x7fc27c0b25f0 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc280e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b3e30 0x7fc27c156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc280e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b3e30 0x7fc27c156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58386/0 (socket says 172.21.15.73:58386) 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc280e00640 1 -- 172.21.15.73:0/3186419859 learned_addr learned my addr 172.21.15.73:0/3186419859 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc281800640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc27c0b25f0 0x7fc27c0ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc282200640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc27c15b5d0 0x7fc27c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc280e00640 1 -- 172.21.15.73:0/3186419859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc27c0b25f0 msgr2=0x7fc27c0ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc280e00640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc27c0b25f0 0x7fc27c0ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc280e00640 1 -- 172.21.15.73:0/3186419859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc27c15b5d0 msgr2=0x7fc27c15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc280e00640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc27c15b5d0 0x7fc27c15a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc280e00640 1 -- 172.21.15.73:0/3186419859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c0a9660 con 0x7fc27c0b3e30 2024-04-15T15:32:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc282200640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc27c15b5d0 0x7fc27c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc280e00640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b3e30 0x7fc27c156f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc26800e870 tx=0x7fc26800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.365+0000 7fc279600640 1 -- 172.21.15.73:0/3186419859 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268017070 con 0x7fc27c0b3e30 2024-04-15T15:32:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.369+0000 7fc279600640 1 -- 172.21.15.73:0/3186419859 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc26800c8e0 con 0x7fc27c0b3e30 2024-04-15T15:32:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.369+0000 7fc279600640 1 -- 172.21.15.73:0/3186419859 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26800cc90 con 0x7fc27c0b3e30 2024-04-15T15:32:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.369+0000 7fc284200640 1 -- 172.21.15.73:0/3186419859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27c0aa3e0 con 0x7fc27c0b3e30 2024-04-15T15:32:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.369+0000 7fc284200640 1 -- 172.21.15.73:0/3186419859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27c0a9be0 con 0x7fc27c0b3e30 2024-04-15T15:32:28.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.369+0000 7fc284200640 1 -- 172.21.15.73:0/3186419859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27c068ab0 con 0x7fc27c0b3e30 2024-04-15T15:32:28.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.369+0000 7fc279600640 1 -- 172.21.15.73:0/3186419859 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc26801a070 con 0x7fc27c0b3e30 2024-04-15T15:32:28.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.369+0000 7fc279600640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc25c068380 0x7fc25c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.369+0000 7fc279600640 1 -- 172.21.15.73:0/3186419859 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fc268086b80 con 0x7fc27c0b3e30 2024-04-15T15:32:28.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.369+0000 7fc281800640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc25c068380 0x7fc25c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.369+0000 7fc281800640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc25c068380 0x7fc25c06a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc270007940 tx=0x7fc270008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:28.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.373+0000 7fc279600640 1 -- 172.21.15.73:0/3186419859 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc2680566d0 con 0x7fc27c0b3e30 2024-04-15T15:32:28.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 -- 172.21.15.73:0/3186419859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc27c15a070 con 0x7fc27c0b3e30 2024-04-15T15:32:28.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc279600640 1 -- 172.21.15.73:0/3186419859 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fc26805a9d0 con 0x7fc27c0b3e30 2024-04-15T15:32:28.545 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-15T15:32:28.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 -- 172.21.15.73:0/3186419859 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc25c068380 msgr2=0x7fc25c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc25c068380 0x7fc25c06a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc270007940 tx=0x7fc270008040 comp rx=0 tx=0).stop 2024-04-15T15:32:28.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 -- 172.21.15.73:0/3186419859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b3e30 msgr2=0x7fc27c156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b3e30 0x7fc27c156f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc26800e870 tx=0x7fc26800ec70 comp rx=0 tx=0).stop 2024-04-15T15:32:28.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 -- 172.21.15.73:0/3186419859 shutdown_connections 2024-04-15T15:32:28.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc27c15b5d0 0x7fc27c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c0b3e30 0x7fc27c156f90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc25c068380 0x7fc25c06a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 --2- 172.21.15.73:0/3186419859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc27c0b25f0 0x7fc27c0ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 -- 172.21.15.73:0/3186419859 >> 172.21.15.73:0/3186419859 conn(0x7fc27c067dd0 msgr2=0x7fc27c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:28.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 -- 172.21.15.73:0/3186419859 shutdown_connections 2024-04-15T15:32:28.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.545+0000 7fc284200640 1 -- 172.21.15.73:0/3186419859 wait complete. 2024-04-15T15:32:28.570 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-15T15:32:28.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:28.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-15T15:32:28.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:32:28.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:28.601 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-15T15:32:28.661 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:28.662 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:28.671 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:28.671 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:28.720 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:28.720 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:28.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:28.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.945+0000 7efccd000640 1 Processor -- start 2024-04-15T15:32:28.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.945+0000 7efccd000640 1 -- start start 2024-04-15T15:32:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.945+0000 7efccd000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efcc80b20b0 0x7efcc80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.945+0000 7efccd000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 0x7efcc815d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.945+0000 7efccd000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc80cd3a0 con 0x7efcc8146110 2024-04-15T15:32:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.945+0000 7efccd000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7efcc80b5160 con 0x7efcc80b20b0 2024-04-15T15:32:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.945+0000 7efccd000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efcc80b40c0 con 0x7efcc815cbd0 2024-04-15T15:32:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.945+0000 7efcc5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efcc80b20b0 0x7efcc80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.945+0000 7efcc5e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efcc8146110 0x7efcc80cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57820/0 (socket says 172.21.15.73:57820) 2024-04-15T15:32:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.945+0000 7efcc5e00640 1 -- 172.21.15.73:0/3432207385 learned_addr learned my addr 172.21.15.73:0/3432207385 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efcc6800640 1 --2- 172.21.15.73:0/3432207385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 0x7efcc815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efcc5400640 1 -- 172.21.15.73:0/3432207385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 msgr2=0x7efcc815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efcc5400640 1 --2- 172.21.15.73:0/3432207385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 0x7efcc815d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efcc5400640 1 -- 172.21.15.73:0/3432207385 >> v1:172.21.15.73:6789/0 conn(0x7efcc8146110 legacy=0x7efcc80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efcc5400640 1 -- 172.21.15.73:0/3432207385 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc80b43a0 con 0x7efcc80b20b0 2024-04-15T15:32:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efcc4a00640 1 -- 172.21.15.73:0/3432207385 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1500860337 0 0) 0x7efcc80cd3a0 con 0x7efcc8146110 2024-04-15T15:32:28.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efcc5400640 1 --2- 172.21.15.73:0/3432207385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 0x7efcc80b2530 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efcb40097c0 tx=0x7efcb401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6023e0fa27e971 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:28.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efcc4a00640 1 -- 172.21.15.73:0/3432207385 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb40b2070 con 0x7efcc80b20b0 2024-04-15T15:32:28.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efcc4a00640 1 -- 172.21.15.73:0/3432207385 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb40ad640 con 0x7efcc80b20b0 2024-04-15T15:32:28.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efcc4a00640 1 -- 172.21.15.73:0/3432207385 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb40ada10 con 0x7efcc80b20b0 2024-04-15T15:32:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efccd000640 1 -- 172.21.15.73:0/3432207385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 msgr2=0x7efcc80b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efccd000640 1 --2- 172.21.15.73:0/3432207385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 0x7efcc80b2530 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efcb40097c0 tx=0x7efcb401c4a0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efccd000640 1 -- 172.21.15.73:0/3432207385 shutdown_connections 2024-04-15T15:32:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efccd000640 1 --2- 172.21.15.73:0/3432207385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 0x7efcc815d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efccd000640 1 --2- 172.21.15.73:0/3432207385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 0x7efcc80b2530 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.949+0000 7efccd000640 1 -- 172.21.15.73:0/3432207385 >> 172.21.15.73:0/3432207385 conn(0x7efcc8067dd0 msgr2=0x7efcc80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 -- 172.21.15.73:0/3432207385 shutdown_connections 2024-04-15T15:32:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 -- 172.21.15.73:0/3432207385 wait complete. 2024-04-15T15:32:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 Processor -- start 2024-04-15T15:32:28.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 -- start start 2024-04-15T15:32:28.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 0x7efcc8140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8146110 0x7efcc8155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 0x7efcc813e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efcc8169210 con 0x7efcc80b20b0 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80b3d70 con 0x7efcc8146110 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efcc8169390 con 0x7efcc815cbd0 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 0x7efcc8140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 0x7efcc8140510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58396/0 (socket says 172.21.15.73:58396) 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5e00640 1 -- 172.21.15.73:0/5851524 learned_addr learned my addr 172.21.15.73:0/5851524 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5e00640 1 -- 172.21.15.73:0/5851524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 msgr2=0x7efcc813e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc6800640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 0x7efcc813e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5e00640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 0x7efcc813e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5400640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8146110 0x7efcc8155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5e00640 1 -- 172.21.15.73:0/5851524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8146110 msgr2=0x7efcc8155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5e00640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8146110 0x7efcc8155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5e00640 1 -- 172.21.15.73:0/5851524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc815a6d0 con 0x7efcc80b20b0 2024-04-15T15:32:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc6800640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 0x7efcc813e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5400640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8146110 0x7efcc8155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcc5e00640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 0x7efcc8140510 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efcb8001570 tx=0x7efcb800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcbe000640 1 -- 172.21.15.73:0/5851524 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8018070 con 0x7efcc80b20b0 2024-04-15T15:32:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcbe000640 1 -- 172.21.15.73:0/5851524 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb800a640 con 0x7efcc80b20b0 2024-04-15T15:32:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efcbe000640 1 -- 172.21.15.73:0/5851524 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb800aa30 con 0x7efcc80b20b0 2024-04-15T15:32:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.953+0000 7efccd000640 1 -- 172.21.15.73:0/5851524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc8140a50 con 0x7efcc80b20b0 2024-04-15T15:32:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.957+0000 7efccd000640 1 -- 172.21.15.73:0/5851524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc815af30 con 0x7efcc80b20b0 2024-04-15T15:32:28.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.957+0000 7efccd000640 1 -- 172.21.15.73:0/5851524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc8068ab0 con 0x7efcc80b20b0 2024-04-15T15:32:28.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.957+0000 7efcbe000640 1 -- 172.21.15.73:0/5851524 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efcb800abd0 con 0x7efcc80b20b0 2024-04-15T15:32:28.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.957+0000 7efcbe000640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efca8068380 0x7efca806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.957+0000 7efcbe000640 1 -- 172.21.15.73:0/5851524 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7efcb80865c0 con 0x7efcc80b20b0 2024-04-15T15:32:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.957+0000 7efcc5400640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efca8068380 0x7efca806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.957+0000 7efcc5400640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efca8068380 0x7efca806a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efcb40af000 tx=0x7efcb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:28.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:28.961+0000 7efcbe000640 1 -- 172.21.15.73:0/5851524 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efcb80566d0 con 0x7efcc80b20b0 2024-04-15T15:32:29.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 -- 172.21.15.73:0/5851524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcc8143be0 con 0x7efcc80b20b0 2024-04-15T15:32:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efcbe000640 1 -- 172.21.15.73:0/5851524 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7efcb8055fd0 con 0x7efcc80b20b0 2024-04-15T15:32:29.122 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:29.122 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 -- 172.21.15.73:0/5851524 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efca8068380 msgr2=0x7efca806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efca8068380 0x7efca806a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efcb40af000 tx=0x7efcb4008040 comp rx=0 tx=0).stop 2024-04-15T15:32:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 -- 172.21.15.73:0/5851524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 msgr2=0x7efcc8140510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 0x7efcc8140510 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efcb8001570 tx=0x7efcb800cd20 comp rx=0 tx=0).stop 2024-04-15T15:32:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 -- 172.21.15.73:0/5851524 shutdown_connections 2024-04-15T15:32:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efca8068380 0x7efca806a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcc815cbd0 0x7efcc813e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8146110 0x7efcc8155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 --2- 172.21.15.73:0/5851524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcc80b20b0 0x7efcc8140510 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 -- 172.21.15.73:0/5851524 >> 172.21.15.73:0/5851524 conn(0x7efcc8067dd0 msgr2=0x7efcc806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 -- 172.21.15.73:0/5851524 shutdown_connections 2024-04-15T15:32:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.121+0000 7efccd000640 1 -- 172.21.15.73:0/5851524 wait complete. 2024-04-15T15:32:29.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:29.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:29.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2fe00640 1 Processor -- start 2024-04-15T15:32:29.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2fe00640 1 -- start start 2024-04-15T15:32:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5c2815fc90 0x7f5c280b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2fe00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c28070160 con 0x7f5c280b27c0 2024-04-15T15:32:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2fe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2815f1f0 con 0x7f5c2815b5d0 2024-04-15T15:32:29.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2fe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f5c2815b9b0 con 0x7f5c2815fc90 2024-04-15T15:32:29.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2ca00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5c280b27c0 0x7f5c280b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57826/0 (socket says 172.21.15.73:57826) 2024-04-15T15:32:29.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2de00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5c2815fc90 0x7f5c280b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2ca00640 1 -- 172.21.15.73:0/1738271964 learned_addr learned my addr 172.21.15.73:0/1738271964 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:29.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2de00640 1 -- 172.21.15.73:0/1738271964 >> v1:172.21.15.118:6789/0 conn(0x7f5c2815b5d0 legacy=0x7f5c280b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:29.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2de00640 1 -- 172.21.15.73:0/1738271964 >> v1:172.21.15.73:6789/0 conn(0x7f5c280b27c0 legacy=0x7f5c280b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.281+0000 7f5c2de00640 1 -- 172.21.15.73:0/1738271964 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2806fe80 con 0x7f5c2815fc90 2024-04-15T15:32:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c2de00640 1 --2- 172.21.15.73:0/1738271964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c2815fc90 0x7f5c280b3e30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5c200097c0 tx=0x7f5c2001e520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4246917544d63566 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c27e00640 1 -- 172.21.15.73:0/1738271964 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c200b2070 con 0x7f5c2815fc90 2024-04-15T15:32:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c27e00640 1 -- 172.21.15.73:0/1738271964 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c200ad600 con 0x7f5c2815fc90 2024-04-15T15:32:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c27e00640 1 -- 172.21.15.73:0/1738271964 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c200ad9d0 con 0x7f5c2815fc90 2024-04-15T15:32:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c2fe00640 1 -- 172.21.15.73:0/1738271964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c2815fc90 msgr2=0x7f5c280b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c2fe00640 1 --2- 172.21.15.73:0/1738271964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c2815fc90 0x7f5c280b3e30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5c200097c0 tx=0x7f5c2001e520 comp rx=0 tx=0).stop 2024-04-15T15:32:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c2fe00640 1 -- 172.21.15.73:0/1738271964 shutdown_connections 2024-04-15T15:32:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c2fe00640 1 --2- 172.21.15.73:0/1738271964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c2815fc90 0x7f5c280b3e30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c2fe00640 1 -- 172.21.15.73:0/1738271964 >> 172.21.15.73:0/1738271964 conn(0x7f5c28067dd0 msgr2=0x7f5c280d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c2fe00640 1 -- 172.21.15.73:0/1738271964 shutdown_connections 2024-04-15T15:32:29.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.285+0000 7f5c2fe00640 1 -- 172.21.15.73:0/1738271964 wait complete. 2024-04-15T15:32:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2fe00640 1 Processor -- start 2024-04-15T15:32:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2fe00640 1 -- start start 2024-04-15T15:32:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c280b27c0 0x7f5c281f82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c2815b5d0 0x7f5c28140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c2815fc90 0x7f5c28155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2806fc20 con 0x7f5c280b27c0 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2806faa0 con 0x7f5c2815fc90 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5c28071e10 con 0x7f5c2815b5d0 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c280b27c0 0x7f5c281f82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c280b27c0 0x7f5c281f82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58408/0 (socket says 172.21.15.73:58408) 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2d400640 1 -- 172.21.15.73:0/4004541564 learned_addr learned my addr 172.21.15.73:0/4004541564 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2d400640 1 -- 172.21.15.73:0/4004541564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c2815b5d0 msgr2=0x7f5c28140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2d400640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c2815b5d0 0x7f5c28140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2d400640 1 -- 172.21.15.73:0/4004541564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c2815fc90 msgr2=0x7f5c28155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2de00640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c2815fc90 0x7f5c28155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2d400640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c2815fc90 0x7f5c28155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2d400640 1 -- 172.21.15.73:0/4004541564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c281564d0 con 0x7f5c280b27c0 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2de00640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c2815fc90 0x7f5c28155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2d400640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c280b27c0 0x7f5c281f82d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00c7c0 tx=0x7f5c1c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:29.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c25600640 1 -- 172.21.15.73:0/4004541564 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c016020 con 0x7f5c280b27c0 2024-04-15T15:32:29.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c25600640 1 -- 172.21.15.73:0/4004541564 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c00aa50 con 0x7f5c280b27c0 2024-04-15T15:32:29.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2fe00640 1 -- 172.21.15.73:0/4004541564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c281f88b0 con 0x7f5c280b27c0 2024-04-15T15:32:29.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c25600640 1 -- 172.21.15.73:0/4004541564 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c012420 con 0x7f5c280b27c0 2024-04-15T15:32:29.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.289+0000 7f5c2fe00640 1 -- 172.21.15.73:0/4004541564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c281f8e70 con 0x7f5c280b27c0 2024-04-15T15:32:29.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.293+0000 7f5c2fe00640 1 -- 172.21.15.73:0/4004541564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c28068ab0 con 0x7f5c280b27c0 2024-04-15T15:32:29.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.293+0000 7f5c25600640 1 -- 172.21.15.73:0/4004541564 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c1c019020 con 0x7f5c280b27c0 2024-04-15T15:32:29.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.293+0000 7f5c25600640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c08068380 0x7f5c0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.293+0000 7f5c25600640 1 -- 172.21.15.73:0/4004541564 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f5c1c086ed0 con 0x7f5c280b27c0 2024-04-15T15:32:29.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.293+0000 7f5c2ca00640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c08068380 0x7f5c0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.293+0000 7f5c2ca00640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c08068380 0x7f5c0806a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5c14000f70 tx=0x7f5c14007a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:29.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.297+0000 7f5c25600640 1 -- 172.21.15.73:0/4004541564 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5c1c020030 con 0x7f5c280b27c0 2024-04-15T15:32:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.457+0000 7f5c2fe00640 1 -- 172.21.15.73:0/4004541564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5c2806f370 con 0x7f5c280b27c0 2024-04-15T15:32:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c25600640 1 -- 172.21.15.73:0/4004541564 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f5c1c057020 con 0x7f5c280b27c0 2024-04-15T15:32:29.461 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 -- 172.21.15.73:0/4004541564 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c08068380 msgr2=0x7f5c0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c08068380 0x7f5c0806a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5c14000f70 tx=0x7f5c14007a90 comp rx=0 tx=0).stop 2024-04-15T15:32:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 -- 172.21.15.73:0/4004541564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c280b27c0 msgr2=0x7f5c281f82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c280b27c0 0x7f5c281f82d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00c7c0 tx=0x7f5c1c00cc80 comp rx=0 tx=0).stop 2024-04-15T15:32:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 -- 172.21.15.73:0/4004541564 shutdown_connections 2024-04-15T15:32:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c2815fc90 0x7f5c28155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5c08068380 0x7f5c0806a840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c2815b5d0 0x7f5c28140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 --2- 172.21.15.73:0/4004541564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c280b27c0 0x7f5c281f82d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 -- 172.21.15.73:0/4004541564 >> 172.21.15.73:0/4004541564 conn(0x7f5c28067dd0 msgr2=0x7f5c280721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 -- 172.21.15.73:0/4004541564 shutdown_connections 2024-04-15T15:32:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.461+0000 7f5c2fe00640 1 -- 172.21.15.73:0/4004541564 wait complete. 2024-04-15T15:32:29.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:29.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cc5200640 1 Processor -- start 2024-04-15T15:32:29.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cc5200640 1 -- start start 2024-04-15T15:32:29.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cc5200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9cc015b5d0 0x7f9cc015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cc5200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc0070160 con 0x7f9cc00b3e30 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cc5200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc015f1f0 con 0x7f9cc00b27c0 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cc5200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc015b9b0 con 0x7f9cc015b5d0 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbd400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9cc00b3e30 0x7f9cc00b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57828/0 (socket says 172.21.15.73:57828) 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbd400640 1 -- 172.21.15.73:0/3611913010 learned_addr learned my addr 172.21.15.73:0/3611913010 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbde00640 1 --2- 172.21.15.73:0/3611913010 >> v2:172.21.15.118:3300/0 conn(0x7f9cc015b5d0 0x7f9cc015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbca00640 1 -- 172.21.15.73:0/3611913010 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529559100 0 0) 0x7f9cc0070160 con 0x7f9cc00b3e30 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbca00640 1 -- 172.21.15.73:0/3611913010 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ca4003530 con 0x7f9cc00b3e30 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbca00640 1 -- 172.21.15.73:0/3611913010 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1869532920 0 0) 0x7f9cc015f1f0 con 0x7f9cc00b27c0 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbca00640 1 -- 172.21.15.73:0/3611913010 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cc0070160 con 0x7f9cc00b27c0 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbde00640 1 -- 172.21.15.73:0/3611913010 >> v1:172.21.15.118:6789/0 conn(0x7f9cc00b27c0 legacy=0x7f9cc00b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbca00640 1 -- 172.21.15.73:0/3611913010 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4017898409 0 0) 0x7f9ca4003530 con 0x7f9cc00b3e30 2024-04-15T15:32:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbde00640 1 -- 172.21.15.73:0/3611913010 >> v1:172.21.15.73:6789/0 conn(0x7f9cc00b3e30 legacy=0x7f9cc00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.621+0000 7f9cbde00640 1 -- 172.21.15.73:0/3611913010 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc006fe80 con 0x7f9cc015b5d0 2024-04-15T15:32:29.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.625+0000 7f9cbde00640 1 --2- 172.21.15.73:0/3611913010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc015b5d0 0x7f9cc015fc90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009dc0 tx=0x7f9cb001c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e457e273fa4c8de4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cbca00640 1 -- 172.21.15.73:0/3611913010 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00b2070 con 0x7f9cc015b5d0 2024-04-15T15:32:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cbca00640 1 -- 172.21.15.73:0/3611913010 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb00a5520 con 0x7f9cc015b5d0 2024-04-15T15:32:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cbca00640 1 -- 172.21.15.73:0/3611913010 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac001680 con 0x7f9cc015b5d0 2024-04-15T15:32:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 -- 172.21.15.73:0/3611913010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc015b5d0 msgr2=0x7f9cc015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 --2- 172.21.15.73:0/3611913010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc015b5d0 0x7f9cc015fc90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009dc0 tx=0x7f9cb001c6f0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 -- 172.21.15.73:0/3611913010 shutdown_connections 2024-04-15T15:32:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 --2- 172.21.15.73:0/3611913010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc015b5d0 0x7f9cc015fc90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 -- 172.21.15.73:0/3611913010 >> 172.21.15.73:0/3611913010 conn(0x7f9cc0067dd0 msgr2=0x7f9cc00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 -- 172.21.15.73:0/3611913010 shutdown_connections 2024-04-15T15:32:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 -- 172.21.15.73:0/3611913010 wait complete. 2024-04-15T15:32:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 Processor -- start 2024-04-15T15:32:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 -- start start 2024-04-15T15:32:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc00b27c0 0x7f9cc0149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cc00b3e30 0x7f9cc0143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc015b5d0 0x7f9cc01445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc006faa0 con 0x7f9cc00b27c0 2024-04-15T15:32:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc00cfd00 con 0x7f9cc015b5d0 2024-04-15T15:32:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.629+0000 7f9cc5200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc006fc20 con 0x7f9cc00b3e30 2024-04-15T15:32:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbde00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc00b27c0 0x7f9cc0149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbde00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc00b27c0 0x7f9cc0149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58412/0 (socket says 172.21.15.73:58412) 2024-04-15T15:32:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbde00640 1 -- 172.21.15.73:0/3423557960 learned_addr learned my addr 172.21.15.73:0/3423557960 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbd400640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cc00b3e30 0x7f9cc0143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbe800640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc015b5d0 0x7f9cc01445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbde00640 1 -- 172.21.15.73:0/3423557960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cc00b3e30 msgr2=0x7f9cc0143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbde00640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cc00b3e30 0x7f9cc0143670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbde00640 1 -- 172.21.15.73:0/3423557960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc015b5d0 msgr2=0x7f9cc01445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbde00640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc015b5d0 0x7f9cc01445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbde00640 1 -- 172.21.15.73:0/3423557960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc0146260 con 0x7f9cc00b27c0 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cbde00640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc00b27c0 0x7f9cc0149a50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009dc0 tx=0x7f9cb0019490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cb6000640 1 -- 172.21.15.73:0/3423557960 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00b2040 con 0x7f9cc00b27c0 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cb6000640 1 -- 172.21.15.73:0/3423557960 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb00039a0 con 0x7f9cc00b27c0 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cc5200640 1 -- 172.21.15.73:0/3423557960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc0146540 con 0x7f9cc00b27c0 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cb6000640 1 -- 172.21.15.73:0/3423557960 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0009450 con 0x7f9cc00b27c0 2024-04-15T15:32:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cc5200640 1 -- 172.21.15.73:0/3423557960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc0147ed0 con 0x7f9cc00b27c0 2024-04-15T15:32:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cc5200640 1 -- 172.21.15.73:0/3423557960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc0068ab0 con 0x7f9cc00b27c0 2024-04-15T15:32:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cb6000640 1 -- 172.21.15.73:0/3423557960 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9cb0004030 con 0x7f9cc00b27c0 2024-04-15T15:32:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cb6000640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9ca00683b0 0x7f9ca006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.633+0000 7f9cb6000640 1 -- 172.21.15.73:0/3423557960 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f9cb0121fc0 con 0x7f9cc00b27c0 2024-04-15T15:32:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.637+0000 7f9cbd400640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9ca00683b0 0x7f9ca006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.637+0000 7f9cbd400640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9ca00683b0 0x7f9ca006a870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9cc01673a0 tx=0x7f9cac001620 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:29.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.641+0000 7f9cb6000640 1 -- 172.21.15.73:0/3423557960 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9cb00164a0 con 0x7f9cc00b27c0 2024-04-15T15:32:29.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 -- 172.21.15.73:0/3423557960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9cc00cf2a0 con 0x7f9cc00b27c0 2024-04-15T15:32:29.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cb6000640 1 -- 172.21.15.73:0/3423557960 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f9cb00f1ba0 con 0x7f9cc00b27c0 2024-04-15T15:32:29.797 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:29.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 -- 172.21.15.73:0/3423557960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9ca00683b0 msgr2=0x7f9ca006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9ca00683b0 0x7f9ca006a870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9cc01673a0 tx=0x7f9cac001620 comp rx=0 tx=0).stop 2024-04-15T15:32:29.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 -- 172.21.15.73:0/3423557960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc00b27c0 msgr2=0x7f9cc0149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc00b27c0 0x7f9cc0149a50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009dc0 tx=0x7f9cb0019490 comp rx=0 tx=0).stop 2024-04-15T15:32:29.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 -- 172.21.15.73:0/3423557960 shutdown_connections 2024-04-15T15:32:29.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc015b5d0 0x7f9cc01445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9ca00683b0 0x7f9ca006a870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9cc00b3e30 0x7f9cc0143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 --2- 172.21.15.73:0/3423557960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc00b27c0 0x7f9cc0149a50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 -- 172.21.15.73:0/3423557960 >> 172.21.15.73:0/3423557960 conn(0x7f9cc0067dd0 msgr2=0x7f9cc0071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:29.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 -- 172.21.15.73:0/3423557960 shutdown_connections 2024-04-15T15:32:29.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.797+0000 7f9cc5200640 1 -- 172.21.15.73:0/3423557960 wait complete. 2024-04-15T15:32:29.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:29.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.953+0000 7fc043a00640 1 Processor -- start 2024-04-15T15:32:29.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.953+0000 7fc043a00640 1 -- start start 2024-04-15T15:32:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc043a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc03c0b20b0 0x7fc03c0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc043a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc03c15cbd0 0x7fc03c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc043a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03c0cd3a0 con 0x7fc03c146110 2024-04-15T15:32:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc043a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc03c0b5160 con 0x7fc03c0b20b0 2024-04-15T15:32:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc043a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc03c0b40c0 con 0x7fc03c15cbd0 2024-04-15T15:32:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc03be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc03c0b20b0 0x7fc03c0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc03be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc03c0b20b0 0x7fc03c0b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58422/0 (socket says 172.21.15.73:58422) 2024-04-15T15:32:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc03be00640 1 -- 172.21.15.73:0/1509955669 learned_addr learned my addr 172.21.15.73:0/1509955669 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc041a00640 1 --2- 172.21.15.73:0/1509955669 >> v2:172.21.15.118:3300/0 conn(0x7fc03c15cbd0 0x7fc03c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc03be00640 1 -- 172.21.15.73:0/1509955669 >> v2:172.21.15.118:3300/0 conn(0x7fc03c15cbd0 msgr2=0x7fc03c15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc03be00640 1 --2- 172.21.15.73:0/1509955669 >> v2:172.21.15.118:3300/0 conn(0x7fc03c15cbd0 0x7fc03c15d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc03be00640 1 -- 172.21.15.73:0/1509955669 >> v1:172.21.15.118:6789/0 conn(0x7fc03c146110 legacy=0x7fc03c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.957+0000 7fc03be00640 1 -- 172.21.15.73:0/1509955669 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c0b43a0 con 0x7fc03c0b20b0 2024-04-15T15:32:29.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc03be00640 1 --2- 172.21.15.73:0/1509955669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 0x7fc03c0b2530 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0cd570 tx=0x7fc02801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184881aa9f5056fe server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:29.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc03b400640 1 -- 172.21.15.73:0/1509955669 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0280ab610 con 0x7fc03c0b20b0 2024-04-15T15:32:29.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc03b400640 1 -- 172.21.15.73:0/1509955669 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0280b0070 con 0x7fc03c0b20b0 2024-04-15T15:32:29.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc03b400640 1 -- 172.21.15.73:0/1509955669 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0280ab9d0 con 0x7fc03c0b20b0 2024-04-15T15:32:29.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc043a00640 1 -- 172.21.15.73:0/1509955669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 msgr2=0x7fc03c0b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc043a00640 1 --2- 172.21.15.73:0/1509955669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 0x7fc03c0b2530 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0cd570 tx=0x7fc02801c520 comp rx=0 tx=0).stop 2024-04-15T15:32:29.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc043a00640 1 -- 172.21.15.73:0/1509955669 shutdown_connections 2024-04-15T15:32:29.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc043a00640 1 --2- 172.21.15.73:0/1509955669 >> v2:172.21.15.118:3300/0 conn(0x7fc03c15cbd0 0x7fc03c15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc043a00640 1 --2- 172.21.15.73:0/1509955669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 0x7fc03c0b2530 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc043a00640 1 -- 172.21.15.73:0/1509955669 >> 172.21.15.73:0/1509955669 conn(0x7fc03c067dd0 msgr2=0x7fc03c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:29.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc043a00640 1 -- 172.21.15.73:0/1509955669 shutdown_connections 2024-04-15T15:32:29.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc043a00640 1 -- 172.21.15.73:0/1509955669 wait complete. 2024-04-15T15:32:29.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc043a00640 1 Processor -- start 2024-04-15T15:32:29.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.961+0000 7fc043a00640 1 -- start start 2024-04-15T15:32:29.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc043a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 0x7fc03c155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc043a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc03c146110 0x7fc03c0cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc043a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc03c15cbd0 0x7fc03c0cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc043a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c169210 con 0x7fc03c0b20b0 2024-04-15T15:32:29.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc043a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c0b3d70 con 0x7fc03c146110 2024-04-15T15:32:29.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc043a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc03c169390 con 0x7fc03c15cbd0 2024-04-15T15:32:29.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc041000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 0x7fc03c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc041000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 0x7fc03c155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58438/0 (socket says 172.21.15.73:58438) 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc041000640 1 -- 172.21.15.73:0/623560575 learned_addr learned my addr 172.21.15.73:0/623560575 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc03be00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc03c146110 0x7fc03c0cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc041a00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc03c15cbd0 0x7fc03c0cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc041000640 1 -- 172.21.15.73:0/623560575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc03c15cbd0 msgr2=0x7fc03c0cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc041000640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc03c15cbd0 0x7fc03c0cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc041000640 1 -- 172.21.15.73:0/623560575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc03c146110 msgr2=0x7fc03c0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc041000640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc03c146110 0x7fc03c0cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc041000640 1 -- 172.21.15.73:0/623560575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c0aea20 con 0x7fc03c0b20b0 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc041000640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 0x7fc03c155040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00c790 tx=0x7fc02c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc038c00640 1 -- 172.21.15.73:0/623560575 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c016020 con 0x7fc03c0b20b0 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc038c00640 1 -- 172.21.15.73:0/623560575 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02c006d60 con 0x7fc03c0b20b0 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc043a00640 1 -- 172.21.15.73:0/623560575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03c0aed00 con 0x7fc03c0b20b0 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc038c00640 1 -- 172.21.15.73:0/623560575 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c003bc0 con 0x7fc03c0b20b0 2024-04-15T15:32:29.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc043a00640 1 -- 172.21.15.73:0/623560575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03c0af2c0 con 0x7fc03c0b20b0 2024-04-15T15:32:29.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc043a00640 1 -- 172.21.15.73:0/623560575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03c068ab0 con 0x7fc03c0b20b0 2024-04-15T15:32:29.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.965+0000 7fc038c00640 1 -- 172.21.15.73:0/623560575 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc02c00a850 con 0x7fc03c0b20b0 2024-04-15T15:32:29.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.969+0000 7fc038c00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc01c0683b0 0x7fc01c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:29.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.969+0000 7fc038c00640 1 -- 172.21.15.73:0/623560575 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fc02c0869f0 con 0x7fc03c0b20b0 2024-04-15T15:32:29.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.969+0000 7fc03be00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc01c0683b0 0x7fc01c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:29.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.969+0000 7fc03be00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc01c0683b0 0x7fc01c06a870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc0280af000 tx=0x7fc0280a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:29.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:29.973+0000 7fc038c00640 1 -- 172.21.15.73:0/623560575 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc02c020020 con 0x7fc03c0b20b0 2024-04-15T15:32:30.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.129+0000 7fc043a00640 1 -- 172.21.15.73:0/623560575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc03c13a260 con 0x7fc03c0b20b0 2024-04-15T15:32:30.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc038c00640 1 -- 172.21.15.73:0/623560575 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fc02c056540 con 0x7fc03c0b20b0 2024-04-15T15:32:30.132 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:30.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 -- 172.21.15.73:0/623560575 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc01c0683b0 msgr2=0x7fc01c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc01c0683b0 0x7fc01c06a870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc0280af000 tx=0x7fc0280a7000 comp rx=0 tx=0).stop 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 -- 172.21.15.73:0/623560575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 msgr2=0x7fc03c155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 0x7fc03c155040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00c790 tx=0x7fc02c00cc50 comp rx=0 tx=0).stop 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 -- 172.21.15.73:0/623560575 shutdown_connections 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc01c0683b0 0x7fc01c06a870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc03c15cbd0 0x7fc03c0cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc03c146110 0x7fc03c0cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 --2- 172.21.15.73:0/623560575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc03c0b20b0 0x7fc03c155040 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 -- 172.21.15.73:0/623560575 >> 172.21.15.73:0/623560575 conn(0x7fc03c067dd0 msgr2=0x7fc03c1450c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 -- 172.21.15.73:0/623560575 shutdown_connections 2024-04-15T15:32:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.133+0000 7fc043a00640 1 -- 172.21.15.73:0/623560575 wait complete. 2024-04-15T15:32:30.154 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:30.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.289+0000 7f5e3a400640 1 Processor -- start 2024-04-15T15:32:30.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.289+0000 7f5e3a400640 1 -- start start 2024-04-15T15:32:30.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e3a400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5e340b20b0 0x7f5e340b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e3a400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e3415cbd0 0x7f5e3415d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e3a400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e340cd3a0 con 0x7f5e34146110 2024-04-15T15:32:30.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e3a400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f5e340b5160 con 0x7f5e340b20b0 2024-04-15T15:32:30.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e3a400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5e340b40c0 con 0x7f5e3415cbd0 2024-04-15T15:32:30.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e33400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5e34146110 0x7f5e340cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57842/0 (socket says 172.21.15.73:57842) 2024-04-15T15:32:30.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e33400640 1 -- 172.21.15.73:0/988829082 learned_addr learned my addr 172.21.15.73:0/988829082 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:30.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e32a00640 1 --2- 172.21.15.73:0/988829082 >> v2:172.21.15.118:3300/0 conn(0x7f5e340b20b0 0x7f5e340b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e33e00640 1 --2- 172.21.15.73:0/988829082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e3415cbd0 0x7f5e3415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e32000640 1 -- 172.21.15.73:0/988829082 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347313248 0 0) 0x7f5e340cd3a0 con 0x7f5e34146110 2024-04-15T15:32:30.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e32000640 1 -- 172.21.15.73:0/988829082 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e18003530 con 0x7f5e34146110 2024-04-15T15:32:30.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e32a00640 1 -- 172.21.15.73:0/988829082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e3415cbd0 msgr2=0x7f5e3415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:30.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e32a00640 1 --2- 172.21.15.73:0/988829082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e3415cbd0 0x7f5e3415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e32a00640 1 -- 172.21.15.73:0/988829082 >> v1:172.21.15.73:6789/0 conn(0x7f5e34146110 legacy=0x7f5e340cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.293+0000 7f5e32a00640 1 -- 172.21.15.73:0/988829082 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e340b43a0 con 0x7f5e340b20b0 2024-04-15T15:32:30.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e32a00640 1 --2- 172.21.15.73:0/988829082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e340b20b0 0x7f5e340b2530 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5e200097c0 tx=0x7f5e2001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=991b2438a5640c12 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:30.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e32000640 1 -- 172.21.15.73:0/988829082 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e200b2070 con 0x7f5e340b20b0 2024-04-15T15:32:30.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e32000640 1 -- 172.21.15.73:0/988829082 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e200ad640 con 0x7f5e340b20b0 2024-04-15T15:32:30.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e32000640 1 -- 172.21.15.73:0/988829082 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e200ada10 con 0x7f5e340b20b0 2024-04-15T15:32:30.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e3a400640 1 -- 172.21.15.73:0/988829082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e340b20b0 msgr2=0x7f5e340b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e3a400640 1 --2- 172.21.15.73:0/988829082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e340b20b0 0x7f5e340b2530 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5e200097c0 tx=0x7f5e2001c4a0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e3a400640 1 -- 172.21.15.73:0/988829082 shutdown_connections 2024-04-15T15:32:30.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e3a400640 1 --2- 172.21.15.73:0/988829082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e3415cbd0 0x7f5e3415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e3a400640 1 --2- 172.21.15.73:0/988829082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e340b20b0 0x7f5e340b2530 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e3a400640 1 -- 172.21.15.73:0/988829082 >> 172.21.15.73:0/988829082 conn(0x7f5e34067dd0 msgr2=0x7f5e340d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:30.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e3a400640 1 -- 172.21.15.73:0/988829082 shutdown_connections 2024-04-15T15:32:30.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e3a400640 1 -- 172.21.15.73:0/988829082 wait complete. 2024-04-15T15:32:30.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e3a400640 1 Processor -- start 2024-04-15T15:32:30.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.297+0000 7f5e3a400640 1 -- start start 2024-04-15T15:32:30.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e3a400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e340b20b0 0x7f5e3413dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e3a400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e34146110 0x7f5e3406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e3a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3415cbd0 0x7f5e34156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e3a400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5e34169210 con 0x7f5e34146110 2024-04-15T15:32:30.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e3a400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5e340b3d70 con 0x7f5e3415cbd0 2024-04-15T15:32:30.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e3a400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5e34169390 con 0x7f5e340b20b0 2024-04-15T15:32:30.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e32a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e34146110 0x7f5e3406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e32a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e34146110 0x7f5e3406bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58440/0 (socket says 172.21.15.73:58440) 2024-04-15T15:32:30.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e32a00640 1 -- 172.21.15.73:0/2839837368 learned_addr learned my addr 172.21.15.73:0/2839837368 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:30.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e33400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e340b20b0 0x7f5e3413dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e32a00640 1 -- 172.21.15.73:0/2839837368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e340b20b0 msgr2=0x7f5e3413dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e33e00640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3415cbd0 0x7f5e34156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e32a00640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e340b20b0 0x7f5e3413dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e32a00640 1 -- 172.21.15.73:0/2839837368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3415cbd0 msgr2=0x7f5e34156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e32a00640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3415cbd0 0x7f5e34156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e32a00640 1 -- 172.21.15.73:0/2839837368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e34141bb0 con 0x7f5e34146110 2024-04-15T15:32:30.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e33e00640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3415cbd0 0x7f5e34156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:30.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e33400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e340b20b0 0x7f5e3413dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:30.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e32a00640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e34146110 0x7f5e3406bcb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5e200097c0 tx=0x7f5e20019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e2b400640 1 -- 172.21.15.73:0/2839837368 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e200b2040 con 0x7f5e34146110 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e2b400640 1 -- 172.21.15.73:0/2839837368 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e200bc070 con 0x7f5e34146110 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e3a400640 1 -- 172.21.15.73:0/2839837368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e34141e90 con 0x7f5e34146110 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e2b400640 1 -- 172.21.15.73:0/2839837368 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20006e20 con 0x7f5e34146110 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e3a400640 1 -- 172.21.15.73:0/2839837368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e34143b50 con 0x7f5e34146110 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e3a400640 1 -- 172.21.15.73:0/2839837368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e34068ab0 con 0x7f5e34146110 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.301+0000 7f5e2b400640 1 -- 172.21.15.73:0/2839837368 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e200b6670 con 0x7f5e34146110 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.305+0000 7f5e2b400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5e14068380 0x7f5e1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.305+0000 7f5e2b400640 1 -- 172.21.15.73:0/2839837368 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f5e20120db0 con 0x7f5e34146110 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.305+0000 7f5e33400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5e14068380 0x7f5e1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.305+0000 7f5e33400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5e14068380 0x7f5e1406a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005890 tx=0x7f5e24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:30.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.309+0000 7f5e2b400640 1 -- 172.21.15.73:0/2839837368 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5e20125070 con 0x7f5e34146110 2024-04-15T15:32:30.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 -- 172.21.15.73:0/2839837368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5e3415ba70 con 0x7f5e34146110 2024-04-15T15:32:30.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e2b400640 1 -- 172.21.15.73:0/2839837368 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f5e20016090 con 0x7f5e34146110 2024-04-15T15:32:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 -- 172.21.15.73:0/2839837368 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5e14068380 msgr2=0x7f5e1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5e14068380 0x7f5e1406a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005890 tx=0x7f5e24009040 comp rx=0 tx=0).stop 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 -- 172.21.15.73:0/2839837368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e34146110 msgr2=0x7f5e3406bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e34146110 0x7f5e3406bcb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5e200097c0 tx=0x7f5e20019240 comp rx=0 tx=0).stop 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 -- 172.21.15.73:0/2839837368 shutdown_connections 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3415cbd0 0x7f5e34156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e34146110 0x7f5e3406bcb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5e14068380 0x7f5e1406a840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 --2- 172.21.15.73:0/2839837368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5e340b20b0 0x7f5e3413dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 -- 172.21.15.73:0/2839837368 >> 172.21.15.73:0/2839837368 conn(0x7f5e34067dd0 msgr2=0x7f5e3415abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 -- 172.21.15.73:0/2839837368 shutdown_connections 2024-04-15T15:32:30.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.469+0000 7f5e3a400640 1 -- 172.21.15.73:0/2839837368 wait complete. 2024-04-15T15:32:30.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:32:30.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.625+0000 7ff04ca00640 1 Processor -- start 2024-04-15T15:32:30.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.625+0000 7ff04ca00640 1 -- start start 2024-04-15T15:32:30.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff04ca00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff04815c840 0x7ff0480b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff04ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0480d1fe0 0x7ff0480ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff04ca00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04815cc20 con 0x7ff048160310 2024-04-15T15:32:30.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff04ca00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff0480b2e70 con 0x7ff0480d1fe0 2024-04-15T15:32:30.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff04ca00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ff0480cd4a0 con 0x7ff04815c840 2024-04-15T15:32:30.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff045400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0480d1fe0 0x7ff0480ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff045400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0480d1fe0 0x7ff0480ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58448/0 (socket says 172.21.15.73:58448) 2024-04-15T15:32:30.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff045400640 1 -- 172.21.15.73:0/215137603 learned_addr learned my addr 172.21.15.73:0/215137603 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:30.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff045400640 1 -- 172.21.15.73:0/215137603 >> v2:172.21.15.118:3300/0 conn(0x7ff04815c840 msgr2=0x7ff0480b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:30.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff045e00640 1 --2- 172.21.15.73:0/215137603 >> v2:172.21.15.118:3300/0 conn(0x7ff04815c840 0x7ff0480b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff045400640 1 --2- 172.21.15.73:0/215137603 >> v2:172.21.15.118:3300/0 conn(0x7ff04815c840 0x7ff0480b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff045400640 1 -- 172.21.15.73:0/215137603 >> v1:172.21.15.118:6789/0 conn(0x7ff048160310 legacy=0x7ff0480b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:30.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff045400640 1 -- 172.21.15.73:0/215137603 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0480cd780 con 0x7ff0480d1fe0 2024-04-15T15:32:30.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.629+0000 7ff045e00640 1 --2- 172.21.15.73:0/215137603 >> v2:172.21.15.118:3300/0 conn(0x7ff04815c840 0x7ff0480b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:30.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff045400640 1 --2- 172.21.15.73:0/215137603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 0x7ff0480ce540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff04809f5c0 tx=0x7ff03401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435a7c26c5b0e250 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:30.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff044a00640 1 -- 172.21.15.73:0/215137603 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0340b5070 con 0x7ff0480d1fe0 2024-04-15T15:32:30.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff044a00640 1 -- 172.21.15.73:0/215137603 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0340a89d0 con 0x7ff0480d1fe0 2024-04-15T15:32:30.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff044a00640 1 -- 172.21.15.73:0/215137603 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0340a8da0 con 0x7ff0480d1fe0 2024-04-15T15:32:30.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff04ca00640 1 -- 172.21.15.73:0/215137603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 msgr2=0x7ff0480ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff04ca00640 1 --2- 172.21.15.73:0/215137603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 0x7ff0480ce540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff04809f5c0 tx=0x7ff03401ecd0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff04ca00640 1 -- 172.21.15.73:0/215137603 shutdown_connections 2024-04-15T15:32:30.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff04ca00640 1 --2- 172.21.15.73:0/215137603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 0x7ff0480ce540 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff04ca00640 1 --2- 172.21.15.73:0/215137603 >> v2:172.21.15.118:3300/0 conn(0x7ff04815c840 0x7ff0480b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff04ca00640 1 -- 172.21.15.73:0/215137603 >> 172.21.15.73:0/215137603 conn(0x7ff04809aa60 msgr2=0x7ff0480d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:30.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff04ca00640 1 -- 172.21.15.73:0/215137603 shutdown_connections 2024-04-15T15:32:30.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.633+0000 7ff04ca00640 1 -- 172.21.15.73:0/215137603 wait complete. 2024-04-15T15:32:30.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff04ca00640 1 Processor -- start 2024-04-15T15:32:30.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff04ca00640 1 -- start start 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff04ca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 0x7ff0480cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff04ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04815c840 0x7ff0480ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff04ca00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff048160310 0x7ff0480b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff04ca00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff0480ce020 con 0x7ff0480d1fe0 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff04ca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff0480cdd40 con 0x7ff04815c840 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff04ca00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff0480cd1a0 con 0x7ff048160310 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 0x7ff0480cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 0x7ff0480cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58462/0 (socket says 172.21.15.73:58462) 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045e00640 1 -- 172.21.15.73:0/65786546 learned_addr learned my addr 172.21.15.73:0/65786546 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045400640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04815c840 0x7ff0480ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff046800640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff048160310 0x7ff0480b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045e00640 1 -- 172.21.15.73:0/65786546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff048160310 msgr2=0x7ff0480b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045e00640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff048160310 0x7ff0480b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045e00640 1 -- 172.21.15.73:0/65786546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04815c840 msgr2=0x7ff0480ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045e00640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04815c840 0x7ff0480ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045e00640 1 -- 172.21.15.73:0/65786546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0480b1500 con 0x7ff0480d1fe0 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045400640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04815c840 0x7ff0480ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff045e00640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 0x7ff0480cb090 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c7c0 tx=0x7ff03800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff03e000640 1 -- 172.21.15.73:0/65786546 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038007a30 con 0x7ff0480d1fe0 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff03e000640 1 -- 172.21.15.73:0/65786546 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff038007bd0 con 0x7ff0480d1fe0 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff03e000640 1 -- 172.21.15.73:0/65786546 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0380113f0 con 0x7ff0480d1fe0 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff04ca00640 1 -- 172.21.15.73:0/65786546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0480ae900 con 0x7ff0480d1fe0 2024-04-15T15:32:30.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.637+0000 7ff04ca00640 1 -- 172.21.15.73:0/65786546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0480aeec0 con 0x7ff0480d1fe0 2024-04-15T15:32:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.641+0000 7ff04ca00640 1 -- 172.21.15.73:0/65786546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff048068ab0 con 0x7ff0480d1fe0 2024-04-15T15:32:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.641+0000 7ff03e000640 1 -- 172.21.15.73:0/65786546 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff038011590 con 0x7ff0480d1fe0 2024-04-15T15:32:30.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.641+0000 7ff03e000640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff0280683b0 0x7ff02806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:30.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.641+0000 7ff03e000640 1 -- 172.21.15.73:0/65786546 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7ff038086ff0 con 0x7ff0480d1fe0 2024-04-15T15:32:30.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.641+0000 7ff045400640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff0280683b0 0x7ff02806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:30.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.641+0000 7ff045400640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff0280683b0 0x7ff02806a870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff0340b2000 tx=0x7ff034008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:30.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.645+0000 7ff03e000640 1 -- 172.21.15.73:0/65786546 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff038015020 con 0x7ff0480d1fe0 2024-04-15T15:32:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.813+0000 7ff04ca00640 1 -- 172.21.15.73:0/65786546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff0480cbb80 con 0x7ff0480d1fe0 2024-04-15T15:32:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.813+0000 7ff03e000640 1 -- 172.21.15.73:0/65786546 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7ff038057100 con 0x7ff0480d1fe0 2024-04-15T15:32:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-15T15:32:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 -- 172.21.15.73:0/65786546 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff0280683b0 msgr2=0x7ff02806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff0280683b0 0x7ff02806a870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff0340b2000 tx=0x7ff034008040 comp rx=0 tx=0).stop 2024-04-15T15:32:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 -- 172.21.15.73:0/65786546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 msgr2=0x7ff0480cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 0x7ff0480cb090 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c7c0 tx=0x7ff03800cc80 comp rx=0 tx=0).stop 2024-04-15T15:32:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 -- 172.21.15.73:0/65786546 shutdown_connections 2024-04-15T15:32:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff0280683b0 0x7ff02806a870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff048160310 0x7ff0480b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04815c840 0x7ff0480ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 --2- 172.21.15.73:0/65786546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0480d1fe0 0x7ff0480cb090 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:30.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 -- 172.21.15.73:0/65786546 >> 172.21.15.73:0/65786546 conn(0x7ff04809aa60 msgr2=0x7ff0480b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:30.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 -- 172.21.15.73:0/65786546 shutdown_connections 2024-04-15T15:32:30.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:30.817+0000 7ff04ca00640 1 -- 172.21.15.73:0/65786546 wait complete. 2024-04-15T15:32:30.837 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-15T15:32:30.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:30.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-15T15:32:30.861 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:32:30.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:30.861 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-15T15:32:30.918 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:32:30.918 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:30.927 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:32:30.927 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:30.980 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:32:30.980 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:31.032 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:31.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.165+0000 7f20e6600640 1 Processor -- start 2024-04-15T15:32:31.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.165+0000 7f20e6600640 1 -- start start 2024-04-15T15:32:31.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20e6600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20e00b2530 0x7f20e015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20e6600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e00cd3a0 con 0x7f20e0146110 2024-04-15T15:32:31.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20e6600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e00b5160 con 0x7f20e00b20b0 2024-04-15T15:32:31.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20e6600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f20e00b40c0 con 0x7f20e00b2530 2024-04-15T15:32:31.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20dfe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20e00b2530 0x7f20e015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20df400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f20e0146110 0x7f20e00cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57848/0 (socket says 172.21.15.73:57848) 2024-04-15T15:32:31.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20df400640 1 -- 172.21.15.73:0/4029548068 learned_addr learned my addr 172.21.15.73:0/4029548068 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:31.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20dfe00640 1 -- 172.21.15.73:0/4029548068 >> v1:172.21.15.118:6789/0 conn(0x7f20e00b20b0 legacy=0x7f20e015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20dfe00640 1 -- 172.21.15.73:0/4029548068 >> v1:172.21.15.73:6789/0 conn(0x7f20e0146110 legacy=0x7f20e00cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20dfe00640 1 -- 172.21.15.73:0/4029548068 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e00b43a0 con 0x7f20e00b2530 2024-04-15T15:32:31.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.169+0000 7f20dfe00640 1 --2- 172.21.15.73:0/4029548068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b2530 0x7f20e015d2e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009d90 tx=0x7f20d801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643b9b01f98e83a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:31.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20de000640 1 -- 172.21.15.73:0/4029548068 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d80b2070 con 0x7f20e00b2530 2024-04-15T15:32:31.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20de000640 1 -- 172.21.15.73:0/4029548068 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d80a5a00 con 0x7f20e00b2530 2024-04-15T15:32:31.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20de000640 1 -- 172.21.15.73:0/4029548068 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d80a5dd0 con 0x7f20e00b2530 2024-04-15T15:32:31.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 -- 172.21.15.73:0/4029548068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b2530 msgr2=0x7f20e015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 --2- 172.21.15.73:0/4029548068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b2530 0x7f20e015d2e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009d90 tx=0x7f20d801c940 comp rx=0 tx=0).stop 2024-04-15T15:32:31.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 -- 172.21.15.73:0/4029548068 shutdown_connections 2024-04-15T15:32:31.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 --2- 172.21.15.73:0/4029548068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b2530 0x7f20e015d2e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 -- 172.21.15.73:0/4029548068 >> 172.21.15.73:0/4029548068 conn(0x7f20e0067dd0 msgr2=0x7f20e00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:31.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 -- 172.21.15.73:0/4029548068 shutdown_connections 2024-04-15T15:32:31.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 -- 172.21.15.73:0/4029548068 wait complete. 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 Processor -- start 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 -- start start 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b20b0 0x7f20e013fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20e00b2530 0x7f20e013dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20e0146110 0x7f20e013c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f20e00b3d70 con 0x7f20e00b20b0 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f20e00b2980 con 0x7f20e0146110 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20e6600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f20e015dc30 con 0x7f20e00b2530 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20df400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b20b0 0x7f20e013fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20df400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b20b0 0x7f20e013fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58478/0 (socket says 172.21.15.73:58478) 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20df400640 1 -- 172.21.15.73:0/1953898988 learned_addr learned my addr 172.21.15.73:0/1953898988 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20dfe00640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20e0146110 0x7f20e013c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.173+0000 7f20dea00640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20e00b2530 0x7f20e013dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20df400640 1 -- 172.21.15.73:0/1953898988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20e00b2530 msgr2=0x7f20e013dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20df400640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20e00b2530 0x7f20e013dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20df400640 1 -- 172.21.15.73:0/1953898988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20e0146110 msgr2=0x7f20e013c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20df400640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20e0146110 0x7f20e013c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20df400640 1 -- 172.21.15.73:0/1953898988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e013e160 con 0x7f20e00b20b0 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20dea00640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20e00b2530 0x7f20e013dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20df400640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b20b0 0x7f20e013fea0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c400 tx=0x7f20c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20d7400640 1 -- 172.21.15.73:0/1953898988 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8017070 con 0x7f20e00b20b0 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20d7400640 1 -- 172.21.15.73:0/1953898988 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c8005cf0 con 0x7f20e00b20b0 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20e6600640 1 -- 172.21.15.73:0/1953898988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e013e3e0 con 0x7f20e00b20b0 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20d7400640 1 -- 172.21.15.73:0/1953898988 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c80072d0 con 0x7f20e00b20b0 2024-04-15T15:32:31.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20e6600640 1 -- 172.21.15.73:0/1953898988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e013e9a0 con 0x7f20e00b20b0 2024-04-15T15:32:31.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20e6600640 1 -- 172.21.15.73:0/1953898988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e0068ab0 con 0x7f20e00b20b0 2024-04-15T15:32:31.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.177+0000 7f20d7400640 1 -- 172.21.15.73:0/1953898988 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f20c801a070 con 0x7f20e00b20b0 2024-04-15T15:32:31.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.181+0000 7f20d7400640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20bc068380 0x7f20bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.181+0000 7f20d7400640 1 -- 172.21.15.73:0/1953898988 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f20c8085ff0 con 0x7f20e00b20b0 2024-04-15T15:32:31.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.181+0000 7f20dea00640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20bc068380 0x7f20bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.181+0000 7f20dea00640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20bc068380 0x7f20bc06a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f20e00ccb20 tx=0x7f20d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:31.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.185+0000 7f20d7400640 1 -- 172.21.15.73:0/1953898988 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20e013e160 con 0x7f20e00b20b0 2024-04-15T15:32:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.341+0000 7f20e6600640 1 -- 172.21.15.73:0/1953898988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20e013eba0 con 0x7f20e00b20b0 2024-04-15T15:32:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20d7400640 1 -- 172.21.15.73:0/1953898988 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7f20c8055b80 con 0x7f20e00b20b0 2024-04-15T15:32:31.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:31.344 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:31.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 -- 172.21.15.73:0/1953898988 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20bc068380 msgr2=0x7f20bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20bc068380 0x7f20bc06a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f20e00ccb20 tx=0x7f20d0009040 comp rx=0 tx=0).stop 2024-04-15T15:32:31.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 -- 172.21.15.73:0/1953898988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b20b0 msgr2=0x7f20e013fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b20b0 0x7f20e013fea0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c400 tx=0x7f20c800c8c0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 -- 172.21.15.73:0/1953898988 shutdown_connections 2024-04-15T15:32:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20e0146110 0x7f20e013c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f20bc068380 0x7f20bc06a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20e00b2530 0x7f20e013dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 --2- 172.21.15.73:0/1953898988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20e00b20b0 0x7f20e013fea0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 -- 172.21.15.73:0/1953898988 >> 172.21.15.73:0/1953898988 conn(0x7f20e0067dd0 msgr2=0x7f20e0144720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 -- 172.21.15.73:0/1953898988 shutdown_connections 2024-04-15T15:32:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.345+0000 7f20e6600640 1 -- 172.21.15.73:0/1953898988 wait complete. 2024-04-15T15:32:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:31.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:31.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9847800640 1 Processor -- start 2024-04-15T15:32:31.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9847800640 1 -- start start 2024-04-15T15:32:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9847800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f984015c6d0 0x7f98400d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9847800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f984009b170 0x7f98400d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9847800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98400cd690 con 0x7f98400cd1b0 2024-04-15T15:32:31.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9847800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f98400cd970 con 0x7f984015c6d0 2024-04-15T15:32:31.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9847800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f98400cdc50 con 0x7f984009b170 2024-04-15T15:32:31.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9845800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f984009b170 0x7f98400d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9844e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f984015c6d0 0x7f98400d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9844e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f984015c6d0 0x7f98400d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:57128/0 (socket says 172.21.15.73:57128) 2024-04-15T15:32:31.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9844e00640 1 -- 172.21.15.73:0/565940361 learned_addr learned my addr 172.21.15.73:0/565940361 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:31.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f983fe00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f98400cd1b0 0x7f984009aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:38994/0 (socket says 172.21.15.73:38994) 2024-04-15T15:32:31.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9845800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f984009b170 0x7f98400d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:45628/0 (socket says 172.21.15.73:45628) 2024-04-15T15:32:31.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9845800640 1 -- 172.21.15.73:0/565940361 >> v2:172.21.15.118:3300/0 conn(0x7f984015c6d0 msgr2=0x7f98400d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:31.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9845800640 1 --2- 172.21.15.73:0/565940361 >> v2:172.21.15.118:3300/0 conn(0x7f984015c6d0 0x7f98400d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9845800640 1 -- 172.21.15.73:0/565940361 >> v1:172.21.15.118:6789/0 conn(0x7f98400cd1b0 legacy=0x7f984009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9845800640 1 -- 172.21.15.73:0/565940361 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98400cdf30 con 0x7f984009b170 2024-04-15T15:32:31.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.505+0000 7f9844e00640 1 --2- 172.21.15.73:0/565940361 >> v2:172.21.15.118:3300/0 conn(0x7f984015c6d0 0x7f98400d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:31.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.509+0000 7f9845800640 1 --2- 172.21.15.73:0/565940361 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f984009b170 0x7f98400d12b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f98380097c0 tx=0x7f983801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c46dc402f3273de server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:31.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.509+0000 7f983f400640 1 -- 172.21.15.73:0/565940361 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380aa5f0 con 0x7f984009b170 2024-04-15T15:32:31.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.509+0000 7f983f400640 1 -- 172.21.15.73:0/565940361 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98380af070 con 0x7f984009b170 2024-04-15T15:32:31.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.509+0000 7f983f400640 1 -- 172.21.15.73:0/565940361 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380aa9b0 con 0x7f984009b170 2024-04-15T15:32:31.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 -- 172.21.15.73:0/565940361 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f984009b170 msgr2=0x7f98400d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 --2- 172.21.15.73:0/565940361 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f984009b170 0x7f98400d12b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f98380097c0 tx=0x7f983801c470 comp rx=0 tx=0).stop 2024-04-15T15:32:31.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 -- 172.21.15.73:0/565940361 shutdown_connections 2024-04-15T15:32:31.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 --2- 172.21.15.73:0/565940361 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f984009b170 0x7f98400d12b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 --2- 172.21.15.73:0/565940361 >> v2:172.21.15.118:3300/0 conn(0x7f984015c6d0 0x7f98400d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 -- 172.21.15.73:0/565940361 >> 172.21.15.73:0/565940361 conn(0x7f98400b3fe0 msgr2=0x7f98400b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:31.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 -- 172.21.15.73:0/565940361 shutdown_connections 2024-04-15T15:32:31.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 -- 172.21.15.73:0/565940361 wait complete. 2024-04-15T15:32:31.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 Processor -- start 2024-04-15T15:32:31.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 -- start start 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f984009b170 0x7f9840154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98400cd1b0 0x7f9840157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984015c6d0 0x7f9840153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98400b1c60 con 0x7f984015c6d0 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f98400b1ae0 con 0x7f984009b170 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9847800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f984006fdf0 con 0x7f98400cd1b0 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9845800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984015c6d0 0x7f9840153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9845800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984015c6d0 0x7f9840153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58480/0 (socket says 172.21.15.73:58480) 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9845800640 1 -- 172.21.15.73:0/2755106600 learned_addr learned my addr 172.21.15.73:0/2755106600 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f983fe00640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98400cd1b0 0x7f9840157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9844e00640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f984009b170 0x7f9840154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9845800640 1 -- 172.21.15.73:0/2755106600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98400cd1b0 msgr2=0x7f9840157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9845800640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98400cd1b0 0x7f9840157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9845800640 1 -- 172.21.15.73:0/2755106600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f984009b170 msgr2=0x7f9840154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9845800640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f984009b170 0x7f9840154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.513+0000 7f9845800640 1 -- 172.21.15.73:0/2755106600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9840156180 con 0x7f984015c6d0 2024-04-15T15:32:31.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f9845800640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984015c6d0 0x7f9840153ee0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98380ac040 tx=0x7f983801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:31.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f983cc00640 1 -- 172.21.15.73:0/2755106600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380b4810 con 0x7f984015c6d0 2024-04-15T15:32:31.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f983cc00640 1 -- 172.21.15.73:0/2755106600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98380b49b0 con 0x7f984015c6d0 2024-04-15T15:32:31.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f983cc00640 1 -- 172.21.15.73:0/2755106600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380b4da0 con 0x7f984015c6d0 2024-04-15T15:32:31.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f9847800640 1 -- 172.21.15.73:0/2755106600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9840156460 con 0x7f984015c6d0 2024-04-15T15:32:31.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f9847800640 1 -- 172.21.15.73:0/2755106600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9840156a20 con 0x7f984015c6d0 2024-04-15T15:32:31.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f9847800640 1 -- 172.21.15.73:0/2755106600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9840068ab0 con 0x7f984015c6d0 2024-04-15T15:32:31.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f983cc00640 1 -- 172.21.15.73:0/2755106600 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98380bc020 con 0x7f984015c6d0 2024-04-15T15:32:31.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f983cc00640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9820068380 0x7f982006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f983cc00640 1 -- 172.21.15.73:0/2755106600 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f98381213c0 con 0x7f984015c6d0 2024-04-15T15:32:31.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.517+0000 7f9844e00640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9820068380 0x7f982006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.521+0000 7f9844e00640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9820068380 0x7f982006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9840158e10 tx=0x7f983000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:31.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.521+0000 7f983cc00640 1 -- 172.21.15.73:0/2755106600 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9838016090 con 0x7f984015c6d0 2024-04-15T15:32:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.681+0000 7f9847800640 1 -- 172.21.15.73:0/2755106600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98400b4d80 con 0x7f984015c6d0 2024-04-15T15:32:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.681+0000 7f983cc00640 1 -- 172.21.15.73:0/2755106600 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f98380aae20 con 0x7f984015c6d0 2024-04-15T15:32:31.683 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:31.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 -- 172.21.15.73:0/2755106600 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9820068380 msgr2=0x7f982006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9820068380 0x7f982006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9840158e10 tx=0x7f983000b040 comp rx=0 tx=0).stop 2024-04-15T15:32:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 -- 172.21.15.73:0/2755106600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984015c6d0 msgr2=0x7f9840153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984015c6d0 0x7f9840153ee0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98380ac040 tx=0x7f983801acb0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 -- 172.21.15.73:0/2755106600 shutdown_connections 2024-04-15T15:32:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984015c6d0 0x7f9840153ee0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9820068380 0x7f982006a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98400cd1b0 0x7f9840157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 --2- 172.21.15.73:0/2755106600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f984009b170 0x7f9840154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 -- 172.21.15.73:0/2755106600 >> 172.21.15.73:0/2755106600 conn(0x7f98400b3fe0 msgr2=0x7f98400d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 -- 172.21.15.73:0/2755106600 shutdown_connections 2024-04-15T15:32:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.685+0000 7f9847800640 1 -- 172.21.15.73:0/2755106600 wait complete. 2024-04-15T15:32:31.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:31.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03db200640 1 Processor -- start 2024-04-15T15:32:31.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03db200640 1 -- start start 2024-04-15T15:32:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03db200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03dc15c490 0x7f03dc0cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03db200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f03dc0d1580 0x7f03dc1600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03db200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03dc0ccac0 con 0x7f03dc160620 2024-04-15T15:32:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03db200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f03dc160a90 con 0x7f03dc15c490 2024-04-15T15:32:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03db200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f03dc0ccda0 con 0x7f03dc0d1580 2024-04-15T15:32:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03d9e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03dc15c490 0x7f03dc0cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03d9e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03dc15c490 0x7f03dc0cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58486/0 (socket says 172.21.15.73:58486) 2024-04-15T15:32:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03d9e00640 1 -- 172.21.15.73:0/3306228292 learned_addr learned my addr 172.21.15.73:0/3306228292 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03d9400640 1 --2- 172.21.15.73:0/3306228292 >> v2:172.21.15.118:3300/0 conn(0x7f03dc0d1580 0x7f03dc1600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03d9e00640 1 -- 172.21.15.73:0/3306228292 >> v2:172.21.15.118:3300/0 conn(0x7f03dc0d1580 msgr2=0x7f03dc1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:31.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03d9e00640 1 --2- 172.21.15.73:0/3306228292 >> v2:172.21.15.118:3300/0 conn(0x7f03dc0d1580 0x7f03dc1600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03d9e00640 1 -- 172.21.15.73:0/3306228292 >> v1:172.21.15.118:6789/0 conn(0x7f03dc160620 legacy=0x7f03dc0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.841+0000 7f03d9e00640 1 -- 172.21.15.73:0/3306228292 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc0d1ad0 con 0x7f03dc15c490 2024-04-15T15:32:31.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03d9e00640 1 --2- 172.21.15.73:0/3306228292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc15c490 0x7f03dc0cf0f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009e50 tx=0x7f03cc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ba71bec81a5485 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:31.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03d8a00640 1 -- 172.21.15.73:0/3306228292 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0a57c0 con 0x7f03dc15c490 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03d8a00640 1 -- 172.21.15.73:0/3306228292 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03cc0a5960 con 0x7f03dc15c490 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03d8a00640 1 -- 172.21.15.73:0/3306228292 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0a5d30 con 0x7f03dc15c490 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03db200640 1 -- 172.21.15.73:0/3306228292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc15c490 msgr2=0x7f03dc0cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03db200640 1 --2- 172.21.15.73:0/3306228292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc15c490 0x7f03dc0cf0f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009e50 tx=0x7f03cc01c9c0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03db200640 1 -- 172.21.15.73:0/3306228292 shutdown_connections 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03db200640 1 --2- 172.21.15.73:0/3306228292 >> v2:172.21.15.118:3300/0 conn(0x7f03dc0d1580 0x7f03dc1600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03db200640 1 --2- 172.21.15.73:0/3306228292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc15c490 0x7f03dc0cf0f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03db200640 1 -- 172.21.15.73:0/3306228292 >> 172.21.15.73:0/3306228292 conn(0x7f03dc06ba50 msgr2=0x7f03dc06be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03db200640 1 -- 172.21.15.73:0/3306228292 shutdown_connections 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.845+0000 7f03db200640 1 -- 172.21.15.73:0/3306228292 wait complete. 2024-04-15T15:32:31.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03db200640 1 Processor -- start 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03db200640 1 -- start start 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03db200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc0d1580 0x7f03dc15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03db200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03dc15c490 0x7f03dc0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03db200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03dc160620 0x7f03dc15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03db200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc0cf7b0 con 0x7f03dc0d1580 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03db200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc0cf630 con 0x7f03dc160620 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03db200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f03dc0b5200 con 0x7f03dc15c490 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc0d1580 0x7f03dc15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc0d1580 0x7f03dc15ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58492/0 (socket says 172.21.15.73:58492) 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d9e00640 1 -- 172.21.15.73:0/1106675333 learned_addr learned my addr 172.21.15.73:0/1106675333 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d9400640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03dc15c490 0x7f03dc0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03da800640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03dc160620 0x7f03dc15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d9e00640 1 -- 172.21.15.73:0/1106675333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03dc15c490 msgr2=0x7f03dc0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d9e00640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03dc15c490 0x7f03dc0c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d9e00640 1 -- 172.21.15.73:0/1106675333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03dc160620 msgr2=0x7f03dc15b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:31.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d9e00640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03dc160620 0x7f03dc15b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:31.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d9e00640 1 -- 172.21.15.73:0/1106675333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc0c9f40 con 0x7f03dc0d1580 2024-04-15T15:32:31.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d9e00640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc0d1580 0x7f03dc15ee20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0af040 tx=0x7f03cc019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:31.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d2000640 1 -- 172.21.15.73:0/1106675333 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc009250 con 0x7f03dc0d1580 2024-04-15T15:32:31.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d2000640 1 -- 172.21.15.73:0/1106675333 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03cc0b8680 con 0x7f03dc0d1580 2024-04-15T15:32:31.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03db200640 1 -- 172.21.15.73:0/1106675333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03dc0ca220 con 0x7f03dc0d1580 2024-04-15T15:32:31.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03d2000640 1 -- 172.21.15.73:0/1106675333 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0b8a70 con 0x7f03dc0d1580 2024-04-15T15:32:31.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.849+0000 7f03db200640 1 -- 172.21.15.73:0/1106675333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03dc0ca7e0 con 0x7f03dc0d1580 2024-04-15T15:32:31.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.853+0000 7f03db200640 1 -- 172.21.15.73:0/1106675333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03dc04fd60 con 0x7f03dc0d1580 2024-04-15T15:32:31.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.853+0000 7f03d2000640 1 -- 172.21.15.73:0/1106675333 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f03cc0c0020 con 0x7f03dc0d1580 2024-04-15T15:32:31.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.853+0000 7f03d2000640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f03bc068380 0x7f03bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:31.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.853+0000 7f03d2000640 1 -- 172.21.15.73:0/1106675333 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f03cc121a40 con 0x7f03dc0d1580 2024-04-15T15:32:31.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.853+0000 7f03d9400640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f03bc068380 0x7f03bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:31.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.853+0000 7f03d9400640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f03bc068380 0x7f03bc06a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0d0180 tx=0x7f03c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:31.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:31.857+0000 7f03d2000640 1 -- 172.21.15.73:0/1106675333 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f03cc0165e0 con 0x7f03dc0d1580 2024-04-15T15:32:32.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.013+0000 7f03db200640 1 -- 172.21.15.73:0/1106675333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f03dc15ff40 con 0x7f03dc0d1580 2024-04-15T15:32:32.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03d2000640 1 -- 172.21.15.73:0/1106675333 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f03cc0f1b50 con 0x7f03dc0d1580 2024-04-15T15:32:32.017 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:32.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 -- 172.21.15.73:0/1106675333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f03bc068380 msgr2=0x7f03bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f03bc068380 0x7f03bc06a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0d0180 tx=0x7f03c8008040 comp rx=0 tx=0).stop 2024-04-15T15:32:32.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 -- 172.21.15.73:0/1106675333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc0d1580 msgr2=0x7f03dc15ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc0d1580 0x7f03dc15ee20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0af040 tx=0x7f03cc019760 comp rx=0 tx=0).stop 2024-04-15T15:32:32.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 -- 172.21.15.73:0/1106675333 shutdown_connections 2024-04-15T15:32:32.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03dc160620 0x7f03dc15b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f03bc068380 0x7f03bc06a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03dc15c490 0x7f03dc0c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 --2- 172.21.15.73:0/1106675333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc0d1580 0x7f03dc15ee20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 -- 172.21.15.73:0/1106675333 >> 172.21.15.73:0/1106675333 conn(0x7f03dc06ba50 msgr2=0x7f03dc0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:32.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 -- 172.21.15.73:0/1106675333 shutdown_connections 2024-04-15T15:32:32.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.017+0000 7f03db200640 1 -- 172.21.15.73:0/1106675333 wait complete. 2024-04-15T15:32:32.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:32.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.173+0000 7f31cc400640 1 Processor -- start 2024-04-15T15:32:32.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.173+0000 7f31cc400640 1 -- start start 2024-04-15T15:32:32.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31cc400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f31c415b5d0 0x7f31c415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31cc400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31c40b3e30 0x7f31c40b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31cc400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31c40b25f0 0x7f31c40b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31cc400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f31c415b9b0 con 0x7f31c40b3e30 2024-04-15T15:32:32.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31cc400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f31c4070160 con 0x7f31c415b5d0 2024-04-15T15:32:32.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31cc400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f31c415f1f0 con 0x7f31c40b25f0 2024-04-15T15:32:32.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31c9000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31c40b3e30 0x7f31c40b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31c9000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31c40b3e30 0x7f31c40b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58504/0 (socket says 172.21.15.73:58504) 2024-04-15T15:32:32.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31c9000640 1 -- 172.21.15.73:0/1385336089 learned_addr learned my addr 172.21.15.73:0/1385336089 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:32.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31ca400640 1 --2- 172.21.15.73:0/1385336089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31c40b25f0 0x7f31c40b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31c9a00640 1 --2- 172.21.15.73:0/1385336089 >> v2:172.21.15.118:3300/0 conn(0x7f31c415b5d0 0x7f31c415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31c9000640 1 -- 172.21.15.73:0/1385336089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31c40b25f0 msgr2=0x7f31c40b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:32.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31c9000640 1 --2- 172.21.15.73:0/1385336089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31c40b25f0 0x7f31c40b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31c9000640 1 -- 172.21.15.73:0/1385336089 >> v2:172.21.15.118:3300/0 conn(0x7f31c415b5d0 msgr2=0x7f31c415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:32.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31c9000640 1 --2- 172.21.15.73:0/1385336089 >> v2:172.21.15.118:3300/0 conn(0x7f31c415b5d0 0x7f31c415fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.177+0000 7f31c9000640 1 -- 172.21.15.73:0/1385336089 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c406fe80 con 0x7f31c40b3e30 2024-04-15T15:32:32.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31c9000640 1 --2- 172.21.15.73:0/1385336089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c40b3e30 0x7f31c40b20b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009870 tx=0x7f31b001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21689eff319b1847 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:32.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31c3e00640 1 -- 172.21.15.73:0/1385336089 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b00b0070 con 0x7f31c40b3e30 2024-04-15T15:32:32.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31c3e00640 1 -- 172.21.15.73:0/1385336089 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b00ab400 con 0x7f31c40b3e30 2024-04-15T15:32:32.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31c3e00640 1 -- 172.21.15.73:0/1385336089 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b00ab7d0 con 0x7f31c40b3e30 2024-04-15T15:32:32.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 -- 172.21.15.73:0/1385336089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c40b3e30 msgr2=0x7f31c40b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 --2- 172.21.15.73:0/1385336089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c40b3e30 0x7f31c40b20b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009870 tx=0x7f31b001c400 comp rx=0 tx=0).stop 2024-04-15T15:32:32.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 -- 172.21.15.73:0/1385336089 shutdown_connections 2024-04-15T15:32:32.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 --2- 172.21.15.73:0/1385336089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31c40b25f0 0x7f31c40b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 --2- 172.21.15.73:0/1385336089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c40b3e30 0x7f31c40b20b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 --2- 172.21.15.73:0/1385336089 >> v2:172.21.15.118:3300/0 conn(0x7f31c415b5d0 0x7f31c415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 -- 172.21.15.73:0/1385336089 >> 172.21.15.73:0/1385336089 conn(0x7f31c4067dd0 msgr2=0x7f31c40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:32.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 -- 172.21.15.73:0/1385336089 shutdown_connections 2024-04-15T15:32:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 -- 172.21.15.73:0/1385336089 wait complete. 2024-04-15T15:32:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 Processor -- start 2024-04-15T15:32:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.181+0000 7f31cc400640 1 -- start start 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31cc400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31c40b25f0 0x7f31c4155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31cc400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c40b3e30 0x7f31c4147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31cc400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c415b5d0 0x7f31c4157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31cc400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f31c406faa0 con 0x7f31c415b5d0 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31cc400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f31c40cfd00 con 0x7f31c40b3e30 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31cc400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f31c406fc20 con 0x7f31c40b25f0 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31ca400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c415b5d0 0x7f31c4157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31c9a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31c40b25f0 0x7f31c4155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31ca400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c415b5d0 0x7f31c4157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58520/0 (socket says 172.21.15.73:58520) 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31ca400640 1 -- 172.21.15.73:0/3313937489 learned_addr learned my addr 172.21.15.73:0/3313937489 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:32.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31c9000640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c40b3e30 0x7f31c4147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31ca400640 1 -- 172.21.15.73:0/3313937489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31c40b25f0 msgr2=0x7f31c4155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31ca400640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31c40b25f0 0x7f31c4155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31ca400640 1 -- 172.21.15.73:0/3313937489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c40b3e30 msgr2=0x7f31c4147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31ca400640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c40b3e30 0x7f31c4147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31ca400640 1 -- 172.21.15.73:0/3313937489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c4155400 con 0x7f31c415b5d0 2024-04-15T15:32:32.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31ca400640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c415b5d0 0x7f31c4157bd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00d560 tx=0x7f31bc00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:32.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31c1600640 1 -- 172.21.15.73:0/3313937489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0125f0 con 0x7f31c415b5d0 2024-04-15T15:32:32.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31c1600640 1 -- 172.21.15.73:0/3313937489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31bc019070 con 0x7f31c415b5d0 2024-04-15T15:32:32.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31cc400640 1 -- 172.21.15.73:0/3313937489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c4155d50 con 0x7f31c415b5d0 2024-04-15T15:32:32.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31c1600640 1 -- 172.21.15.73:0/3313937489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0129f0 con 0x7f31c415b5d0 2024-04-15T15:32:32.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31cc400640 1 -- 172.21.15.73:0/3313937489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c4156310 con 0x7f31c415b5d0 2024-04-15T15:32:32.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31cc400640 1 -- 172.21.15.73:0/3313937489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c4068ab0 con 0x7f31c415b5d0 2024-04-15T15:32:32.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.185+0000 7f31c1600640 1 -- 172.21.15.73:0/3313937489 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31bc012b90 con 0x7f31c415b5d0 2024-04-15T15:32:32.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.189+0000 7f31c1600640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31a4068380 0x7f31a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.189+0000 7f31c1600640 1 -- 172.21.15.73:0/3313937489 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f31bc087120 con 0x7f31c415b5d0 2024-04-15T15:32:32.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.189+0000 7f31c9a00640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31a4068380 0x7f31a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.189+0000 7f31c9a00640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31a4068380 0x7f31a406a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31b80039f0 tx=0x7f31b8009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:32.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.193+0000 7f31c1600640 1 -- 172.21.15.73:0/3313937489 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31bc056be0 con 0x7f31c415b5d0 2024-04-15T15:32:32.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 -- 172.21.15.73:0/3313937489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f31c406f370 con 0x7f31c415b5d0 2024-04-15T15:32:32.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31c1600640 1 -- 172.21.15.73:0/3313937489 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f31bc05aee0 con 0x7f31c415b5d0 2024-04-15T15:32:32.350 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 -- 172.21.15.73:0/3313937489 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31a4068380 msgr2=0x7f31a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31a4068380 0x7f31a406a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31b80039f0 tx=0x7f31b8009830 comp rx=0 tx=0).stop 2024-04-15T15:32:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 -- 172.21.15.73:0/3313937489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c415b5d0 msgr2=0x7f31c4157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c415b5d0 0x7f31c4157bd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00d560 tx=0x7f31bc00da20 comp rx=0 tx=0).stop 2024-04-15T15:32:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 -- 172.21.15.73:0/3313937489 shutdown_connections 2024-04-15T15:32:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31c415b5d0 0x7f31c4157bd0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c40b3e30 0x7f31c4147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31a4068380 0x7f31a406a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 --2- 172.21.15.73:0/3313937489 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31c40b25f0 0x7f31c4155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 -- 172.21.15.73:0/3313937489 >> 172.21.15.73:0/3313937489 conn(0x7f31c4067dd0 msgr2=0x7f31c40b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:32.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 -- 172.21.15.73:0/3313937489 shutdown_connections 2024-04-15T15:32:32.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.349+0000 7f31cc400640 1 -- 172.21.15.73:0/3313937489 wait complete. 2024-04-15T15:32:32.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.509+0000 7fa1e9600640 1 Processor -- start 2024-04-15T15:32:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.509+0000 7fa1e9600640 1 -- start start 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e9600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1e415b560 0x7fa1e406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e9600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa1e40af610 0x7fa1e40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e9600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e40ce620 con 0x7fa1e40d0450 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e9600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e406dc10 con 0x7fa1e40af610 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e9600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e406def0 con 0x7fa1e415b560 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e3400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa1e40af610 0x7fa1e40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e3400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa1e40af610 0x7fa1e40cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58530/0 (socket says 172.21.15.73:58530) 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e3400640 1 -- 172.21.15.73:0/706161189 learned_addr learned my addr 172.21.15.73:0/706161189 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e3e00640 1 --2- 172.21.15.73:0/706161189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1e415b560 0x7fa1e406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e3400640 1 -- 172.21.15.73:0/706161189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1e415b560 msgr2=0x7fa1e406e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e3400640 1 --2- 172.21.15.73:0/706161189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1e415b560 0x7fa1e406e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e3400640 1 -- 172.21.15.73:0/706161189 >> v1:172.21.15.118:6789/0 conn(0x7fa1e40d0450 legacy=0x7fa1e40d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e3400640 1 -- 172.21.15.73:0/706161189 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e40ce330 con 0x7fa1e40af610 2024-04-15T15:32:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e3400640 1 --2- 172.21.15.73:0/706161189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e40af610 0x7fa1e40cddf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009870 tx=0x7fa1d001e6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04a4ea8dbbeae68 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e2a00640 1 -- 172.21.15.73:0/706161189 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00a9070 con 0x7fa1e40af610 2024-04-15T15:32:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e2a00640 1 -- 172.21.15.73:0/706161189 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d00b2070 con 0x7fa1e40af610 2024-04-15T15:32:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.513+0000 7fa1e2a00640 1 -- 172.21.15.73:0/706161189 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00ad890 con 0x7fa1e40af610 2024-04-15T15:32:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 -- 172.21.15.73:0/706161189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e40af610 msgr2=0x7fa1e40cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 --2- 172.21.15.73:0/706161189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e40af610 0x7fa1e40cddf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009870 tx=0x7fa1d001e6a0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 -- 172.21.15.73:0/706161189 shutdown_connections 2024-04-15T15:32:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 --2- 172.21.15.73:0/706161189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e40af610 0x7fa1e40cddf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 --2- 172.21.15.73:0/706161189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1e415b560 0x7fa1e406e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 -- 172.21.15.73:0/706161189 >> 172.21.15.73:0/706161189 conn(0x7fa1e406bc20 msgr2=0x7fa1e406c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 -- 172.21.15.73:0/706161189 shutdown_connections 2024-04-15T15:32:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 -- 172.21.15.73:0/706161189 wait complete. 2024-04-15T15:32:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 Processor -- start 2024-04-15T15:32:32.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 -- start start 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e40af610 0x7fa1e41f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1e40d0450 0x7fa1e4164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e415b560 0x7fa1e40ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e40b4110 con 0x7fa1e415b560 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e40b3f90 con 0x7fa1e40af610 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e9600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e40b4290 con 0x7fa1e40d0450 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e415b560 0x7fa1e40ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e415b560 0x7fa1e40ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58532/0 (socket says 172.21.15.73:58532) 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e8c00640 1 -- 172.21.15.73:0/3010542129 learned_addr learned my addr 172.21.15.73:0/3010542129 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e3400640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1e40d0450 0x7fa1e4164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.517+0000 7fa1e3e00640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e40af610 0x7fa1e41f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1e8c00640 1 -- 172.21.15.73:0/3010542129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1e40d0450 msgr2=0x7fa1e4164540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1e8c00640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1e40d0450 0x7fa1e4164540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1e8c00640 1 -- 172.21.15.73:0/3010542129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e40af610 msgr2=0x7fa1e41f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1e8c00640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e40af610 0x7fa1e41f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1e8c00640 1 -- 172.21.15.73:0/3010542129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e41f6ca0 con 0x7fa1e415b560 2024-04-15T15:32:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1e8c00640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e415b560 0x7fa1e40ae1d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00c3f0 tx=0x7fa1dc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1dbe00640 1 -- 172.21.15.73:0/3010542129 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc011790 con 0x7fa1e415b560 2024-04-15T15:32:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1dbe00640 1 -- 172.21.15.73:0/3010542129 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1dc017070 con 0x7fa1e415b560 2024-04-15T15:32:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1e9600640 1 -- 172.21.15.73:0/3010542129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e4164d90 con 0x7fa1e415b560 2024-04-15T15:32:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1dbe00640 1 -- 172.21.15.73:0/3010542129 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc011b70 con 0x7fa1e415b560 2024-04-15T15:32:32.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1e9600640 1 -- 172.21.15.73:0/3010542129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e4165350 con 0x7fa1e415b560 2024-04-15T15:32:32.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1e9600640 1 -- 172.21.15.73:0/3010542129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e404fd60 con 0x7fa1e415b560 2024-04-15T15:32:32.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1dbe00640 1 -- 172.21.15.73:0/3010542129 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa1dc011d10 con 0x7fa1e415b560 2024-04-15T15:32:32.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1dbe00640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa1c4068380 0x7fa1c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1dbe00640 1 -- 172.21.15.73:0/3010542129 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fa1dc086a80 con 0x7fa1e415b560 2024-04-15T15:32:32.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.521+0000 7fa1e3e00640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa1c4068380 0x7fa1c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.525+0000 7fa1e3e00640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa1c4068380 0x7fa1c406a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4003ab0 tx=0x7fa1d4009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.525+0000 7fa1dbe00640 1 -- 172.21.15.73:0/3010542129 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1dc088e20 con 0x7fa1e415b560 2024-04-15T15:32:32.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.685+0000 7fa1e9600640 1 -- 172.21.15.73:0/3010542129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa1e4164a80 con 0x7fa1e415b560 2024-04-15T15:32:32.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.685+0000 7fa1dbe00640 1 -- 172.21.15.73:0/3010542129 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fa1dc0565d0 con 0x7fa1e415b560 2024-04-15T15:32:32.687 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:32.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 -- 172.21.15.73:0/3010542129 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa1c4068380 msgr2=0x7fa1c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa1c4068380 0x7fa1c406a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4003ab0 tx=0x7fa1d4009830 comp rx=0 tx=0).stop 2024-04-15T15:32:32.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 -- 172.21.15.73:0/3010542129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e415b560 msgr2=0x7fa1e40ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e415b560 0x7fa1e40ae1d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00c3f0 tx=0x7fa1dc00c8b0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 -- 172.21.15.73:0/3010542129 shutdown_connections 2024-04-15T15:32:32.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1e415b560 0x7fa1e40ae1d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa1c4068380 0x7fa1c406a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1e40d0450 0x7fa1e4164540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 --2- 172.21.15.73:0/3010542129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e40af610 0x7fa1e41f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 -- 172.21.15.73:0/3010542129 >> 172.21.15.73:0/3010542129 conn(0x7fa1e406bc20 msgr2=0x7fa1e4153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:32.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 -- 172.21.15.73:0/3010542129 shutdown_connections 2024-04-15T15:32:32.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.689+0000 7fa1e9600640 1 -- 172.21.15.73:0/3010542129 wait complete. 2024-04-15T15:32:32.708 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:32:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.841+0000 7fb51f600640 1 Processor -- start 2024-04-15T15:32:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.841+0000 7fb51f600640 1 -- start start 2024-04-15T15:32:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51f600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb5180b27c0 0x7fb51815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51f600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5180b3e30 0x7fb5180b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51f600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb518070160 con 0x7fb51815b5d0 2024-04-15T15:32:32.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51f600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb51815b9b0 con 0x7fb5180b3e30 2024-04-15T15:32:32.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51f600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb51815f1f0 con 0x7fb5180b27c0 2024-04-15T15:32:32.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51cc00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb51815b5d0 0x7fb5180b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57864/0 (socket says 172.21.15.73:57864) 2024-04-15T15:32:32.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51cc00640 1 -- 172.21.15.73:0/1748914202 learned_addr learned my addr 172.21.15.73:0/1748914202 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51d600640 1 --2- 172.21.15.73:0/1748914202 >> v2:172.21.15.73:3300/0 conn(0x7fb5180b3e30 0x7fb5180b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb517e00640 1 --2- 172.21.15.73:0/1748914202 >> v2:172.21.15.118:3300/0 conn(0x7fb5180b27c0 0x7fb51815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb517400640 1 -- 172.21.15.73:0/1748914202 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424334906 0 0) 0x7fb518070160 con 0x7fb51815b5d0 2024-04-15T15:32:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb517400640 1 -- 172.21.15.73:0/1748914202 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4fc005740 con 0x7fb51815b5d0 2024-04-15T15:32:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51d600640 1 -- 172.21.15.73:0/1748914202 >> v2:172.21.15.118:3300/0 conn(0x7fb5180b27c0 msgr2=0x7fb51815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51d600640 1 --2- 172.21.15.73:0/1748914202 >> v2:172.21.15.118:3300/0 conn(0x7fb5180b27c0 0x7fb51815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51d600640 1 -- 172.21.15.73:0/1748914202 >> v1:172.21.15.73:6789/0 conn(0x7fb51815b5d0 legacy=0x7fb5180b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.845+0000 7fb51d600640 1 -- 172.21.15.73:0/1748914202 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51806fe80 con 0x7fb5180b3e30 2024-04-15T15:32:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51d600640 1 --2- 172.21.15.73:0/1748914202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b3e30 0x7fb5180b4740 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb5180b2c50 tx=0x7fb51001c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66284538233b27f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb517400640 1 -- 172.21.15.73:0/1748914202 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5100b2070 con 0x7fb5180b3e30 2024-04-15T15:32:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb517400640 1 -- 172.21.15.73:0/1748914202 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5100a56a0 con 0x7fb5180b3e30 2024-04-15T15:32:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb517400640 1 -- 172.21.15.73:0/1748914202 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5100a5a70 con 0x7fb5180b3e30 2024-04-15T15:32:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51f600640 1 -- 172.21.15.73:0/1748914202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b3e30 msgr2=0x7fb5180b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51f600640 1 --2- 172.21.15.73:0/1748914202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b3e30 0x7fb5180b4740 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb5180b2c50 tx=0x7fb51001c7e0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51f600640 1 -- 172.21.15.73:0/1748914202 shutdown_connections 2024-04-15T15:32:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51f600640 1 --2- 172.21.15.73:0/1748914202 >> v2:172.21.15.118:3300/0 conn(0x7fb5180b27c0 0x7fb51815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51f600640 1 --2- 172.21.15.73:0/1748914202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b3e30 0x7fb5180b4740 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51f600640 1 -- 172.21.15.73:0/1748914202 >> 172.21.15.73:0/1748914202 conn(0x7fb518067dd0 msgr2=0x7fb5180d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51f600640 1 -- 172.21.15.73:0/1748914202 shutdown_connections 2024-04-15T15:32:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51f600640 1 -- 172.21.15.73:0/1748914202 wait complete. 2024-04-15T15:32:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51f600640 1 Processor -- start 2024-04-15T15:32:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.849+0000 7fb51f600640 1 -- start start 2024-04-15T15:32:32.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51f600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b27c0 0x7fb518151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51f600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180b3e30 0x7fb51814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51f600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb51815b5d0 0x7fb51814f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51f600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb51806faa0 con 0x7fb5180b27c0 2024-04-15T15:32:32.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51f600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb5180b4240 con 0x7fb5180b3e30 2024-04-15T15:32:32.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51f600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb51806fc20 con 0x7fb51815b5d0 2024-04-15T15:32:32.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b27c0 0x7fb518151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b27c0 0x7fb518151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58552/0 (socket says 172.21.15.73:58552) 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51cc00640 1 -- 172.21.15.73:0/581560565 learned_addr learned my addr 172.21.15.73:0/581560565 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51d600640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb51815b5d0 0x7fb51814f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb517e00640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180b3e30 0x7fb51814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51cc00640 1 -- 172.21.15.73:0/581560565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb51815b5d0 msgr2=0x7fb51814f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51cc00640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb51815b5d0 0x7fb51814f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51cc00640 1 -- 172.21.15.73:0/581560565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180b3e30 msgr2=0x7fb51814eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51cc00640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180b3e30 0x7fb51814eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51cc00640 1 -- 172.21.15.73:0/581560565 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5180b1450 con 0x7fb5180b27c0 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb517e00640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180b3e30 0x7fb51814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51cc00640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b27c0 0x7fb518151c70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb50800c450 tx=0x7fb50800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb514c00640 1 -- 172.21.15.73:0/581560565 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508017070 con 0x7fb5180b27c0 2024-04-15T15:32:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb514c00640 1 -- 172.21.15.73:0/581560565 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb508005cf0 con 0x7fb5180b27c0 2024-04-15T15:32:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51f600640 1 -- 172.21.15.73:0/581560565 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5180b1730 con 0x7fb5180b27c0 2024-04-15T15:32:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb514c00640 1 -- 172.21.15.73:0/581560565 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508007290 con 0x7fb5180b27c0 2024-04-15T15:32:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51f600640 1 -- 172.21.15.73:0/581560565 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5180b1cf0 con 0x7fb5180b27c0 2024-04-15T15:32:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb51f600640 1 -- 172.21.15.73:0/581560565 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb518068ab0 con 0x7fb5180b27c0 2024-04-15T15:32:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.853+0000 7fb514c00640 1 -- 172.21.15.73:0/581560565 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb50801a070 con 0x7fb5180b27c0 2024-04-15T15:32:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.857+0000 7fb514c00640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f8068380 0x7fb4f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.857+0000 7fb514c00640 1 -- 172.21.15.73:0/581560565 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fb508086220 con 0x7fb5180b27c0 2024-04-15T15:32:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.857+0000 7fb517e00640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f8068380 0x7fb4f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:32.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.857+0000 7fb517e00640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f8068380 0x7fb4f806a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5180ccb00 tx=0x7fb50400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:32.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:32.861+0000 7fb514c00640 1 -- 172.21.15.73:0/581560565 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb508056330 con 0x7fb5180b27c0 2024-04-15T15:32:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 -- 172.21.15.73:0/581560565 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb5180afc90 con 0x7fb5180b27c0 2024-04-15T15:32:33.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb514c00640 1 -- 172.21.15.73:0/581560565 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fb508055c30 con 0x7fb5180b27c0 2024-04-15T15:32:33.030 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-15T15:32:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 -- 172.21.15.73:0/581560565 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f8068380 msgr2=0x7fb4f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f8068380 0x7fb4f806a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5180ccb00 tx=0x7fb50400d040 comp rx=0 tx=0).stop 2024-04-15T15:32:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 -- 172.21.15.73:0/581560565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b27c0 msgr2=0x7fb518151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b27c0 0x7fb518151c70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb50800c450 tx=0x7fb50800c910 comp rx=0 tx=0).stop 2024-04-15T15:32:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 -- 172.21.15.73:0/581560565 shutdown_connections 2024-04-15T15:32:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f8068380 0x7fb4f806a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb51815b5d0 0x7fb51814f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180b3e30 0x7fb51814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 --2- 172.21.15.73:0/581560565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180b27c0 0x7fb518151c70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 -- 172.21.15.73:0/581560565 >> 172.21.15.73:0/581560565 conn(0x7fb518067dd0 msgr2=0x7fb5181598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 -- 172.21.15.73:0/581560565 shutdown_connections 2024-04-15T15:32:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.029+0000 7fb51f600640 1 -- 172.21.15.73:0/581560565 wait complete. 2024-04-15T15:32:33.050 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-15T15:32:33.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:33.051 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-15T15:32:33.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:32:33.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:33.077 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-15T15:32:33.128 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:32:33.129 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-15T15:32:33.129 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:32:33.132 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:32:33.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c3600640 1 Processor -- start 2024-04-15T15:32:33.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c3600640 1 -- start start 2024-04-15T15:32:33.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c3600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc4bc15b5d0 0x7fc4bc15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c3600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 0x7fc4bc0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c3600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc070160 con 0x7fc4bc0b3e30 2024-04-15T15:32:33.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c3600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc4bc15b9b0 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c3600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc4bc15f1f0 con 0x7fc4bc0b27c0 2024-04-15T15:32:33.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c1600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 0x7fc4bc0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c1600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 0x7fc4bc0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:45698/0 (socket says 172.21.15.73:45698) 2024-04-15T15:32:33.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c1600640 1 -- 172.21.15.73:0/1243957193 learned_addr learned my addr 172.21.15.73:0/1243957193 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:33.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c0c00640 1 --2- 172.21.15.73:0/1243957193 >> v2:172.21.15.118:3300/0 conn(0x7fc4bc15b5d0 0x7fc4bc15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c1600640 1 -- 172.21.15.73:0/1243957193 >> v2:172.21.15.118:3300/0 conn(0x7fc4bc15b5d0 msgr2=0x7fc4bc15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:33.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c1600640 1 --2- 172.21.15.73:0/1243957193 >> v2:172.21.15.118:3300/0 conn(0x7fc4bc15b5d0 0x7fc4bc15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c1600640 1 -- 172.21.15.73:0/1243957193 >> v1:172.21.15.118:6789/0 conn(0x7fc4bc0b3e30 legacy=0x7fc4bc0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c1600640 1 -- 172.21.15.73:0/1243957193 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc06fe80 con 0x7fc4bc0b27c0 2024-04-15T15:32:33.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.265+0000 7fc4c0c00640 1 --2- 172.21.15.73:0/1243957193 >> v2:172.21.15.118:3300/0 conn(0x7fc4bc15b5d0 0x7fc4bc15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:33.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4c1600640 1 --2- 172.21.15.73:0/1243957193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 0x7fc4bc0b4740 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009e80 tx=0x7fc4b401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8c624d72e236575 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:33.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4bbe00640 1 -- 172.21.15.73:0/1243957193 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b40090d0 con 0x7fc4bc0b27c0 2024-04-15T15:32:33.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4bbe00640 1 -- 172.21.15.73:0/1243957193 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b40a5780 con 0x7fc4bc0b27c0 2024-04-15T15:32:33.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4bbe00640 1 -- 172.21.15.73:0/1243957193 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4009270 con 0x7fc4bc0b27c0 2024-04-15T15:32:33.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4c3600640 1 -- 172.21.15.73:0/1243957193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 msgr2=0x7fc4bc0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4c3600640 1 --2- 172.21.15.73:0/1243957193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 0x7fc4bc0b4740 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009e80 tx=0x7fc4b401c8c0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4c3600640 1 -- 172.21.15.73:0/1243957193 shutdown_connections 2024-04-15T15:32:33.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4c3600640 1 --2- 172.21.15.73:0/1243957193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 0x7fc4bc0b4740 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4c3600640 1 --2- 172.21.15.73:0/1243957193 >> v2:172.21.15.118:3300/0 conn(0x7fc4bc15b5d0 0x7fc4bc15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4c3600640 1 -- 172.21.15.73:0/1243957193 >> 172.21.15.73:0/1243957193 conn(0x7fc4bc067dd0 msgr2=0x7fc4bc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:33.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4c3600640 1 -- 172.21.15.73:0/1243957193 shutdown_connections 2024-04-15T15:32:33.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.269+0000 7fc4c3600640 1 -- 172.21.15.73:0/1243957193 wait complete. 2024-04-15T15:32:33.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c3600640 1 Processor -- start 2024-04-15T15:32:33.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c3600640 1 -- start start 2024-04-15T15:32:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c3600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 0x7fc4bc150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c3600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc0b3e30 0x7fc4bc141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c3600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4bc15b5d0 0x7fc4bc15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c3600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc06faa0 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c3600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc0b4240 con 0x7fc4bc0b3e30 2024-04-15T15:32:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c3600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc4bc06fc20 con 0x7fc4bc0b27c0 2024-04-15T15:32:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c1600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4bc15b5d0 0x7fc4bc15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c1600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4bc15b5d0 0x7fc4bc15cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58564/0 (socket says 172.21.15.73:58564) 2024-04-15T15:32:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c1600640 1 -- 172.21.15.73:0/2367350527 learned_addr learned my addr 172.21.15.73:0/2367350527 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4b3e00640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc0b3e30 0x7fc4bc141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c0c00640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 0x7fc4bc150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c1600640 1 -- 172.21.15.73:0/2367350527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 msgr2=0x7fc4bc150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c1600640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 0x7fc4bc150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c1600640 1 -- 172.21.15.73:0/2367350527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc0b3e30 msgr2=0x7fc4bc141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c1600640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc0b3e30 0x7fc4bc141dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c1600640 1 -- 172.21.15.73:0/2367350527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc15d4a0 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c1600640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4bc15b5d0 0x7fc4bc15cf60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009e80 tx=0x7fc4b4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4b9600640 1 -- 172.21.15.73:0/2367350527 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b40bc020 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4b9600640 1 -- 172.21.15.73:0/2367350527 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b40b8670 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4b9600640 1 -- 172.21.15.73:0/2367350527 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b40b8a60 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c3600640 1 -- 172.21.15.73:0/2367350527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4bc15e630 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.273+0000 7fc4c3600640 1 -- 172.21.15.73:0/2367350527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4bc15c760 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.277+0000 7fc4c3600640 1 -- 172.21.15.73:0/2367350527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4bc15c550 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.277+0000 7fc4b9600640 1 -- 172.21.15.73:0/2367350527 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4b40bf020 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.277+0000 7fc4b9600640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4980683b0 0x7fc49806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.277+0000 7fc4b9600640 1 -- 172.21.15.73:0/2367350527 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fc4b4121ac0 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.277+0000 7fc4c0c00640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4980683b0 0x7fc49806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.277+0000 7fc4c0c00640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4980683b0 0x7fc49806a870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc15e3b0 tx=0x7fc4ac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.281+0000 7fc4b9600640 1 -- 172.21.15.73:0/2367350527 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc4b40c6070 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.473+0000 7fc4c3600640 1 -- 172.21.15.73:0/2367350527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4bc068ab0 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4b9600640 1 -- 172.21.15.73:0/2367350527 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7fc4bc15d4a0 con 0x7fc4bc15b5d0 2024-04-15T15:32:33.477 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:33.477 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:31:33.826027+0000","modified":"2024-04-15T15:31:52.268632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-15T15:32:33.477 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-04-15T15:32:33.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 -- 172.21.15.73:0/2367350527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4980683b0 msgr2=0x7fc49806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4980683b0 0x7fc49806a870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc15e3b0 tx=0x7fc4ac009190 comp rx=0 tx=0).stop 2024-04-15T15:32:33.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 -- 172.21.15.73:0/2367350527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4bc15b5d0 msgr2=0x7fc4bc15cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4bc15b5d0 0x7fc4bc15cf60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009e80 tx=0x7fc4b4019660 comp rx=0 tx=0).stop 2024-04-15T15:32:33.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 -- 172.21.15.73:0/2367350527 shutdown_connections 2024-04-15T15:32:33.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4bc15b5d0 0x7fc4bc15cf60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc0b3e30 0x7fc4bc141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4980683b0 0x7fc49806a870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 --2- 172.21.15.73:0/2367350527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4bc0b27c0 0x7fc4bc150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 -- 172.21.15.73:0/2367350527 >> 172.21.15.73:0/2367350527 conn(0x7fc4bc067dd0 msgr2=0x7fc4bc0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:33.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 -- 172.21.15.73:0/2367350527 shutdown_connections 2024-04-15T15:32:33.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.477+0000 7fc4c3600640 1 -- 172.21.15.73:0/2367350527 wait complete. 2024-04-15T15:32:33.499 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:33.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.633+0000 7f2ec5600640 1 Processor -- start 2024-04-15T15:32:33.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.633+0000 7f2ec5600640 1 -- start start 2024-04-15T15:32:33.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ec5600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ec015e760 0x7f2ec0073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ec5600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ec0070130 0x7f2ec006ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ec5600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec00b4810 con 0x7f2ec006cfa0 2024-04-15T15:32:33.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ec5600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec00cd2f0 con 0x7f2ec0070130 2024-04-15T15:32:33.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ec5600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec00b45c0 con 0x7f2ec015e760 2024-04-15T15:32:33.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebf400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2ec006cfa0 0x7f2ec0162410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57880/0 (socket says 172.21.15.73:57880) 2024-04-15T15:32:33.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebf400640 1 -- 172.21.15.73:0/2774677183 learned_addr learned my addr 172.21.15.73:0/2774677183 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:33.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebe000640 1 --2- 172.21.15.73:0/2774677183 >> v2:172.21.15.73:3300/0 conn(0x7f2ec0070130 0x7f2ec006ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebea00640 1 --2- 172.21.15.73:0/2774677183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ec015e760 0x7f2ec0073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebe000640 1 -- 172.21.15.73:0/2774677183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ec015e760 msgr2=0x7f2ec0073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:33.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebe000640 1 --2- 172.21.15.73:0/2774677183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ec015e760 0x7f2ec0073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebe000640 1 -- 172.21.15.73:0/2774677183 >> v1:172.21.15.73:6789/0 conn(0x7f2ec006cfa0 legacy=0x7f2ec0162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebe000640 1 -- 172.21.15.73:0/2774677183 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec00b4af0 con 0x7f2ec0070130 2024-04-15T15:32:33.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebd600640 1 -- 172.21.15.73:0/2774677183 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793043817 0 0) 0x7f2ec00b4810 con 0x7f2ec006cfa0 2024-04-15T15:32:33.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebe000640 1 --2- 172.21.15.73:0/2774677183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 0x7f2ec006ca60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0097c0 tx=0x7f2eac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c4cf7dc1143c10 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:33.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebd600640 1 -- 172.21.15.73:0/2774677183 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0b2070 con 0x7f2ec0070130 2024-04-15T15:32:33.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebd600640 1 -- 172.21.15.73:0/2774677183 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ad640 con 0x7f2ec0070130 2024-04-15T15:32:33.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.637+0000 7f2ebd600640 1 -- 172.21.15.73:0/2774677183 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0ada10 con 0x7f2ec0070130 2024-04-15T15:32:33.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 -- 172.21.15.73:0/2774677183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 msgr2=0x7f2ec006ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 --2- 172.21.15.73:0/2774677183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 0x7f2ec006ca60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0097c0 tx=0x7f2eac01c4a0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 -- 172.21.15.73:0/2774677183 shutdown_connections 2024-04-15T15:32:33.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 --2- 172.21.15.73:0/2774677183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 0x7f2ec006ca60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 --2- 172.21.15.73:0/2774677183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ec015e760 0x7f2ec0073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 -- 172.21.15.73:0/2774677183 >> 172.21.15.73:0/2774677183 conn(0x7f2ec0072590 msgr2=0x7f2ec0072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:33.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 -- 172.21.15.73:0/2774677183 shutdown_connections 2024-04-15T15:32:33.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 -- 172.21.15.73:0/2774677183 wait complete. 2024-04-15T15:32:33.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 Processor -- start 2024-04-15T15:32:33.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 -- start start 2024-04-15T15:32:33.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ec006cfa0 0x7f2ec014bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 0x7f2ec014c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ec015e760 0x7f2ec00b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec016b930 con 0x7f2ec0070130 2024-04-15T15:32:33.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec016b7b0 con 0x7f2ec015e760 2024-04-15T15:32:33.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ec5600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec016bab0 con 0x7f2ec006cfa0 2024-04-15T15:32:33.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ebe000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 0x7f2ec014c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ebe000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 0x7f2ec014c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58586/0 (socket says 172.21.15.73:58586) 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ebe000640 1 -- 172.21.15.73:0/3299101029 learned_addr learned my addr 172.21.15.73:0/3299101029 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ebf400640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ec015e760 0x7f2ec00b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ebea00640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ec006cfa0 0x7f2ec014bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ebe000640 1 -- 172.21.15.73:0/3299101029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ec006cfa0 msgr2=0x7f2ec014bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ebe000640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ec006cfa0 0x7f2ec014bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ebe000640 1 -- 172.21.15.73:0/3299101029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ec015e760 msgr2=0x7f2ec00b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ebe000640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ec015e760 0x7f2ec00b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.641+0000 7f2ebe000640 1 -- 172.21.15.73:0/3299101029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec014c330 con 0x7f2ec0070130 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.645+0000 7f2ebe000640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 0x7f2ec014c560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2eac01a0d0 tx=0x7f2eac019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.645+0000 7f2eb6a00640 1 -- 172.21.15.73:0/3299101029 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0ba020 con 0x7f2ec0070130 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.645+0000 7f2eb6a00640 1 -- 172.21.15.73:0/3299101029 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac0b6630 con 0x7f2ec0070130 2024-04-15T15:32:33.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.645+0000 7f2eb6a00640 1 -- 172.21.15.73:0/3299101029 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0b2040 con 0x7f2ec0070130 2024-04-15T15:32:33.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.645+0000 7f2ec5600640 1 -- 172.21.15.73:0/3299101029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec014cfe0 con 0x7f2ec0070130 2024-04-15T15:32:33.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.645+0000 7f2ec5600640 1 -- 172.21.15.73:0/3299101029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec014d5a0 con 0x7f2ec0070130 2024-04-15T15:32:33.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.645+0000 7f2ec5600640 1 -- 172.21.15.73:0/3299101029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec0068ab0 con 0x7f2ec0070130 2024-04-15T15:32:33.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.645+0000 7f2eb6a00640 1 -- 172.21.15.73:0/3299101029 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2eac0bd020 con 0x7f2ec0070130 2024-04-15T15:32:33.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.649+0000 7f2eb6a00640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2ea00683d0 0x7f2ea006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.649+0000 7f2eb6a00640 1 -- 172.21.15.73:0/3299101029 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f2eac120be0 con 0x7f2ec0070130 2024-04-15T15:32:33.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.649+0000 7f2ebea00640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2ea00683d0 0x7f2ea006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.649+0000 7f2ebea00640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2ea00683d0 0x7f2ea006a890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0153660 tx=0x7f2eb0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:33.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.653+0000 7f2eb6a00640 1 -- 172.21.15.73:0/3299101029 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2eac0c4030 con 0x7f2ec0070130 2024-04-15T15:32:33.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.809+0000 7f2ec5600640 1 -- 172.21.15.73:0/3299101029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ec0073260 con 0x7f2ec0070130 2024-04-15T15:32:33.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.809+0000 7f2eb6a00640 1 -- 172.21.15.73:0/3299101029 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7f2eac016090 con 0x7f2ec0070130 2024-04-15T15:32:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:33.811 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:33.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 -- 172.21.15.73:0/3299101029 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2ea00683d0 msgr2=0x7f2ea006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2ea00683d0 0x7f2ea006a890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0153660 tx=0x7f2eb0008040 comp rx=0 tx=0).stop 2024-04-15T15:32:33.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 -- 172.21.15.73:0/3299101029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 msgr2=0x7f2ec014c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 0x7f2ec014c560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2eac01a0d0 tx=0x7f2eac019240 comp rx=0 tx=0).stop 2024-04-15T15:32:33.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 -- 172.21.15.73:0/3299101029 shutdown_connections 2024-04-15T15:32:33.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ec015e760 0x7f2ec00b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ec0070130 0x7f2ec014c560 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2ea00683d0 0x7f2ea006a890 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 --2- 172.21.15.73:0/3299101029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ec006cfa0 0x7f2ec014bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 -- 172.21.15.73:0/3299101029 >> 172.21.15.73:0/3299101029 conn(0x7f2ec0072590 msgr2=0x7f2ec0153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:33.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 -- 172.21.15.73:0/3299101029 shutdown_connections 2024-04-15T15:32:33.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.813+0000 7f2ec5600640 1 -- 172.21.15.73:0/3299101029 wait complete. 2024-04-15T15:32:33.832 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:31:31.544543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:31:32.789874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T15:31:36.482495+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T15:32:33.832 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:33.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.969+0000 7f0456a00640 1 Processor -- start 2024-04-15T15:32:33.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.969+0000 7f0456a00640 1 -- start start 2024-04-15T15:32:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.969+0000 7f0456a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f04500b20b0 0x7f04500b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.969+0000 7f0456a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04500cd3a0 con 0x7f0450146110 2024-04-15T15:32:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.969+0000 7f0456a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04500b5160 con 0x7f045015cbd0 2024-04-15T15:32:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.969+0000 7f0456a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f04500b40c0 con 0x7f04500b20b0 2024-04-15T15:32:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.969+0000 7f044fe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0450146110 0x7f04500cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57896/0 (socket says 172.21.15.73:57896) 2024-04-15T15:32:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.969+0000 7f044fe00640 1 -- 172.21.15.73:0/280591899 learned_addr learned my addr 172.21.15.73:0/280591899 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.969+0000 7f0447400640 1 --2- 172.21.15.73:0/280591899 >> v2:172.21.15.73:3300/0 conn(0x7f04500b20b0 0x7f04500b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.973+0000 7f0447400640 1 -- 172.21.15.73:0/280591899 >> v1:172.21.15.118:6789/0 conn(0x7f045015cbd0 legacy=0x7f045015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.973+0000 7f0447400640 1 -- 172.21.15.73:0/280591899 >> v1:172.21.15.73:6789/0 conn(0x7f0450146110 legacy=0x7f04500cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.973+0000 7f0447400640 1 -- 172.21.15.73:0/280591899 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04500b43a0 con 0x7f04500b20b0 2024-04-15T15:32:33.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.973+0000 7f0447400640 1 --2- 172.21.15.73:0/280591899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 0x7f04500b2530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f04380097c0 tx=0x7f043801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d5dc8e2db1c156 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:33.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.973+0000 7f044f400640 1 -- 172.21.15.73:0/280591899 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04380b1070 con 0x7f04500b20b0 2024-04-15T15:32:33.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.973+0000 7f044f400640 1 -- 172.21.15.73:0/280591899 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380ac5f0 con 0x7f04500b20b0 2024-04-15T15:32:33.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.973+0000 7f044f400640 1 -- 172.21.15.73:0/280591899 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04380ac9c0 con 0x7f04500b20b0 2024-04-15T15:32:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.973+0000 7f0456a00640 1 -- 172.21.15.73:0/280591899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 msgr2=0x7f04500b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.973+0000 7f0456a00640 1 --2- 172.21.15.73:0/280591899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 0x7f04500b2530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f04380097c0 tx=0x7f043801c4a0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 -- 172.21.15.73:0/280591899 shutdown_connections 2024-04-15T15:32:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 --2- 172.21.15.73:0/280591899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 0x7f04500b2530 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 -- 172.21.15.73:0/280591899 >> 172.21.15.73:0/280591899 conn(0x7f0450067dd0 msgr2=0x7f04500d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 -- 172.21.15.73:0/280591899 shutdown_connections 2024-04-15T15:32:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 -- 172.21.15.73:0/280591899 wait complete. 2024-04-15T15:32:33.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 Processor -- start 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 -- start start 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 0x7f045006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0450146110 0x7f045006f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f045015cbd0 0x7f0450139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f045016a220 con 0x7f04500b20b0 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f04500b3d70 con 0x7f0450146110 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0456a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f045016a3a0 con 0x7f045015cbd0 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f044fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 0x7f045006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f044fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 0x7f045006ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58602/0 (socket says 172.21.15.73:58602) 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f044fe00640 1 -- 172.21.15.73:0/1584844182 learned_addr learned my addr 172.21.15.73:0/1584844182 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0447400640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0450146110 0x7f045006f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f0454a00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f045015cbd0 0x7f0450139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f044fe00640 1 -- 172.21.15.73:0/1584844182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f045015cbd0 msgr2=0x7f0450139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f044fe00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f045015cbd0 0x7f0450139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f044fe00640 1 -- 172.21.15.73:0/1584844182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0450146110 msgr2=0x7f045006f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f044fe00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0450146110 0x7f045006f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f044fe00640 1 -- 172.21.15.73:0/1584844182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045006efa0 con 0x7f04500b20b0 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f044fe00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 0x7f045006ea60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f044000c500 tx=0x7f044000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.977+0000 7f044cc00640 1 -- 172.21.15.73:0/1584844182 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440017070 con 0x7f04500b20b0 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.981+0000 7f044cc00640 1 -- 172.21.15.73:0/1584844182 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0440005cf0 con 0x7f04500b20b0 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.981+0000 7f044cc00640 1 -- 172.21.15.73:0/1584844182 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04400072f0 con 0x7f04500b20b0 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.981+0000 7f0456a00640 1 -- 172.21.15.73:0/1584844182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045013de70 con 0x7f04500b20b0 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.981+0000 7f0456a00640 1 -- 172.21.15.73:0/1584844182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045013e430 con 0x7f04500b20b0 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.981+0000 7f0456a00640 1 -- 172.21.15.73:0/1584844182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0450068ab0 con 0x7f04500b20b0 2024-04-15T15:32:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.981+0000 7f044cc00640 1 -- 172.21.15.73:0/1584844182 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f044001a070 con 0x7f04500b20b0 2024-04-15T15:32:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.981+0000 7f044cc00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f042c068380 0x7f042c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.981+0000 7f044cc00640 1 -- 172.21.15.73:0/1584844182 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f04400860b0 con 0x7f04500b20b0 2024-04-15T15:32:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.981+0000 7f0447400640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f042c068380 0x7f042c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.981+0000 7f0447400640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f042c068380 0x7f042c06a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f04380ae000 tx=0x7f0438008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:33.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:33.985+0000 7f044cc00640 1 -- 172.21.15.73:0/1584844182 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f045006efa0 con 0x7f04500b20b0 2024-04-15T15:32:34.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.145+0000 7f0456a00640 1 -- 172.21.15.73:0/1584844182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0450157d40 con 0x7f04500b20b0 2024-04-15T15:32:34.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.145+0000 7f044cc00640 1 -- 172.21.15.73:0/1584844182 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f0440055c00 con 0x7f04500b20b0 2024-04-15T15:32:34.147 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 -- 172.21.15.73:0/1584844182 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f042c068380 msgr2=0x7f042c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f042c068380 0x7f042c06a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f04380ae000 tx=0x7f0438008040 comp rx=0 tx=0).stop 2024-04-15T15:32:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 -- 172.21.15.73:0/1584844182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 msgr2=0x7f045006ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 0x7f045006ea60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f044000c500 tx=0x7f044000c9c0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 -- 172.21.15.73:0/1584844182 shutdown_connections 2024-04-15T15:32:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f042c068380 0x7f042c06a840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f045015cbd0 0x7f0450139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0450146110 0x7f045006f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 --2- 172.21.15.73:0/1584844182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04500b20b0 0x7f045006ea60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 -- 172.21.15.73:0/1584844182 >> 172.21.15.73:0/1584844182 conn(0x7f0450067dd0 msgr2=0x7f0450144fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 -- 172.21.15.73:0/1584844182 shutdown_connections 2024-04-15T15:32:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.149+0000 7f0456a00640 1 -- 172.21.15.73:0/1584844182 wait complete. 2024-04-15T15:32:34.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:32:34.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca14e00640 1 Processor -- start 2024-04-15T15:32:34.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca14e00640 1 -- start start 2024-04-15T15:32:34.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca14e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fca100b20b0 0x7fca100b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca14e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca1015cbd0 0x7fca1015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca14e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca100cd3a0 con 0x7fca10146110 2024-04-15T15:32:34.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca14e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fca100b5160 con 0x7fca100b20b0 2024-04-15T15:32:34.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca14e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fca100b40c0 con 0x7fca1015cbd0 2024-04-15T15:32:34.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca0de00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fca10146110 0x7fca100cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57912/0 (socket says 172.21.15.73:57912) 2024-04-15T15:32:34.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca0de00640 1 -- 172.21.15.73:0/25489490 learned_addr learned my addr 172.21.15.73:0/25489490 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca05400640 1 --2- 172.21.15.73:0/25489490 >> v2:172.21.15.73:3300/0 conn(0x7fca100b20b0 0x7fca100b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca0e800640 1 --2- 172.21.15.73:0/25489490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca1015cbd0 0x7fca1015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca0d400640 1 -- 172.21.15.73:0/25489490 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396011648 0 0) 0x7fca100cd3a0 con 0x7fca10146110 2024-04-15T15:32:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca0d400640 1 -- 172.21.15.73:0/25489490 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9f4003530 con 0x7fca10146110 2024-04-15T15:32:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca05400640 1 -- 172.21.15.73:0/25489490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca1015cbd0 msgr2=0x7fca1015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca05400640 1 --2- 172.21.15.73:0/25489490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca1015cbd0 0x7fca1015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca05400640 1 -- 172.21.15.73:0/25489490 >> v1:172.21.15.73:6789/0 conn(0x7fca10146110 legacy=0x7fca100cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.309+0000 7fca05400640 1 -- 172.21.15.73:0/25489490 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca100b43a0 con 0x7fca100b20b0 2024-04-15T15:32:34.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca05400640 1 --2- 172.21.15.73:0/25489490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca100b20b0 0x7fca100b2530 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc9f80097c0 tx=0x7fc9f801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37bc339dead18224 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:34.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca0d400640 1 -- 172.21.15.73:0/25489490 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f80b2070 con 0x7fca100b20b0 2024-04-15T15:32:34.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca0d400640 1 -- 172.21.15.73:0/25489490 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f80ad640 con 0x7fca100b20b0 2024-04-15T15:32:34.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca0d400640 1 -- 172.21.15.73:0/25489490 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f80ada10 con 0x7fca100b20b0 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca14e00640 1 -- 172.21.15.73:0/25489490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca100b20b0 msgr2=0x7fca100b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca14e00640 1 --2- 172.21.15.73:0/25489490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca100b20b0 0x7fca100b2530 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc9f80097c0 tx=0x7fc9f801c4a0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca14e00640 1 -- 172.21.15.73:0/25489490 shutdown_connections 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca14e00640 1 --2- 172.21.15.73:0/25489490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca1015cbd0 0x7fca1015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca14e00640 1 --2- 172.21.15.73:0/25489490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca100b20b0 0x7fca100b2530 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca14e00640 1 -- 172.21.15.73:0/25489490 >> 172.21.15.73:0/25489490 conn(0x7fca10067dd0 msgr2=0x7fca100d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca14e00640 1 -- 172.21.15.73:0/25489490 shutdown_connections 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.313+0000 7fca14e00640 1 -- 172.21.15.73:0/25489490 wait complete. 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 Processor -- start 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 -- start start 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca100b20b0 0x7fca1013dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca10146110 0x7fca1006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1015cbd0 0x7fca10156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fca10169210 con 0x7fca1015cbd0 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fca100b3d70 con 0x7fca100b20b0 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fca10169390 con 0x7fca10146110 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca0e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1015cbd0 0x7fca10156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca0e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1015cbd0 0x7fca10156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58624/0 (socket says 172.21.15.73:58624) 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca0e800640 1 -- 172.21.15.73:0/1129598882 learned_addr learned my addr 172.21.15.73:0/1129598882 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca0de00640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca100b20b0 0x7fca1013dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca05400640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca10146110 0x7fca1006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca0e800640 1 -- 172.21.15.73:0/1129598882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca10146110 msgr2=0x7fca1006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca0e800640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca10146110 0x7fca1006bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca0e800640 1 -- 172.21.15.73:0/1129598882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca100b20b0 msgr2=0x7fca1013dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca0e800640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca100b20b0 0x7fca1013dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca0e800640 1 -- 172.21.15.73:0/1129598882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca10141bb0 con 0x7fca1015cbd0 2024-04-15T15:32:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca0e800640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1015cbd0 0x7fca10156b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fca08007e90 tx=0x7fca0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca06a00640 1 -- 172.21.15.73:0/1129598882 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08014420 con 0x7fca1015cbd0 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca06a00640 1 -- 172.21.15.73:0/1129598882 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca08019070 con 0x7fca1015cbd0 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 -- 172.21.15.73:0/1129598882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca10141e90 con 0x7fca1015cbd0 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca06a00640 1 -- 172.21.15.73:0/1129598882 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08014800 con 0x7fca1015cbd0 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 -- 172.21.15.73:0/1129598882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca10143b50 con 0x7fca1015cbd0 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.317+0000 7fca14e00640 1 -- 172.21.15.73:0/1129598882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca10068ab0 con 0x7fca1015cbd0 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.321+0000 7fca06a00640 1 -- 172.21.15.73:0/1129598882 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fca080149a0 con 0x7fca1015cbd0 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.321+0000 7fca06a00640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc9ec068380 0x7fc9ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.321+0000 7fca06a00640 1 -- 172.21.15.73:0/1129598882 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7fca080875d0 con 0x7fca1015cbd0 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.321+0000 7fca0de00640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc9ec068380 0x7fc9ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.321+0000 7fca0de00640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc9ec068380 0x7fc9ec06a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca00007fd0 tx=0x7fca00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:34.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.325+0000 7fca06a00640 1 -- 172.21.15.73:0/1129598882 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca08057000 con 0x7fca1015cbd0 2024-04-15T15:32:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 -- 172.21.15.73:0/1129598882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fca1015b790 con 0x7fca1015cbd0 2024-04-15T15:32:34.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca06a00640 1 -- 172.21.15.73:0/1129598882 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fca0805b300 con 0x7fca1015cbd0 2024-04-15T15:32:34.485 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 -- 172.21.15.73:0/1129598882 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc9ec068380 msgr2=0x7fc9ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc9ec068380 0x7fc9ec06a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca00007fd0 tx=0x7fca00009040 comp rx=0 tx=0).stop 2024-04-15T15:32:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 -- 172.21.15.73:0/1129598882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1015cbd0 msgr2=0x7fca10156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1015cbd0 0x7fca10156b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fca08007e90 tx=0x7fca0800e4b0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 -- 172.21.15.73:0/1129598882 shutdown_connections 2024-04-15T15:32:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1015cbd0 0x7fca10156b90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc9ec068380 0x7fc9ec06a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca10146110 0x7fca1006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 --2- 172.21.15.73:0/1129598882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca100b20b0 0x7fca1013dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 -- 172.21.15.73:0/1129598882 >> 172.21.15.73:0/1129598882 conn(0x7fca10067dd0 msgr2=0x7fca1015abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 -- 172.21.15.73:0/1129598882 shutdown_connections 2024-04-15T15:32:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.485+0000 7fca14e00640 1 -- 172.21.15.73:0/1129598882 wait complete. 2024-04-15T15:32:34.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:32:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3e800640 1 Processor -- start 2024-04-15T15:32:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3e800640 1 -- start start 2024-04-15T15:32:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3e800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efe380d2a60 0x7efe381630f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3e800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe38162450 con 0x7efe38162070 2024-04-15T15:32:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3e800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe380d0180 con 0x7efe3806e7c0 2024-04-15T15:32:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3e800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7efe380d0460 con 0x7efe380d2a60 2024-04-15T15:32:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3d400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efe38162070 0x7efe380d2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57922/0 (socket says 172.21.15.73:57922) 2024-04-15T15:32:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3d400640 1 -- 172.21.15.73:0/2097798301 learned_addr learned my addr 172.21.15.73:0/2097798301 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3ca00640 1 --2- 172.21.15.73:0/2097798301 >> v2:172.21.15.118:3300/0 conn(0x7efe380d2a60 0x7efe381630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3ca00640 1 -- 172.21.15.73:0/2097798301 >> v1:172.21.15.118:6789/0 conn(0x7efe3806e7c0 legacy=0x7efe3806cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3ca00640 1 -- 172.21.15.73:0/2097798301 >> v1:172.21.15.73:6789/0 conn(0x7efe38162070 legacy=0x7efe380d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.649+0000 7efe3ca00640 1 -- 172.21.15.73:0/2097798301 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe380d0740 con 0x7efe380d2a60 2024-04-15T15:32:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe3ca00640 1 --2- 172.21.15.73:0/2097798301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe380d2a60 0x7efe381630f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efe240097c0 tx=0x7efe2401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c96cc9e6e51c15 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe37e00640 1 -- 172.21.15.73:0/2097798301 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe240b0070 con 0x7efe380d2a60 2024-04-15T15:32:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe37e00640 1 -- 172.21.15.73:0/2097798301 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe240ab600 con 0x7efe380d2a60 2024-04-15T15:32:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe37e00640 1 -- 172.21.15.73:0/2097798301 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe240ab9d0 con 0x7efe380d2a60 2024-04-15T15:32:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe3e800640 1 -- 172.21.15.73:0/2097798301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe380d2a60 msgr2=0x7efe381630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe3e800640 1 --2- 172.21.15.73:0/2097798301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe380d2a60 0x7efe381630f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efe240097c0 tx=0x7efe2401c410 comp rx=0 tx=0).stop 2024-04-15T15:32:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe3e800640 1 -- 172.21.15.73:0/2097798301 shutdown_connections 2024-04-15T15:32:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe3e800640 1 --2- 172.21.15.73:0/2097798301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe380d2a60 0x7efe381630f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe3e800640 1 -- 172.21.15.73:0/2097798301 >> 172.21.15.73:0/2097798301 conn(0x7efe3806fe30 msgr2=0x7efe38070240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe3e800640 1 -- 172.21.15.73:0/2097798301 shutdown_connections 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.653+0000 7efe3e800640 1 -- 172.21.15.73:0/2097798301 wait complete. 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 Processor -- start 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 -- start start 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe3806e7c0 0x7efe38155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe380d2a60 0x7efe381609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe38162070 0x7efe3815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efe3816cde0 con 0x7efe38162070 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efe3816cc60 con 0x7efe380d2a60 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efe3816cf60 con 0x7efe3806e7c0 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe38162070 0x7efe3815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3d400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe3806e7c0 0x7efe38155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe38162070 0x7efe3815e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58626/0 (socket says 172.21.15.73:58626) 2024-04-15T15:32:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3de00640 1 -- 172.21.15.73:0/3470521804 learned_addr learned my addr 172.21.15.73:0/3470521804 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3ca00640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe380d2a60 0x7efe381609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3de00640 1 -- 172.21.15.73:0/3470521804 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe3806e7c0 msgr2=0x7efe38155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3de00640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe3806e7c0 0x7efe38155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3de00640 1 -- 172.21.15.73:0/3470521804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe380d2a60 msgr2=0x7efe381609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3de00640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe380d2a60 0x7efe381609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3de00640 1 -- 172.21.15.73:0/3470521804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3815a7b0 con 0x7efe38162070 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3de00640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe38162070 0x7efe3815e420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c770 tx=0x7efe3000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe35600640 1 -- 172.21.15.73:0/3470521804 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe30003b80 con 0x7efe38162070 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe35600640 1 -- 172.21.15.73:0/3470521804 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe30003d20 con 0x7efe38162070 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe35600640 1 -- 172.21.15.73:0/3470521804 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3000aa30 con 0x7efe38162070 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 -- 172.21.15.73:0/3470521804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3815aa90 con 0x7efe38162070 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 -- 172.21.15.73:0/3470521804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3815b050 con 0x7efe38162070 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.657+0000 7efe3e800640 1 -- 172.21.15.73:0/3470521804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3804fd60 con 0x7efe38162070 2024-04-15T15:32:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.661+0000 7efe35600640 1 -- 172.21.15.73:0/3470521804 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe3000abd0 con 0x7efe38162070 2024-04-15T15:32:34.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.661+0000 7efe35600640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efe18068380 0x7efe1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.661+0000 7efe35600640 1 -- 172.21.15.73:0/3470521804 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7efe30086bf0 con 0x7efe38162070 2024-04-15T15:32:34.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.661+0000 7efe3d400640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efe18068380 0x7efe1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.661+0000 7efe3d400640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efe18068380 0x7efe1806a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efe2c005890 tx=0x7efe2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:34.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.665+0000 7efe35600640 1 -- 172.21.15.73:0/3470521804 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe300566b0 con 0x7efe38162070 2024-04-15T15:32:34.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 -- 172.21.15.73:0/3470521804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efe380d3250 con 0x7efe38162070 2024-04-15T15:32:34.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe35600640 1 -- 172.21.15.73:0/3470521804 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7efe3005a9b0 con 0x7efe38162070 2024-04-15T15:32:34.822 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:32:34.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 -- 172.21.15.73:0/3470521804 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efe18068380 msgr2=0x7efe1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efe18068380 0x7efe1806a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efe2c005890 tx=0x7efe2c009040 comp rx=0 tx=0).stop 2024-04-15T15:32:34.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 -- 172.21.15.73:0/3470521804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe38162070 msgr2=0x7efe3815e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe38162070 0x7efe3815e420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c770 tx=0x7efe3000cc30 comp rx=0 tx=0).stop 2024-04-15T15:32:34.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 -- 172.21.15.73:0/3470521804 shutdown_connections 2024-04-15T15:32:34.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe38162070 0x7efe3815e420 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe380d2a60 0x7efe381609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efe18068380 0x7efe1806a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 --2- 172.21.15.73:0/3470521804 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe3806e7c0 0x7efe38155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.821+0000 7efe3e800640 1 -- 172.21.15.73:0/3470521804 >> 172.21.15.73:0/3470521804 conn(0x7efe3806fe30 msgr2=0x7efe38070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:34.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.825+0000 7efe3e800640 1 -- 172.21.15.73:0/3470521804 shutdown_connections 2024-04-15T15:32:34.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.825+0000 7efe3e800640 1 -- 172.21.15.73:0/3470521804 wait complete. 2024-04-15T15:32:34.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T15:32:34.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.981+0000 7f0195400640 1 Processor -- start 2024-04-15T15:32:34.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.981+0000 7f0195400640 1 -- start start 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.981+0000 7f0195400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 0x7f01900b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.981+0000 7f0195400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01900cd3a0 con 0x7f019015cbd0 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.981+0000 7f0195400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01900b5160 con 0x7f0190146110 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.981+0000 7f0195400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f01900b40c0 con 0x7f01900b20b0 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f018f200640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f019015cbd0 0x7f019015d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57926/0 (socket says 172.21.15.73:57926) 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f018f200640 1 -- 172.21.15.73:0/101301310 learned_addr learned my addr 172.21.15.73:0/101301310 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f0185e00640 1 --2- 172.21.15.73:0/101301310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 0x7f01900b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f018de00640 1 -- 172.21.15.73:0/101301310 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44162847 0 0) 0x7f01900cd3a0 con 0x7f019015cbd0 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f018de00640 1 -- 172.21.15.73:0/101301310 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0174003530 con 0x7f019015cbd0 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f018de00640 1 -- 172.21.15.73:0/101301310 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618438793 0 0) 0x7f01900b5160 con 0x7f0190146110 2024-04-15T15:32:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f018de00640 1 -- 172.21.15.73:0/101301310 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01900cd3a0 con 0x7f0190146110 2024-04-15T15:32:34.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f0185e00640 1 -- 172.21.15.73:0/101301310 >> v1:172.21.15.118:6789/0 conn(0x7f0190146110 legacy=0x7f01900cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f0185e00640 1 -- 172.21.15.73:0/101301310 >> v1:172.21.15.73:6789/0 conn(0x7f019015cbd0 legacy=0x7f019015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f018de00640 1 -- 172.21.15.73:0/101301310 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2975395263 0 0) 0x7f0174003530 con 0x7f019015cbd0 2024-04-15T15:32:34.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f0185e00640 1 -- 172.21.15.73:0/101301310 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01900b43a0 con 0x7f01900b20b0 2024-04-15T15:32:34.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.985+0000 7f0185e00640 1 --2- 172.21.15.73:0/101301310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 0x7f01900b2530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01780097f0 tx=0x7f017801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55ca78e76866c804 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018de00640 1 -- 172.21.15.73:0/101301310 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01780b1070 con 0x7f01900b20b0 2024-04-15T15:32:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018de00640 1 -- 172.21.15.73:0/101301310 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01780ac630 con 0x7f01900b20b0 2024-04-15T15:32:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018de00640 1 -- 172.21.15.73:0/101301310 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01780a8050 con 0x7f01900b20b0 2024-04-15T15:32:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 -- 172.21.15.73:0/101301310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 msgr2=0x7f01900b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 --2- 172.21.15.73:0/101301310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 0x7f01900b2530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01780097f0 tx=0x7f017801c4e0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 -- 172.21.15.73:0/101301310 shutdown_connections 2024-04-15T15:32:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 --2- 172.21.15.73:0/101301310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 0x7f01900b2530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 -- 172.21.15.73:0/101301310 >> 172.21.15.73:0/101301310 conn(0x7f0190067dd0 msgr2=0x7f01900d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 -- 172.21.15.73:0/101301310 shutdown_connections 2024-04-15T15:32:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 -- 172.21.15.73:0/101301310 wait complete. 2024-04-15T15:32:34.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 Processor -- start 2024-04-15T15:32:34.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 -- start start 2024-04-15T15:32:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 0x7f0190139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0190146110 0x7f0190139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f019015cbd0 0x7f01901518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f019015db80 con 0x7f019015cbd0 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f01900b3d70 con 0x7f0190146110 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0195400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f019015dd00 con 0x7f01900b20b0 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f019015cbd0 0x7f01901518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f019015cbd0 0x7f01901518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58628/0 (socket says 172.21.15.73:58628) 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018f200640 1 -- 172.21.15.73:0/2632221438 learned_addr learned my addr 172.21.15.73:0/2632221438 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f0185e00640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0190146110 0x7f0190139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018e800640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 0x7f0190139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018f200640 1 -- 172.21.15.73:0/2632221438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 msgr2=0x7f0190139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018f200640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 0x7f0190139400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018f200640 1 -- 172.21.15.73:0/2632221438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0190146110 msgr2=0x7f0190139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018f200640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0190146110 0x7f0190139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018f200640 1 -- 172.21.15.73:0/2632221438 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01901550b0 con 0x7f019015cbd0 2024-04-15T15:32:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.989+0000 7f018e800640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 0x7f0190139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f018f200640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f019015cbd0 0x7f01901518d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f018800c390 tx=0x7f018800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f0187400640 1 -- 172.21.15.73:0/2632221438 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0188017070 con 0x7f019015cbd0 2024-04-15T15:32:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f0187400640 1 -- 172.21.15.73:0/2632221438 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0188005cf0 con 0x7f019015cbd0 2024-04-15T15:32:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f0187400640 1 -- 172.21.15.73:0/2632221438 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01880072f0 con 0x7f019015cbd0 2024-04-15T15:32:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f0195400640 1 -- 172.21.15.73:0/2632221438 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0190155390 con 0x7f019015cbd0 2024-04-15T15:32:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f0195400640 1 -- 172.21.15.73:0/2632221438 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019013f360 con 0x7f019015cbd0 2024-04-15T15:32:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f0195400640 1 -- 172.21.15.73:0/2632221438 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0190068ab0 con 0x7f019015cbd0 2024-04-15T15:32:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f0187400640 1 -- 172.21.15.73:0/2632221438 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f018801a070 con 0x7f019015cbd0 2024-04-15T15:32:34.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f0187400640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f016c068380 0x7f016c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:34.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f0187400640 1 -- 172.21.15.73:0/2632221438 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f0188086290 con 0x7f019015cbd0 2024-04-15T15:32:34.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.993+0000 7f018e800640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f016c068380 0x7f016c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:34.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.997+0000 7f018e800640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f016c068380 0x7f016c06a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0180001570 tx=0x7f0180009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:34.997+0000 7f0187400640 1 -- 172.21.15.73:0/2632221438 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01880563a0 con 0x7f019015cbd0 2024-04-15T15:32:35.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.153+0000 7f0195400640 1 -- 172.21.15.73:0/2632221438 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f019013a460 con 0x7f019015cbd0 2024-04-15T15:32:35.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0187400640 1 -- 172.21.15.73:0/2632221438 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f0188055ca0 con 0x7f019015cbd0 2024-04-15T15:32:35.156 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:32:35.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 -- 172.21.15.73:0/2632221438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f016c068380 msgr2=0x7f016c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f016c068380 0x7f016c06a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0180001570 tx=0x7f0180009040 comp rx=0 tx=0).stop 2024-04-15T15:32:35.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 -- 172.21.15.73:0/2632221438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f019015cbd0 msgr2=0x7f01901518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f019015cbd0 0x7f01901518d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f018800c390 tx=0x7f018800c850 comp rx=0 tx=0).stop 2024-04-15T15:32:35.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 -- 172.21.15.73:0/2632221438 shutdown_connections 2024-04-15T15:32:35.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f019015cbd0 0x7f01901518d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0190146110 0x7f0190139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f016c068380 0x7f016c06a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 --2- 172.21.15.73:0/2632221438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01900b20b0 0x7f0190139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 -- 172.21.15.73:0/2632221438 >> 172.21.15.73:0/2632221438 conn(0x7f0190067dd0 msgr2=0x7f01900b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:35.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 -- 172.21.15.73:0/2632221438 shutdown_connections 2024-04-15T15:32:35.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.157+0000 7f0195400640 1 -- 172.21.15.73:0/2632221438 wait complete. 2024-04-15T15:32:35.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:32:35.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef3a00640 1 Processor -- start 2024-04-15T15:32:35.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef3a00640 1 -- start start 2024-04-15T15:32:35.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef3a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4eec15e760 0x7f4eec073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef3a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec070130 0x7f4eec06ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef3a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4eec06cfa0 0x7f4eec162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef3a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4eec0cd2f0 con 0x7f4eec06cfa0 2024-04-15T15:32:35.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef3a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f4eec0b45c0 con 0x7f4eec15e760 2024-04-15T15:32:35.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef3a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4eec0b4810 con 0x7f4eec070130 2024-04-15T15:32:35.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef1a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4eec06cfa0 0x7f4eec162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef1a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4eec06cfa0 0x7f4eec162410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58636/0 (socket says 172.21.15.73:58636) 2024-04-15T15:32:35.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef1a00640 1 -- 172.21.15.73:0/3574297519 learned_addr learned my addr 172.21.15.73:0/3574297519 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:35.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ee3e00640 1 --2- 172.21.15.73:0/3574297519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec070130 0x7f4eec06ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef1000640 1 --2- 172.21.15.73:0/3574297519 >> v2:172.21.15.118:3300/0 conn(0x7f4eec15e760 0x7f4eec073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef1a00640 1 -- 172.21.15.73:0/3574297519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec070130 msgr2=0x7f4eec06ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:35.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef1a00640 1 --2- 172.21.15.73:0/3574297519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec070130 0x7f4eec06ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef1a00640 1 -- 172.21.15.73:0/3574297519 >> v2:172.21.15.118:3300/0 conn(0x7f4eec15e760 msgr2=0x7f4eec073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:35.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef1a00640 1 --2- 172.21.15.73:0/3574297519 >> v2:172.21.15.118:3300/0 conn(0x7f4eec15e760 0x7f4eec073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.313+0000 7f4ef1a00640 1 -- 172.21.15.73:0/3574297519 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eec0b4af0 con 0x7f4eec06cfa0 2024-04-15T15:32:35.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4ef1a00640 1 --2- 172.21.15.73:0/3574297519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec06cfa0 0x7f4eec162410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4eec063740 tx=0x7f4ee401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e539b448cb6e7c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:35.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4eebe00640 1 -- 172.21.15.73:0/3574297519 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40ac070 con 0x7f4eec06cfa0 2024-04-15T15:32:35.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4eebe00640 1 -- 172.21.15.73:0/3574297519 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee40a8420 con 0x7f4eec06cfa0 2024-04-15T15:32:35.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4eebe00640 1 -- 172.21.15.73:0/3574297519 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40a87f0 con 0x7f4eec06cfa0 2024-04-15T15:32:35.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4ef3a00640 1 -- 172.21.15.73:0/3574297519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec06cfa0 msgr2=0x7f4eec162410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4ef3a00640 1 --2- 172.21.15.73:0/3574297519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec06cfa0 0x7f4eec162410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4eec063740 tx=0x7f4ee401c730 comp rx=0 tx=0).stop 2024-04-15T15:32:35.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4ef3a00640 1 -- 172.21.15.73:0/3574297519 shutdown_connections 2024-04-15T15:32:35.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4ef3a00640 1 --2- 172.21.15.73:0/3574297519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec06cfa0 0x7f4eec162410 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4ef3a00640 1 --2- 172.21.15.73:0/3574297519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec070130 0x7f4eec06ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4ef3a00640 1 --2- 172.21.15.73:0/3574297519 >> v2:172.21.15.118:3300/0 conn(0x7f4eec15e760 0x7f4eec073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4ef3a00640 1 -- 172.21.15.73:0/3574297519 >> 172.21.15.73:0/3574297519 conn(0x7f4eec072590 msgr2=0x7f4eec072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:35.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4ef3a00640 1 -- 172.21.15.73:0/3574297519 shutdown_connections 2024-04-15T15:32:35.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.317+0000 7f4ef3a00640 1 -- 172.21.15.73:0/3574297519 wait complete. 2024-04-15T15:32:35.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef3a00640 1 Processor -- start 2024-04-15T15:32:35.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef3a00640 1 -- start start 2024-04-15T15:32:35.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef3a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec06cfa0 0x7f4eec14dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef3a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec070130 0x7f4eec0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef3a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec15e760 0x7f4eec0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef3a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec06e720 con 0x7f4eec15e760 2024-04-15T15:32:35.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef3a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec15ed50 con 0x7f4eec070130 2024-04-15T15:32:35.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef3a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4eec06e8a0 con 0x7f4eec06cfa0 2024-04-15T15:32:35.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef1a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec15e760 0x7f4eec0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef1a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec15e760 0x7f4eec0b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58640/0 (socket says 172.21.15.73:58640) 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef1a00640 1 -- 172.21.15.73:0/377239096 learned_addr learned my addr 172.21.15.73:0/377239096 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef1000640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec06cfa0 0x7f4eec14dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ee3e00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec070130 0x7f4eec0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef1a00640 1 -- 172.21.15.73:0/377239096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec06cfa0 msgr2=0x7f4eec14dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef1a00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec06cfa0 0x7f4eec14dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef1a00640 1 -- 172.21.15.73:0/377239096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec070130 msgr2=0x7f4eec0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef1a00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec070130 0x7f4eec0b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef1a00640 1 -- 172.21.15.73:0/377239096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eec14cbe0 con 0x7f4eec15e760 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ee3e00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec070130 0x7f4eec0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef1a00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec15e760 0x7f4eec0b11e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ee401cfd0 tx=0x7f4ee40194d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ee9600640 1 -- 172.21.15.73:0/377239096 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40bf070 con 0x7f4eec15e760 2024-04-15T15:32:35.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ee9600640 1 -- 172.21.15.73:0/377239096 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee40090d0 con 0x7f4eec15e760 2024-04-15T15:32:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ee9600640 1 -- 172.21.15.73:0/377239096 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40ac040 con 0x7f4eec15e760 2024-04-15T15:32:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef3a00640 1 -- 172.21.15.73:0/377239096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eec14cec0 con 0x7f4eec15e760 2024-04-15T15:32:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.321+0000 7f4ef3a00640 1 -- 172.21.15.73:0/377239096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eec158050 con 0x7f4eec15e760 2024-04-15T15:32:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.325+0000 7f4ef3a00640 1 -- 172.21.15.73:0/377239096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eec14d3e0 con 0x7f4eec15e760 2024-04-15T15:32:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.325+0000 7f4ee9600640 1 -- 172.21.15.73:0/377239096 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ee40c2070 con 0x7f4eec15e760 2024-04-15T15:32:35.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.325+0000 7f4ee9600640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ec8068380 0x7f4ec806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.325+0000 7f4ee9600640 1 -- 172.21.15.73:0/377239096 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f4ee4120fa0 con 0x7f4eec15e760 2024-04-15T15:32:35.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.325+0000 7f4ef1000640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ec8068380 0x7f4ec806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.325+0000 7f4ef1000640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ec8068380 0x7f4ec806a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0099d0 tx=0x7f4edc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:35.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.329+0000 7f4ee9600640 1 -- 172.21.15.73:0/377239096 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ee40165e0 con 0x7f4eec15e760 2024-04-15T15:32:35.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.521+0000 7f4ef3a00640 1 -- 172.21.15.73:0/377239096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4eec068ab0 con 0x7f4eec15e760 2024-04-15T15:32:35.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.521+0000 7f4ee9600640 1 -- 172.21.15.73:0/377239096 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f4ee40f0a60 con 0x7f4eec15e760 2024-04-15T15:32:35.523 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:35.523 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:31:33.826027+0000","modified":"2024-04-15T15:31:52.268632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-15T15:32:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-04-15T15:32:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 -- 172.21.15.73:0/377239096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ec8068380 msgr2=0x7f4ec806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ec8068380 0x7f4ec806a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0099d0 tx=0x7f4edc008040 comp rx=0 tx=0).stop 2024-04-15T15:32:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 -- 172.21.15.73:0/377239096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec15e760 msgr2=0x7f4eec0b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec15e760 0x7f4eec0b11e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ee401cfd0 tx=0x7f4ee40194d0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 -- 172.21.15.73:0/377239096 shutdown_connections 2024-04-15T15:32:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eec15e760 0x7f4eec0b11e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4eec070130 0x7f4eec0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ec8068380 0x7f4ec806a840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 --2- 172.21.15.73:0/377239096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4eec06cfa0 0x7f4eec14dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 -- 172.21.15.73:0/377239096 >> 172.21.15.73:0/377239096 conn(0x7f4eec072590 msgr2=0x7f4eec06f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 -- 172.21.15.73:0/377239096 shutdown_connections 2024-04-15T15:32:35.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.525+0000 7f4ef3a00640 1 -- 172.21.15.73:0/377239096 wait complete. 2024-04-15T15:32:35.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:35.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f2156e00640 1 Processor -- start 2024-04-15T15:32:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f2156e00640 1 -- start start 2024-04-15T15:32:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f2156e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f21500d0390 0x7f21500cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f2156e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215015cf50 con 0x7f215006ba50 2024-04-15T15:32:35.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f2156e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215015d230 con 0x7f21500d1f30 2024-04-15T15:32:35.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f2156e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f21500d23a0 con 0x7f21500d0390 2024-04-15T15:32:35.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214fe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f215006ba50 0x7f215006be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57932/0 (socket says 172.21.15.73:57932) 2024-04-15T15:32:35.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214fe00640 1 -- 172.21.15.73:0/1526275365 learned_addr learned my addr 172.21.15.73:0/1526275365 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:35.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214f400640 1 --2- 172.21.15.73:0/1526275365 >> v2:172.21.15.118:3300/0 conn(0x7f21500d0390 0x7f21500cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276970382 0 0) 0x7f215015cf50 con 0x7f215006ba50 2024-04-15T15:32:35.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2134003530 con 0x7f215006ba50 2024-04-15T15:32:35.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3760223758 0 0) 0x7f2134003530 con 0x7f215006ba50 2024-04-15T15:32:35.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 >> v2:172.21.15.118:3300/0 conn(0x7f21500d0390 msgr2=0x7f21500cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:35.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 --2- 172.21.15.73:0/1526275365 >> v2:172.21.15.118:3300/0 conn(0x7f21500d0390 0x7f21500cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 >> v1:172.21.15.118:6789/0 conn(0x7f21500d1f30 legacy=0x7f21500cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215015d510 con 0x7f215006ba50 2024-04-15T15:32:35.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f2140001a00 con 0x7f215006ba50 2024-04-15T15:32:35.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 >> v1:172.21.15.73:6789/0 conn(0x7f215006ba50 legacy=0x7f215006be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21340039c0 0x7f2134003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2134004810 0x7f2134004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21340051d0 0x7f213400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f21500d23a0 con 0x7f21340039c0 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f213400c0d0 con 0x7f2134004810 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f213400c2d0 con 0x7f21340051d0 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.681+0000 7f214fe00640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21340039c0 0x7f2134003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f2154e00640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21340051d0 0x7f213400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214f400640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2134004810 0x7f2134004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214fe00640 1 -- 172.21.15.73:0/1526275365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21340051d0 msgr2=0x7f213400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214fe00640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21340051d0 0x7f213400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214fe00640 1 -- 172.21.15.73:0/1526275365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2134004810 msgr2=0x7f2134004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214fe00640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2134004810 0x7f2134004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214fe00640 1 -- 172.21.15.73:0/1526275365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2134003530 con 0x7f21340039c0 2024-04-15T15:32:35.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214f400640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2134004810 0x7f2134004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:35.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f2154e00640 1 -- 172.21.15.73:0/1526275365 reap_dead start 2024-04-15T15:32:35.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214fe00640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21340039c0 0x7f2134003da0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f214000a7b0 tx=0x7f214001d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b66ba4dfd24daf server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:35.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214000a3d0 con 0x7f21340039c0 2024-04-15T15:32:35.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21400ad630 con 0x7f21340039c0 2024-04-15T15:32:35.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f214ea00640 1 -- 172.21.15.73:0/1526275365 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21400ada60 con 0x7f21340039c0 2024-04-15T15:32:35.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f2156e00640 1 -- 172.21.15.73:0/1526275365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21340039c0 msgr2=0x7f2134003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f2156e00640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21340039c0 0x7f2134003da0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f214000a7b0 tx=0x7f214001d2e0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f2156e00640 1 -- 172.21.15.73:0/1526275365 shutdown_connections 2024-04-15T15:32:35.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f2156e00640 1 --2- 172.21.15.73:0/1526275365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21340039c0 0x7f2134003da0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f2156e00640 1 -- 172.21.15.73:0/1526275365 >> 172.21.15.73:0/1526275365 conn(0x7f21500d1410 msgr2=0x7f21500d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:35.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f2156e00640 1 -- 172.21.15.73:0/1526275365 shutdown_connections 2024-04-15T15:32:35.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.685+0000 7f2156e00640 1 -- 172.21.15.73:0/1526275365 wait complete. 2024-04-15T15:32:35.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2156e00640 1 Processor -- start 2024-04-15T15:32:35.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2156e00640 1 -- start start 2024-04-15T15:32:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2156e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21340039c0 0x7f21500c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2156e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21500c9330 0x7f2150160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2156e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21501fb1b0 0x7f21501fb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2156e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f215006c3c0 con 0x7f21501fb1b0 2024-04-15T15:32:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2156e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f215006c240 con 0x7f21500c9330 2024-04-15T15:32:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2156e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f21500cf9a0 con 0x7f21340039c0 2024-04-15T15:32:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2154e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21501fb1b0 0x7f21501fb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f214fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21340039c0 0x7f21500c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f214f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21500c9330 0x7f2150160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2154e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21501fb1b0 0x7f21501fb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58670/0 (socket says 172.21.15.73:58670) 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2154e00640 1 -- 172.21.15.73:0/1326089184 learned_addr learned my addr 172.21.15.73:0/1326089184 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2154e00640 1 -- 172.21.15.73:0/1326089184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21340039c0 msgr2=0x7f21500c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2154e00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21340039c0 0x7f21500c5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2154e00640 1 -- 172.21.15.73:0/1326089184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21500c9330 msgr2=0x7f2150160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2154e00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21500c9330 0x7f2150160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2154e00640 1 -- 172.21.15.73:0/1326089184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21500c5d80 con 0x7f21501fb1b0 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2154e00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21501fb1b0 0x7f21501fb630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f215015de40 tx=0x7f214800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2147e00640 1 -- 172.21.15.73:0/1326089184 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148019070 con 0x7f21501fb1b0 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2147e00640 1 -- 172.21.15.73:0/1326089184 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21480052e0 con 0x7f21501fb1b0 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2156e00640 1 -- 172.21.15.73:0/1326089184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215006f080 con 0x7f21501fb1b0 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.689+0000 7f2147e00640 1 -- 172.21.15.73:0/1326089184 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148003840 con 0x7f21501fb1b0 2024-04-15T15:32:35.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.693+0000 7f2156e00640 1 -- 172.21.15.73:0/1326089184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215006f640 con 0x7f21501fb1b0 2024-04-15T15:32:35.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.693+0000 7f2156e00640 1 -- 172.21.15.73:0/1326089184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215006f840 con 0x7f21501fb1b0 2024-04-15T15:32:35.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.693+0000 7f2147e00640 1 -- 172.21.15.73:0/1326089184 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f214801c070 con 0x7f21501fb1b0 2024-04-15T15:32:35.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.693+0000 7f2147e00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f21300683b0 0x7f213006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:35.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.693+0000 7f2147e00640 1 -- 172.21.15.73:0/1326089184 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f2148086230 con 0x7f21501fb1b0 2024-04-15T15:32:35.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.693+0000 7f214fe00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f21300683b0 0x7f213006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:35.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.693+0000 7f214fe00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f21300683b0 0x7f213006a870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f21400ad000 tx=0x7f21400af040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:35.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.697+0000 7f2147e00640 1 -- 172.21.15.73:0/1326089184 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f215006f840 con 0x7f21501fb1b0 2024-04-15T15:32:35.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.853+0000 7f2156e00640 1 -- 172.21.15.73:0/1326089184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2150068ab0 con 0x7f21501fb1b0 2024-04-15T15:32:35.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2147e00640 1 -- 172.21.15.73:0/1326089184 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7f2148055cf0 con 0x7f21501fb1b0 2024-04-15T15:32:35.856 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:35.857 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:35.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 -- 172.21.15.73:0/1326089184 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f21300683b0 msgr2=0x7f213006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f21300683b0 0x7f213006a870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f21400ad000 tx=0x7f21400af040 comp rx=0 tx=0).stop 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 -- 172.21.15.73:0/1326089184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21501fb1b0 msgr2=0x7f21501fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21501fb1b0 0x7f21501fb630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f215015de40 tx=0x7f214800e8a0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 -- 172.21.15.73:0/1326089184 shutdown_connections 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21501fb1b0 0x7f21501fb630 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21500c9330 0x7f2150160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f21300683b0 0x7f213006a870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 --2- 172.21.15.73:0/1326089184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21340039c0 0x7f21500c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 -- 172.21.15.73:0/1326089184 >> 172.21.15.73:0/1326089184 conn(0x7f21500d1410 msgr2=0x7f21500ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 -- 172.21.15.73:0/1326089184 shutdown_connections 2024-04-15T15:32:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:35.857+0000 7f2156e00640 1 -- 172.21.15.73:0/1326089184 wait complete. 2024-04-15T15:32:35.879 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-15T15:32:35.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:32:36.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.013+0000 7f4b47000640 1 Processor -- start 2024-04-15T15:32:36.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.013+0000 7f4b47000640 1 -- start start 2024-04-15T15:32:36.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b47000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b4006fc90 0x7f4b4015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b47000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b40072520 0x7f4b4015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b47000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b4006f5a0 con 0x7f4b4015e910 2024-04-15T15:32:36.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b47000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4b4015b9e0 con 0x7f4b40072520 2024-04-15T15:32:36.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b47000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4b4015f480 con 0x7f4b4006fc90 2024-04-15T15:32:36.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b45000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b40072520 0x7f4b4015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b45000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b40072520 0x7f4b4015ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58676/0 (socket says 172.21.15.73:58676) 2024-04-15T15:32:36.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b45000640 1 -- 172.21.15.73:0/3871252141 learned_addr learned my addr 172.21.15.73:0/3871252141 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:36.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b3fe00640 1 --2- 172.21.15.73:0/3871252141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b4006fc90 0x7f4b4015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b45000640 1 -- 172.21.15.73:0/3871252141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b4006fc90 msgr2=0x7f4b4015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:36.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b45000640 1 --2- 172.21.15.73:0/3871252141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b4006fc90 0x7f4b4015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b45000640 1 -- 172.21.15.73:0/3871252141 >> v1:172.21.15.118:6789/0 conn(0x7f4b4015e910 legacy=0x7f4b40071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.017+0000 7f4b45000640 1 -- 172.21.15.73:0/3871252141 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4015f760 con 0x7f4b40072520 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b45000640 1 --2- 172.21.15.73:0/3871252141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b40072520 0x7f4b4015ed90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009870 tx=0x7f4b3801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744dd473f2388513 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b3f400640 1 -- 172.21.15.73:0/3871252141 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b380ab5f0 con 0x7f4b40072520 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b3f400640 1 -- 172.21.15.73:0/3871252141 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b380b0070 con 0x7f4b40072520 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b3f400640 1 -- 172.21.15.73:0/3871252141 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b380ab9b0 con 0x7f4b40072520 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 -- 172.21.15.73:0/3871252141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b40072520 msgr2=0x7f4b4015ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 --2- 172.21.15.73:0/3871252141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b40072520 0x7f4b4015ed90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009870 tx=0x7f4b3801c560 comp rx=0 tx=0).stop 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 -- 172.21.15.73:0/3871252141 shutdown_connections 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 --2- 172.21.15.73:0/3871252141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b40072520 0x7f4b4015ed90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 --2- 172.21.15.73:0/3871252141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b4006fc90 0x7f4b4015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 -- 172.21.15.73:0/3871252141 >> 172.21.15.73:0/3871252141 conn(0x7f4b40067dd0 msgr2=0x7f4b400d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:36.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 -- 172.21.15.73:0/3871252141 shutdown_connections 2024-04-15T15:32:36.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 -- 172.21.15.73:0/3871252141 wait complete. 2024-04-15T15:32:36.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 Processor -- start 2024-04-15T15:32:36.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 -- start start 2024-04-15T15:32:36.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.021+0000 7f4b47000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4006fc90 0x7f4b4014c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b47000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b40072520 0x7f4b400c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b47000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b4015e910 0x7f4b4014ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b47000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4b400b3f90 con 0x7f4b4006fc90 2024-04-15T15:32:36.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b47000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4b400b3e10 con 0x7f4b4015e910 2024-04-15T15:32:36.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b47000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4b400b4110 con 0x7f4b40072520 2024-04-15T15:32:36.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4006fc90 0x7f4b4014c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4006fc90 0x7f4b4014c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58692/0 (socket says 172.21.15.73:58692) 2024-04-15T15:32:36.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3fe00640 1 -- 172.21.15.73:0/2167412188 learned_addr learned my addr 172.21.15.73:0/2167412188 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3fe00640 1 -- 172.21.15.73:0/2167412188 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b40072520 msgr2=0x7f4b400c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3fe00640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b40072520 0x7f4b400c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3fe00640 1 -- 172.21.15.73:0/2167412188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b4015e910 msgr2=0x7f4b4014ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3fe00640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b4015e910 0x7f4b4014ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3fe00640 1 -- 172.21.15.73:0/2167412188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4014d5d0 con 0x7f4b4006fc90 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3fe00640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4006fc90 0x7f4b4014c790 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000e960 tx=0x7f4b3000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3cc00640 1 -- 172.21.15.73:0/2167412188 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30017070 con 0x7f4b4006fc90 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3cc00640 1 -- 172.21.15.73:0/2167412188 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3000ca00 con 0x7f4b4006fc90 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3cc00640 1 -- 172.21.15.73:0/2167412188 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000cdb0 con 0x7f4b4006fc90 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b47000640 1 -- 172.21.15.73:0/2167412188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4015c4b0 con 0x7f4b4006fc90 2024-04-15T15:32:36.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b47000640 1 -- 172.21.15.73:0/2167412188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b4015ca70 con 0x7f4b4006fc90 2024-04-15T15:32:36.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b47000640 1 -- 172.21.15.73:0/2167412188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b40068ab0 con 0x7f4b4006fc90 2024-04-15T15:32:36.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.025+0000 7f4b3cc00640 1 -- 172.21.15.73:0/2167412188 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b3001a070 con 0x7f4b4006fc90 2024-04-15T15:32:36.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.029+0000 7f4b3cc00640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b1c0683b0 0x7f4b1c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.029+0000 7f4b3cc00640 1 -- 172.21.15.73:0/2167412188 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f4b30087160 con 0x7f4b4006fc90 2024-04-15T15:32:36.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.029+0000 7f4b37400640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b1c0683b0 0x7f4b1c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.029+0000 7f4b37400640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b1c0683b0 0x7f4b1c06a870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b28007fd0 tx=0x7f4b28007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:36.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.033+0000 7f4b3cc00640 1 -- 172.21.15.73:0/2167412188 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b30057300 con 0x7f4b4006fc90 2024-04-15T15:32:36.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 -- 172.21.15.73:0/2167412188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b4014ccd0 con 0x7f4b4006fc90 2024-04-15T15:32:36.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b3cc00640 1 -- 172.21.15.73:0/2167412188 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f4b30056c00 con 0x7f4b4006fc90 2024-04-15T15:32:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:36.222 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:31:33.826027+0000","modified":"2024-04-15T15:31:52.268632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-15T15:32:36.222 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-04-15T15:32:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 -- 172.21.15.73:0/2167412188 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b1c0683b0 msgr2=0x7f4b1c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b1c0683b0 0x7f4b1c06a870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b28007fd0 tx=0x7f4b28007d60 comp rx=0 tx=0).stop 2024-04-15T15:32:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 -- 172.21.15.73:0/2167412188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4006fc90 msgr2=0x7f4b4014c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4006fc90 0x7f4b4014c790 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000e960 tx=0x7f4b3000ee20 comp rx=0 tx=0).stop 2024-04-15T15:32:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 -- 172.21.15.73:0/2167412188 shutdown_connections 2024-04-15T15:32:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b4015e910 0x7f4b4014ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b1c0683b0 0x7f4b1c06a870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b40072520 0x7f4b400c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 --2- 172.21.15.73:0/2167412188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b4006fc90 0x7f4b4014c790 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 -- 172.21.15.73:0/2167412188 >> 172.21.15.73:0/2167412188 conn(0x7f4b40067dd0 msgr2=0x7f4b4015cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:36.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 -- 172.21.15.73:0/2167412188 shutdown_connections 2024-04-15T15:32:36.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.221+0000 7f4b47000640 1 -- 172.21.15.73:0/2167412188 wait complete. 2024-04-15T15:32:36.244 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:32:36.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.377+0000 7f7c92e00640 1 Processor -- start 2024-04-15T15:32:36.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.377+0000 7f7c92e00640 1 -- start start 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.377+0000 7f7c92e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c8c15b5d0 0x7f7c8c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.377+0000 7f7c92e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c8c0b27c0 0x7f7c8c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.377+0000 7f7c92e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c8c070160 con 0x7f7c8c0b3e30 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.377+0000 7f7c92e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7c8c15b9b0 con 0x7f7c8c0b27c0 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.377+0000 7f7c92e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7c8c15f1f0 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c90e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c8c0b27c0 0x7f7c8c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c90e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c8c0b27c0 0x7f7c8c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58708/0 (socket says 172.21.15.73:58708) 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c90e00640 1 -- 172.21.15.73:0/1656114335 learned_addr learned my addr 172.21.15.73:0/1656114335 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c8be00640 1 --2- 172.21.15.73:0/1656114335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c8c15b5d0 0x7f7c8c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c90e00640 1 -- 172.21.15.73:0/1656114335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c8c15b5d0 msgr2=0x7f7c8c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c90e00640 1 --2- 172.21.15.73:0/1656114335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c8c15b5d0 0x7f7c8c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c90e00640 1 -- 172.21.15.73:0/1656114335 >> v1:172.21.15.118:6789/0 conn(0x7f7c8c0b3e30 legacy=0x7f7c8c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c90e00640 1 -- 172.21.15.73:0/1656114335 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c06fe80 con 0x7f7c8c0b27c0 2024-04-15T15:32:36.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c90e00640 1 --2- 172.21.15.73:0/1656114335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c0b27c0 0x7f7c8c0b4740 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009870 tx=0x7f7c8401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1b9c5b1f0073b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:36.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c8aa00640 1 -- 172.21.15.73:0/1656114335 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c840ab410 con 0x7f7c8c0b27c0 2024-04-15T15:32:36.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c8aa00640 1 -- 172.21.15.73:0/1656114335 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c840b0070 con 0x7f7c8c0b27c0 2024-04-15T15:32:36.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.381+0000 7f7c8aa00640 1 -- 172.21.15.73:0/1656114335 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c840ab7d0 con 0x7f7c8c0b27c0 2024-04-15T15:32:36.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 -- 172.21.15.73:0/1656114335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c0b27c0 msgr2=0x7f7c8c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 --2- 172.21.15.73:0/1656114335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c0b27c0 0x7f7c8c0b4740 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009870 tx=0x7f7c8401c410 comp rx=0 tx=0).stop 2024-04-15T15:32:36.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 -- 172.21.15.73:0/1656114335 shutdown_connections 2024-04-15T15:32:36.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 --2- 172.21.15.73:0/1656114335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c0b27c0 0x7f7c8c0b4740 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 --2- 172.21.15.73:0/1656114335 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c8c15b5d0 0x7f7c8c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 -- 172.21.15.73:0/1656114335 >> 172.21.15.73:0/1656114335 conn(0x7f7c8c067dd0 msgr2=0x7f7c8c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:36.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 -- 172.21.15.73:0/1656114335 shutdown_connections 2024-04-15T15:32:36.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 -- 172.21.15.73:0/1656114335 wait complete. 2024-04-15T15:32:36.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 Processor -- start 2024-04-15T15:32:36.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 -- start start 2024-04-15T15:32:36.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c8c0b27c0 0x7f7c8c150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c8c0b3e30 0x7f7c8c159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c15b5d0 0x7f7c8c150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c0b4390 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c0b4210 con 0x7f7c8c0b3e30 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c92e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7c8c06faa0 con 0x7f7c8c0b27c0 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c90e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c15b5d0 0x7f7c8c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c90e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c15b5d0 0x7f7c8c150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58712/0 (socket says 172.21.15.73:58712) 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c90e00640 1 -- 172.21.15.73:0/1651349162 learned_addr learned my addr 172.21.15.73:0/1651349162 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c8b400640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c8c0b3e30 0x7f7c8c159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c8be00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c8c0b27c0 0x7f7c8c150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c90e00640 1 -- 172.21.15.73:0/1651349162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c8c0b27c0 msgr2=0x7f7c8c150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c90e00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c8c0b27c0 0x7f7c8c150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c90e00640 1 -- 172.21.15.73:0/1651349162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c8c0b3e30 msgr2=0x7f7c8c159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c90e00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c8c0b3e30 0x7f7c8c159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c90e00640 1 -- 172.21.15.73:0/1651349162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c150860 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.385+0000 7f7c90e00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c15b5d0 0x7f7c8c150320 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7c8401a040 tx=0x7f7c8401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c83e00640 1 -- 172.21.15.73:0/1651349162 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c840be3f0 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c83e00640 1 -- 172.21.15.73:0/1651349162 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c840be590 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c92e00640 1 -- 172.21.15.73:0/1651349162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8c1582d0 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c83e00640 1 -- 172.21.15.73:0/1651349162 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c840be980 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c92e00640 1 -- 172.21.15.73:0/1651349162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c8c158890 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c92e00640 1 -- 172.21.15.73:0/1651349162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c8c068ab0 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c83e00640 1 -- 172.21.15.73:0/1651349162 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c840c7440 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c83e00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c6c068380 0x7f7c6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c83e00640 1 -- 172.21.15.73:0/1651349162 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f7c84121520 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c8be00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c6c068380 0x7f7c6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.389+0000 7f7c8be00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c6c068380 0x7f7c6c06a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c15f090 tx=0x7f7c7c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:36.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.393+0000 7f7c83e00640 1 -- 172.21.15.73:0/1651349162 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c840a8050 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 -- 172.21.15.73:0/1651349162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c8c072a20 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c83e00640 1 -- 172.21.15.73:0/1651349162 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f7c84016150 con 0x7f7c8c15b5d0 2024-04-15T15:32:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:36.585 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/932296088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":932296088},{"type":"v1","addr":"172.21.15.118:6835","nonce":932296088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1984792055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1984792055},{"type":"v1","addr":"172.21.15.118:6834","nonce":1984792055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2643683125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2643683125},{"type":"v1","addr":"172.21.15.73:6836","nonce":2643683125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:31:33.826027+0000","modified":"2024-04-15T15:31:52.268632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2095978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2095978965},{"type":"v1","addr":"172.21.15.73:6837","nonce":2095978965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-15T15:32:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2024-04-15T15:32:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 -- 172.21.15.73:0/1651349162 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c6c068380 msgr2=0x7f7c6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c6c068380 0x7f7c6c06a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c15f090 tx=0x7f7c7c00b040 comp rx=0 tx=0).stop 2024-04-15T15:32:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 -- 172.21.15.73:0/1651349162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c15b5d0 msgr2=0x7f7c8c150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c15b5d0 0x7f7c8c150320 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7c8401a040 tx=0x7f7c8401ac50 comp rx=0 tx=0).stop 2024-04-15T15:32:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 -- 172.21.15.73:0/1651349162 shutdown_connections 2024-04-15T15:32:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c8c15b5d0 0x7f7c8c150320 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c8c0b3e30 0x7f7c8c159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c6c068380 0x7f7c6c06a840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 --2- 172.21.15.73:0/1651349162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c8c0b27c0 0x7f7c8c150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 -- 172.21.15.73:0/1651349162 >> 172.21.15.73:0/1651349162 conn(0x7f7c8c067dd0 msgr2=0x7f7c8c153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 -- 172.21.15.73:0/1651349162 shutdown_connections 2024-04-15T15:32:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.585+0000 7f7c92e00640 1 -- 172.21.15.73:0/1651349162 wait complete. 2024-04-15T15:32:36.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:36.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.741+0000 7f8db3200640 1 Processor -- start 2024-04-15T15:32:36.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.741+0000 7f8db3200640 1 -- start start 2024-04-15T15:32:36.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.741+0000 7f8db3200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 0x7f8dac0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.741+0000 7f8db3200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8dac15cbd0 0x7f8dac15d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.741+0000 7f8db3200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac0cd3a0 con 0x7f8dac146110 2024-04-15T15:32:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.741+0000 7f8db3200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8dac0b5160 con 0x7f8dac15cbd0 2024-04-15T15:32:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.741+0000 7f8db3200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8dac0b40c0 con 0x7f8dac0b20b0 2024-04-15T15:32:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.741+0000 7f8db1200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8dac15cbd0 0x7f8dac15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.741+0000 7f8db1200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8dac15cbd0 0x7f8dac15d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58714/0 (socket says 172.21.15.73:58714) 2024-04-15T15:32:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.741+0000 7f8db1200640 1 -- 172.21.15.73:0/2697902438 learned_addr learned my addr 172.21.15.73:0/2697902438 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8da3400640 1 --2- 172.21.15.73:0/2697902438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 0x7f8dac0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db1200640 1 -- 172.21.15.73:0/2697902438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 msgr2=0x7f8dac0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db1200640 1 --2- 172.21.15.73:0/2697902438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 0x7f8dac0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db1200640 1 -- 172.21.15.73:0/2697902438 >> v1:172.21.15.118:6789/0 conn(0x7f8dac146110 legacy=0x7f8dac0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db1200640 1 -- 172.21.15.73:0/2697902438 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac0b43a0 con 0x7f8dac15cbd0 2024-04-15T15:32:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8da3400640 1 --2- 172.21.15.73:0/2697902438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 0x7f8dac0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:36.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db1200640 1 --2- 172.21.15.73:0/2697902438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac15cbd0 0x7f8dac15d060 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009870 tx=0x7f8da401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4cb89b48a508607 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:36.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8dab400640 1 -- 172.21.15.73:0/2697902438 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da40b1070 con 0x7f8dac15cbd0 2024-04-15T15:32:36.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8dab400640 1 -- 172.21.15.73:0/2697902438 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da40ac630 con 0x7f8dac15cbd0 2024-04-15T15:32:36.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8dab400640 1 -- 172.21.15.73:0/2697902438 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da40a8050 con 0x7f8dac15cbd0 2024-04-15T15:32:36.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db3200640 1 -- 172.21.15.73:0/2697902438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac15cbd0 msgr2=0x7f8dac15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db3200640 1 --2- 172.21.15.73:0/2697902438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac15cbd0 0x7f8dac15d060 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009870 tx=0x7f8da401c520 comp rx=0 tx=0).stop 2024-04-15T15:32:36.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db3200640 1 -- 172.21.15.73:0/2697902438 shutdown_connections 2024-04-15T15:32:36.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db3200640 1 --2- 172.21.15.73:0/2697902438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac15cbd0 0x7f8dac15d060 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db3200640 1 --2- 172.21.15.73:0/2697902438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 0x7f8dac0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.745+0000 7f8db3200640 1 -- 172.21.15.73:0/2697902438 >> 172.21.15.73:0/2697902438 conn(0x7f8dac067dd0 msgr2=0x7f8dac0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:36.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 -- 172.21.15.73:0/2697902438 shutdown_connections 2024-04-15T15:32:36.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 -- 172.21.15.73:0/2697902438 wait complete. 2024-04-15T15:32:36.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 Processor -- start 2024-04-15T15:32:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 -- start start 2024-04-15T15:32:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 0x7f8dac071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac146110 0x7f8dac072350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dac15cbd0 0x7f8dac0ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac169210 con 0x7f8dac146110 2024-04-15T15:32:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac0b3d70 con 0x7f8dac15cbd0 2024-04-15T15:32:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8dac169390 con 0x7f8dac0b20b0 2024-04-15T15:32:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac146110 0x7f8dac072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac146110 0x7f8dac072350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58730/0 (socket says 172.21.15.73:58730) 2024-04-15T15:32:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da3400640 1 -- 172.21.15.73:0/1249139331 learned_addr learned my addr 172.21.15.73:0/1249139331 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8dabe00640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 0x7f8dac071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db1200640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dac15cbd0 0x7f8dac0ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da3400640 1 -- 172.21.15.73:0/1249139331 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 msgr2=0x7f8dac071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da3400640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 0x7f8dac071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da3400640 1 -- 172.21.15.73:0/1249139331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dac15cbd0 msgr2=0x7f8dac0ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da3400640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dac15cbd0 0x7f8dac0ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da3400640 1 -- 172.21.15.73:0/1249139331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac139fa0 con 0x7f8dac146110 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db1200640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dac15cbd0 0x7f8dac0ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da3400640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac146110 0x7f8dac072350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400cf90 tx=0x7f8d9400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da8c00640 1 -- 172.21.15.73:0/1249139331 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9401a070 con 0x7f8dac146110 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da8c00640 1 -- 172.21.15.73:0/1249139331 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9400d840 con 0x7f8dac146110 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8da8c00640 1 -- 172.21.15.73:0/1249139331 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400dc10 con 0x7f8dac146110 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 -- 172.21.15.73:0/1249139331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dac15b0f0 con 0x7f8dac146110 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.749+0000 7f8db3200640 1 -- 172.21.15.73:0/1249139331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dac15b6b0 con 0x7f8dac146110 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.753+0000 7f8db3200640 1 -- 172.21.15.73:0/1249139331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dac068ab0 con 0x7f8dac146110 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.753+0000 7f8da8c00640 1 -- 172.21.15.73:0/1249139331 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d9401d070 con 0x7f8dac146110 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.753+0000 7f8da8c00640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8d880683b0 0x7f8d8806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.753+0000 7f8da8c00640 1 -- 172.21.15.73:0/1249139331 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f8d940875f0 con 0x7f8dac146110 2024-04-15T15:32:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.753+0000 7f8dabe00640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8d880683b0 0x7f8d8806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.753+0000 7f8dabe00640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8d880683b0 0x7f8d8806a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c007fd0 tx=0x7f8d9c007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.757+0000 7f8da8c00640 1 -- 172.21.15.73:0/1249139331 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8dac139fa0 con 0x7f8dac146110 2024-04-15T15:32:36.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.913+0000 7f8db3200640 1 -- 172.21.15.73:0/1249139331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8dac156530 con 0x7f8dac146110 2024-04-15T15:32:36.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8da8c00640 1 -- 172.21.15.73:0/1249139331 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18897 (secure 0 0 0) 0x7f8d940570b0 con 0x7f8dac146110 2024-04-15T15:32:36.917 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:36.917 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:14.565105+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:31:31.544543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T15:31:32.789874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T15:31:36.482495+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 -- 172.21.15.73:0/1249139331 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8d880683b0 msgr2=0x7f8d8806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8d880683b0 0x7f8d8806a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c007fd0 tx=0x7f8d9c007e40 comp rx=0 tx=0).stop 2024-04-15T15:32:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 -- 172.21.15.73:0/1249139331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac146110 msgr2=0x7f8dac072350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac146110 0x7f8dac072350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400cf90 tx=0x7f8d9400a7d0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 -- 172.21.15.73:0/1249139331 shutdown_connections 2024-04-15T15:32:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dac15cbd0 0x7f8dac0ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dac146110 0x7f8dac072350 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8d880683b0 0x7f8d8806a870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 --2- 172.21.15.73:0/1249139331 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dac0b20b0 0x7f8dac071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 -- 172.21.15.73:0/1249139331 >> 172.21.15.73:0/1249139331 conn(0x7f8dac067dd0 msgr2=0x7f8dac144d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 -- 172.21.15.73:0/1249139331 shutdown_connections 2024-04-15T15:32:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:36.917+0000 7f8db3200640 1 -- 172.21.15.73:0/1249139331 wait complete. 2024-04-15T15:32:36.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-15T15:32:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.073+0000 7f4ae6200640 1 Processor -- start 2024-04-15T15:32:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.073+0000 7f4ae6200640 1 -- start start 2024-04-15T15:32:37.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4ae6200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4ae0146110 0x7f4ae00cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4ae6200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4ae00b2530 0x7f4ae0072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4ae6200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae00cd3a0 con 0x7f4ae00b20b0 2024-04-15T15:32:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4ae6200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae00b5160 con 0x7f4ae00b2530 2024-04-15T15:32:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4ae6200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae00b40c0 con 0x7f4ae0146110 2024-04-15T15:32:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4adea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4ae00b20b0 0x7f4ae0071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57934/0 (socket says 172.21.15.73:57934) 2024-04-15T15:32:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4adea00640 1 -- 172.21.15.73:0/3665046563 learned_addr learned my addr 172.21.15.73:0/3665046563 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:37.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4adfe00640 1 --2- 172.21.15.73:0/3665046563 >> v2:172.21.15.73:3300/0 conn(0x7f4ae00b2530 0x7f4ae0072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4adf400640 1 --2- 172.21.15.73:0/3665046563 >> v2:172.21.15.118:3300/0 conn(0x7f4ae0146110 0x7f4ae00cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4ade000640 1 -- 172.21.15.73:0/3665046563 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564479674 0 0) 0x7f4ae00cd3a0 con 0x7f4ae00b20b0 2024-04-15T15:32:37.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4adfe00640 1 -- 172.21.15.73:0/3665046563 >> v2:172.21.15.118:3300/0 conn(0x7f4ae0146110 msgr2=0x7f4ae00cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:37.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4adfe00640 1 --2- 172.21.15.73:0/3665046563 >> v2:172.21.15.118:3300/0 conn(0x7f4ae0146110 0x7f4ae00cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4adfe00640 1 -- 172.21.15.73:0/3665046563 >> v1:172.21.15.73:6789/0 conn(0x7f4ae00b20b0 legacy=0x7f4ae0071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:37.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.077+0000 7f4adfe00640 1 -- 172.21.15.73:0/3665046563 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae00b43a0 con 0x7f4ae00b2530 2024-04-15T15:32:37.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4adfe00640 1 --2- 172.21.15.73:0/3665046563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b2530 0x7f4ae0072520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00cd570 tx=0x7f4ad801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef3946fb761bdf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ade000640 1 -- 172.21.15.73:0/3665046563 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80ab430 con 0x7f4ae00b2530 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ade000640 1 -- 172.21.15.73:0/3665046563 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad80b0070 con 0x7f4ae00b2530 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ade000640 1 -- 172.21.15.73:0/3665046563 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80ab7f0 con 0x7f4ae00b2530 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 -- 172.21.15.73:0/3665046563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b2530 msgr2=0x7f4ae0072520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 --2- 172.21.15.73:0/3665046563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b2530 0x7f4ae0072520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00cd570 tx=0x7f4ad801c430 comp rx=0 tx=0).stop 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 -- 172.21.15.73:0/3665046563 shutdown_connections 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 --2- 172.21.15.73:0/3665046563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b2530 0x7f4ae0072520 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 --2- 172.21.15.73:0/3665046563 >> v2:172.21.15.118:3300/0 conn(0x7f4ae0146110 0x7f4ae00cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 -- 172.21.15.73:0/3665046563 >> 172.21.15.73:0/3665046563 conn(0x7f4ae0067dd0 msgr2=0x7f4ae00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 -- 172.21.15.73:0/3665046563 shutdown_connections 2024-04-15T15:32:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 -- 172.21.15.73:0/3665046563 wait complete. 2024-04-15T15:32:37.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 Processor -- start 2024-04-15T15:32:37.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 -- start start 2024-04-15T15:32:37.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.081+0000 7f4ae6200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b20b0 0x7f4ae01faf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ae6200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ae00b2530 0x7f4ae013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ae6200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ae0146110 0x7f4ae0143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ae6200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae00b3d70 con 0x7f4ae00b20b0 2024-04-15T15:32:37.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ae6200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae00b2980 con 0x7f4ae0146110 2024-04-15T15:32:37.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ae6200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae00cdcf0 con 0x7f4ae00b2530 2024-04-15T15:32:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adf400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b20b0 0x7f4ae01faf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adf400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b20b0 0x7f4ae01faf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58756/0 (socket says 172.21.15.73:58756) 2024-04-15T15:32:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adf400640 1 -- 172.21.15.73:0/12302926 learned_addr learned my addr 172.21.15.73:0/12302926 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adea00640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ae00b2530 0x7f4ae013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adfe00640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ae0146110 0x7f4ae0143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adf400640 1 -- 172.21.15.73:0/12302926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ae00b2530 msgr2=0x7f4ae013bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adf400640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ae00b2530 0x7f4ae013bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adf400640 1 -- 172.21.15.73:0/12302926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ae0146110 msgr2=0x7f4ae0143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:37.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adf400640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ae0146110 0x7f4ae0143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adf400640 1 -- 172.21.15.73:0/12302926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae013c260 con 0x7f4ae00b20b0 2024-04-15T15:32:37.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adea00640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ae00b2530 0x7f4ae013bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:37.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4adf400640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b20b0 0x7f4ae01faf50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000efc0 tx=0x7f4ad000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:37.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ad7400640 1 -- 172.21.15.73:0/12302926 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0018020 con 0x7f4ae00b20b0 2024-04-15T15:32:37.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ad7400640 1 -- 172.21.15.73:0/12302926 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad0014480 con 0x7f4ae00b20b0 2024-04-15T15:32:37.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ae6200640 1 -- 172.21.15.73:0/12302926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae013c540 con 0x7f4ae00b20b0 2024-04-15T15:32:37.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ad7400640 1 -- 172.21.15.73:0/12302926 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0014850 con 0x7f4ae00b20b0 2024-04-15T15:32:37.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ae6200640 1 -- 172.21.15.73:0/12302926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae01fa750 con 0x7f4ae00b20b0 2024-04-15T15:32:37.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ae6200640 1 -- 172.21.15.73:0/12302926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae0068ab0 con 0x7f4ae00b20b0 2024-04-15T15:32:37.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.085+0000 7f4ad7400640 1 -- 172.21.15.73:0/12302926 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ad001b020 con 0x7f4ae00b20b0 2024-04-15T15:32:37.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.089+0000 7f4ad7400640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ac0068380 0x7f4ac006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.089+0000 7f4ad7400640 1 -- 172.21.15.73:0/12302926 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f4ad0087940 con 0x7f4ae00b20b0 2024-04-15T15:32:37.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.089+0000 7f4adea00640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ac0068380 0x7f4ac006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.089+0000 7f4adea00640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ac0068380 0x7f4ac006a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4acc000f70 tx=0x7f4acc007c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:37.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.093+0000 7f4ad7400640 1 -- 172.21.15.73:0/12302926 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ad0022070 con 0x7f4ae00b20b0 2024-04-15T15:32:37.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.281+0000 7f4ae6200640 1 -- 172.21.15.73:0/12302926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4ae01452b0 con 0x7f4ae00b20b0 2024-04-15T15:32:37.282 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-04-15T15:32:37.281+0000 7f0e1ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T15:32:37.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ad7400640 1 -- 172.21.15.73:0/12302926 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f4ad0010040 con 0x7f4ae00b20b0 2024-04-15T15:32:37.284 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-15T15:32:37.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 -- 172.21.15.73:0/12302926 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ac0068380 msgr2=0x7f4ac006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:37.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ac0068380 0x7f4ac006a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4acc000f70 tx=0x7f4acc007c40 comp rx=0 tx=0).stop 2024-04-15T15:32:37.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 -- 172.21.15.73:0/12302926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b20b0 msgr2=0x7f4ae01faf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:37.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b20b0 0x7f4ae01faf50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000efc0 tx=0x7f4ad000c490 comp rx=0 tx=0).stop 2024-04-15T15:32:37.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 -- 172.21.15.73:0/12302926 shutdown_connections 2024-04-15T15:32:37.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ae0146110 0x7f4ae0143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ac0068380 0x7f4ac006a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ae00b2530 0x7f4ae013bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 --2- 172.21.15.73:0/12302926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae00b20b0 0x7f4ae01faf50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 -- 172.21.15.73:0/12302926 >> 172.21.15.73:0/12302926 conn(0x7f4ae0067dd0 msgr2=0x7f4ae0071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.285+0000 7f4ae6200640 1 -- 172.21.15.73:0/12302926 shutdown_connections 2024-04-15T15:32:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.289+0000 7f4ae6200640 1 -- 172.21.15.73:0/12302926 wait complete. 2024-04-15T15:32:37.298 INFO:tasks.ceph.mds.c.smithi073.stderr: -5585> 2024-04-15T15:31:37.913+0000 7fda65200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-15T15:32:37.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-15T15:32:37.348 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-04-15T15:32:37.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31da600640 1 Processor -- start 2024-04-15T15:32:37.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31da600640 1 -- start start 2024-04-15T15:32:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31da600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31d4146110 0x7f31d40cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31da600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31d40b2530 0x7f31d4072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31da600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d40cd3a0 con 0x7f31d40b20b0 2024-04-15T15:32:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31da600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f31d40b29c0 con 0x7f31d4146110 2024-04-15T15:32:37.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31da600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f31d40b5160 con 0x7f31d40b2530 2024-04-15T15:32:37.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31d3400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31d4146110 0x7f31d40cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31d3400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31d4146110 0x7f31d40cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58518/0 (socket says 172.21.15.73:58518) 2024-04-15T15:32:37.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31d3400640 1 -- 172.21.15.73:0/1673427891 learned_addr learned my addr 172.21.15.73:0/1673427891 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:37.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31d3e00640 1 --2- 172.21.15.73:0/1673427891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31d40b2530 0x7f31d4072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31d3400640 1 -- 172.21.15.73:0/1673427891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31d40b2530 msgr2=0x7f31d4072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:37.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31d3400640 1 --2- 172.21.15.73:0/1673427891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31d40b2530 0x7f31d4072520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31d3400640 1 -- 172.21.15.73:0/1673427891 >> v1:172.21.15.118:6789/0 conn(0x7f31d40b20b0 legacy=0x7f31d4071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:37.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.453+0000 7f31d3400640 1 -- 172.21.15.73:0/1673427891 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d40b40c0 con 0x7f31d4146110 2024-04-15T15:32:37.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31d3400640 1 --2- 172.21.15.73:0/1673427891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4146110 0x7f31d40cd7b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009870 tx=0x7f31c401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a39d3fc2c7fcf server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:37.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31d2000640 1 -- 172.21.15.73:0/1673427891 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c40aa610 con 0x7f31d4146110 2024-04-15T15:32:37.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31d2000640 1 -- 172.21.15.73:0/1673427891 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c40af070 con 0x7f31d4146110 2024-04-15T15:32:37.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31d2000640 1 -- 172.21.15.73:0/1673427891 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c40aa9d0 con 0x7f31d4146110 2024-04-15T15:32:37.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31da600640 1 -- 172.21.15.73:0/1673427891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4146110 msgr2=0x7f31d40cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:37.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31da600640 1 --2- 172.21.15.73:0/1673427891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4146110 0x7f31d40cd7b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009870 tx=0x7f31c401c4f0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31da600640 1 -- 172.21.15.73:0/1673427891 shutdown_connections 2024-04-15T15:32:37.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31da600640 1 --2- 172.21.15.73:0/1673427891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31d40b2530 0x7f31d4072520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31da600640 1 --2- 172.21.15.73:0/1673427891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d4146110 0x7f31d40cd7b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31da600640 1 -- 172.21.15.73:0/1673427891 >> 172.21.15.73:0/1673427891 conn(0x7f31d4067dd0 msgr2=0x7f31d40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:37.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31da600640 1 -- 172.21.15.73:0/1673427891 shutdown_connections 2024-04-15T15:32:37.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.457+0000 7f31da600640 1 -- 172.21.15.73:0/1673427891 wait complete. 2024-04-15T15:32:37.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31da600640 1 Processor -- start 2024-04-15T15:32:37.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31da600640 1 -- start start 2024-04-15T15:32:37.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31da600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40b20b0 0x7f31d41384c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31da600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31d40b2530 0x7f31d40a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31da600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d4146110 0x7f31d40a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31da600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f31d40b3d70 con 0x7f31d40b20b0 2024-04-15T15:32:37.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31da600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f31d40b4c40 con 0x7f31d4146110 2024-04-15T15:32:37.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31da600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f31d40cdcf0 con 0x7f31d40b2530 2024-04-15T15:32:37.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40b20b0 0x7f31d41384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40b20b0 0x7f31d41384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58522/0 (socket says 172.21.15.73:58522) 2024-04-15T15:32:37.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d3400640 1 -- 172.21.15.73:0/3183416835 learned_addr learned my addr 172.21.15.73:0/3183416835 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:37.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d2a00640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31d40b2530 0x7f31d40a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d3e00640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d4146110 0x7f31d40a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d3400640 1 -- 172.21.15.73:0/3183416835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31d40b2530 msgr2=0x7f31d40a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:37.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d3400640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31d40b2530 0x7f31d40a94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d3400640 1 -- 172.21.15.73:0/3183416835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d4146110 msgr2=0x7f31d40a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:37.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d3400640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d4146110 0x7f31d40a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:37.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d3400640 1 -- 172.21.15.73:0/3183416835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d413a970 con 0x7f31d40b20b0 2024-04-15T15:32:37.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31d3400640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40b20b0 0x7f31d41384c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f31c40ac040 tx=0x7f31c401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:37.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31cb400640 1 -- 172.21.15.73:0/3183416835 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c40bd5f0 con 0x7f31d40b20b0 2024-04-15T15:32:37.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31cb400640 1 -- 172.21.15.73:0/3183416835 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c40bd7b0 con 0x7f31d40b20b0 2024-04-15T15:32:37.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31cb400640 1 -- 172.21.15.73:0/3183416835 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c40bdba0 con 0x7f31d40b20b0 2024-04-15T15:32:37.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31da600640 1 -- 172.21.15.73:0/3183416835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d4138ed0 con 0x7f31d40b20b0 2024-04-15T15:32:37.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.461+0000 7f31da600640 1 -- 172.21.15.73:0/3183416835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d4139490 con 0x7f31d40b20b0 2024-04-15T15:32:37.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.465+0000 7f31da600640 1 -- 172.21.15.73:0/3183416835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d4068ab0 con 0x7f31d40b20b0 2024-04-15T15:32:37.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.465+0000 7f31cb400640 1 -- 172.21.15.73:0/3183416835 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31c40b33f0 con 0x7f31d40b20b0 2024-04-15T15:32:37.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.465+0000 7f31cb400640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31b4068380 0x7f31b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:37.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.465+0000 7f31cb400640 1 -- 172.21.15.73:0/3183416835 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6829+0+0 (secure 0 0 0) 0x7f31c41217b0 con 0x7f31d40b20b0 2024-04-15T15:32:37.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.465+0000 7f31d2a00640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31b4068380 0x7f31b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:37.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.465+0000 7f31d2a00640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31b4068380 0x7f31b406a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f31d406fa90 tx=0x7f31c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:37.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.469+0000 7f31cb400640 1 -- 172.21.15.73:0/3183416835 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31c40a7070 con 0x7f31d40b20b0 2024-04-15T15:32:37.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:37.665+0000 7f31da600640 1 -- 172.21.15.73:0/3183416835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f31d40b3390 con 0x7f31d40b20b0 2024-04-15T15:32:38.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31cb400640 1 -- 172.21.15.73:0/3183416835 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f31c4016110 con 0x7f31d40b20b0 2024-04-15T15:32:38.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 -- 172.21.15.73:0/3183416835 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31b4068380 msgr2=0x7f31b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:38.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31b4068380 0x7f31b406a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f31d406fa90 tx=0x7f31c0009040 comp rx=0 tx=0).stop 2024-04-15T15:32:38.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 -- 172.21.15.73:0/3183416835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40b20b0 msgr2=0x7f31d41384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:38.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40b20b0 0x7f31d41384c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f31c40ac040 tx=0x7f31c401ad30 comp rx=0 tx=0).stop 2024-04-15T15:32:38.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 -- 172.21.15.73:0/3183416835 shutdown_connections 2024-04-15T15:32:38.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d4146110 0x7f31d40a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:38.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31b4068380 0x7f31b406a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:38.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31d40b2530 0x7f31d40a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:38.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 --2- 172.21.15.73:0/3183416835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40b20b0 0x7f31d41384c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:38.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 -- 172.21.15.73:0/3183416835 >> 172.21.15.73:0/3183416835 conn(0x7f31d4067dd0 msgr2=0x7f31d40b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:38.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 -- 172.21.15.73:0/3183416835 shutdown_connections 2024-04-15T15:32:38.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.293+0000 7f31da600640 1 -- 172.21.15.73:0/3183416835 wait complete. 2024-04-15T15:32:38.320 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-15T15:32:38.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb51f600640 1 Processor -- start 2024-04-15T15:32:38.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb51f600640 1 -- start start 2024-04-15T15:32:38.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb51f600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 0x7fb51815c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:38.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb51f600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5180ceb40 0x7fb5180cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:38.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb51f600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51815be20 con 0x7fb51806ba50 2024-04-15T15:32:38.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb51f600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb518159720 con 0x7fb5180ceb40 2024-04-15T15:32:38.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb51f600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb5180cf6b0 con 0x7fb518159340 2024-04-15T15:32:38.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb50fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5180ceb40 0x7fb5180cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:38.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb50fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5180ceb40 0x7fb5180cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58526/0 (socket says 172.21.15.73:58526) 2024-04-15T15:32:38.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb50fe00640 1 -- 172.21.15.73:0/1584521052 learned_addr learned my addr 172.21.15.73:0/1584521052 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:38.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb51cc00640 1 --2- 172.21.15.73:0/1584521052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 0x7fb51815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:38.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb50fe00640 1 -- 172.21.15.73:0/1584521052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 msgr2=0x7fb51815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:38.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb50fe00640 1 --2- 172.21.15.73:0/1584521052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 0x7fb51815c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:38.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb50fe00640 1 -- 172.21.15.73:0/1584521052 >> v1:172.21.15.118:6789/0 conn(0x7fb51806ba50 legacy=0x7fb51806be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:38.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb50fe00640 1 -- 172.21.15.73:0/1584521052 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51815c090 con 0x7fb5180ceb40 2024-04-15T15:32:38.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.505+0000 7fb51cc00640 1 --2- 172.21.15.73:0/1584521052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 0x7fb51815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:38.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb50fe00640 1 --2- 172.21.15.73:0/1584521052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180ceb40 0x7fb5180cefa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb500009870 tx=0x7fb50001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9393efe75d4466 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:38.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb517e00640 1 -- 172.21.15.73:0/1584521052 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5000ab610 con 0x7fb5180ceb40 2024-04-15T15:32:38.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb517e00640 1 -- 172.21.15.73:0/1584521052 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5000b0070 con 0x7fb5180ceb40 2024-04-15T15:32:38.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb517e00640 1 -- 172.21.15.73:0/1584521052 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5000ab9d0 con 0x7fb5180ceb40 2024-04-15T15:32:38.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb51f600640 1 -- 172.21.15.73:0/1584521052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180ceb40 msgr2=0x7fb5180cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:38.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb51f600640 1 --2- 172.21.15.73:0/1584521052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180ceb40 0x7fb5180cefa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb500009870 tx=0x7fb50001c560 comp rx=0 tx=0).stop 2024-04-15T15:32:38.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb51f600640 1 -- 172.21.15.73:0/1584521052 shutdown_connections 2024-04-15T15:32:38.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb51f600640 1 --2- 172.21.15.73:0/1584521052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5180ceb40 0x7fb5180cefa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:38.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb51f600640 1 --2- 172.21.15.73:0/1584521052 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 0x7fb51815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:38.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb51f600640 1 -- 172.21.15.73:0/1584521052 >> 172.21.15.73:0/1584521052 conn(0x7fb518067e30 msgr2=0x7fb5180b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:38.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb51f600640 1 -- 172.21.15.73:0/1584521052 shutdown_connections 2024-04-15T15:32:38.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.509+0000 7fb51f600640 1 -- 172.21.15.73:0/1584521052 wait complete. 2024-04-15T15:32:38.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51f600640 1 Processor -- start 2024-04-15T15:32:38.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51f600640 1 -- start start 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51f600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb51806ba50 0x7fb51814d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51f600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180ceb40 0x7fb51814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51f600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 0x7fb5180d0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51f600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb5180b4400 con 0x7fb51806ba50 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51f600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb5180b4280 con 0x7fb5180ceb40 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51f600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb5180b4580 con 0x7fb518159340 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb51806ba50 0x7fb51814d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb51806ba50 0x7fb51814d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58536/0 (socket says 172.21.15.73:58536) 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51cc00640 1 -- 172.21.15.73:0/4074125281 learned_addr learned my addr 172.21.15.73:0/4074125281 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb50fe00640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180ceb40 0x7fb51814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51d600640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 0x7fb5180d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51cc00640 1 -- 172.21.15.73:0/4074125281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 msgr2=0x7fb5180d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:38.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51cc00640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 0x7fb5180d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:38.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51cc00640 1 -- 172.21.15.73:0/4074125281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180ceb40 msgr2=0x7fb51814df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:38.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51cc00640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180ceb40 0x7fb51814df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:38.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51cc00640 1 -- 172.21.15.73:0/4074125281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb518155c90 con 0x7fb51806ba50 2024-04-15T15:32:38.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51cc00640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb51806ba50 0x7fb51814d160 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb50800d800 tx=0x7fb50800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:38.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb515600640 1 -- 172.21.15.73:0/4074125281 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508018020 con 0x7fb51806ba50 2024-04-15T15:32:38.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb515600640 1 -- 172.21.15.73:0/4074125281 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5080096c0 con 0x7fb51806ba50 2024-04-15T15:32:38.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51f600640 1 -- 172.21.15.73:0/4074125281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51814dbe0 con 0x7fb51806ba50 2024-04-15T15:32:38.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb515600640 1 -- 172.21.15.73:0/4074125281 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508009ab0 con 0x7fb51806ba50 2024-04-15T15:32:38.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.513+0000 7fb51f600640 1 -- 172.21.15.73:0/4074125281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5181513f0 con 0x7fb51806ba50 2024-04-15T15:32:38.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.517+0000 7fb51f600640 1 -- 172.21.15.73:0/4074125281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb518068b20 con 0x7fb51806ba50 2024-04-15T15:32:38.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.517+0000 7fb515600640 1 -- 172.21.15.73:0/4074125281 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb50801b020 con 0x7fb51806ba50 2024-04-15T15:32:38.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.517+0000 7fb515600640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f40683b0 0x7fb4f406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:38.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.517+0000 7fb515600640 1 -- 172.21.15.73:0/4074125281 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6829+0+0 (secure 0 0 0) 0x7fb508087260 con 0x7fb51806ba50 2024-04-15T15:32:38.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.517+0000 7fb50fe00640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f40683b0 0x7fb4f406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:38.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.517+0000 7fb50fe00640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f40683b0 0x7fb4f406a870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb5000af000 tx=0x7fb5000a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:38.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.521+0000 7fb515600640 1 -- 172.21.15.73:0/4074125281 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb508022020 con 0x7fb51806ba50 2024-04-15T15:32:38.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:38.689+0000 7fb51f600640 1 -- 172.21.15.73:0/4074125281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb51814e440 con 0x7fb51806ba50 2024-04-15T15:32:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.665+0000 7fb515600640 1 -- 172.21.15.73:0/4074125281 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fb51814dbe0 con 0x7fb51806ba50 2024-04-15T15:32:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 -- 172.21.15.73:0/4074125281 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f40683b0 msgr2=0x7fb4f406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f40683b0 0x7fb4f406a870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb5000af000 tx=0x7fb5000a7000 comp rx=0 tx=0).stop 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 -- 172.21.15.73:0/4074125281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb51806ba50 msgr2=0x7fb51814d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb51806ba50 0x7fb51814d160 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb50800d800 tx=0x7fb50800dcc0 comp rx=0 tx=0).stop 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 -- 172.21.15.73:0/4074125281 shutdown_connections 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb4f40683b0 0x7fb4f406a870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb518159340 0x7fb5180d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5180ceb40 0x7fb51814df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 --2- 172.21.15.73:0/4074125281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb51806ba50 0x7fb51814d160 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 -- 172.21.15.73:0/4074125281 >> 172.21.15.73:0/4074125281 conn(0x7fb518067e30 msgr2=0x7fb5180b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 -- 172.21.15.73:0/4074125281 shutdown_connections 2024-04-15T15:32:39.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.669+0000 7fb51f600640 1 -- 172.21.15.73:0/4074125281 wait complete. 2024-04-15T15:32:39.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-15T15:32:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.837+0000 7f92e6e00640 1 Processor -- start 2024-04-15T15:32:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.837+0000 7f92e6e00640 1 -- start start 2024-04-15T15:32:39.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.837+0000 7f92e6e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f92e006c160 0x7f92e00ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:39.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92e6e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92e015ec50 0x7f92e00b5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:39.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92e6e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e00cfbd0 con 0x7f92e015e870 2024-04-15T15:32:39.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92e6e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f92e00cfeb0 con 0x7f92e015ec50 2024-04-15T15:32:39.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92e6e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f92e0072bf0 con 0x7f92e006c160 2024-04-15T15:32:39.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92e4e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92e015ec50 0x7f92e00b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92dfe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f92e015e870 0x7f92e006ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52644/0 (socket says 172.21.15.73:52644) 2024-04-15T15:32:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92dfe00640 1 -- 172.21.15.73:0/1378280331 learned_addr learned my addr 172.21.15.73:0/1378280331 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92d7400640 1 --2- 172.21.15.73:0/1378280331 >> v2:172.21.15.118:3300/0 conn(0x7f92e006c160 0x7f92e00ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92e4e00640 1 -- 172.21.15.73:0/1378280331 >> v2:172.21.15.118:3300/0 conn(0x7f92e006c160 msgr2=0x7f92e00ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92e4e00640 1 --2- 172.21.15.73:0/1378280331 >> v2:172.21.15.118:3300/0 conn(0x7f92e006c160 0x7f92e00ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:39.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92e4e00640 1 -- 172.21.15.73:0/1378280331 >> v1:172.21.15.73:6789/0 conn(0x7f92e015e870 legacy=0x7f92e006ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:39.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92e4e00640 1 -- 172.21.15.73:0/1378280331 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e0072ed0 con 0x7f92e015ec50 2024-04-15T15:32:39.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92df400640 1 -- 172.21.15.73:0/1378280331 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572097534 0 0) 0x7f92e00cfbd0 con 0x7f92e015e870 2024-04-15T15:32:39.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92e4e00640 1 --2- 172.21.15.73:0/1378280331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015ec50 0x7f92e00b5120 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f92d80097c0 tx=0x7f92d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d7a956c3ff2e93 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:39.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92df400640 1 -- 172.21.15.73:0/1378280331 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80b0070 con 0x7f92e015ec50 2024-04-15T15:32:39.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92df400640 1 -- 172.21.15.73:0/1378280331 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d80ab600 con 0x7f92e015ec50 2024-04-15T15:32:39.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.841+0000 7f92df400640 1 -- 172.21.15.73:0/1378280331 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80ab9d0 con 0x7f92e015ec50 2024-04-15T15:32:39.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 -- 172.21.15.73:0/1378280331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015ec50 msgr2=0x7f92e00b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:39.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 --2- 172.21.15.73:0/1378280331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015ec50 0x7f92e00b5120 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f92d80097c0 tx=0x7f92d801c460 comp rx=0 tx=0).stop 2024-04-15T15:32:39.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 -- 172.21.15.73:0/1378280331 shutdown_connections 2024-04-15T15:32:39.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 --2- 172.21.15.73:0/1378280331 >> v2:172.21.15.118:3300/0 conn(0x7f92e006c160 0x7f92e00ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:39.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 --2- 172.21.15.73:0/1378280331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015ec50 0x7f92e00b5120 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:39.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 -- 172.21.15.73:0/1378280331 >> 172.21.15.73:0/1378280331 conn(0x7f92e0067e30 msgr2=0x7f92e00b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:39.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 -- 172.21.15.73:0/1378280331 shutdown_connections 2024-04-15T15:32:39.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 -- 172.21.15.73:0/1378280331 wait complete. 2024-04-15T15:32:39.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 Processor -- start 2024-04-15T15:32:39.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 -- start start 2024-04-15T15:32:39.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e006c160 0x7f92e01509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:39.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015e870 0x7f92e00b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92e015ec50 0x7f92e00ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0163390 con 0x7f92e015e870 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0163210 con 0x7f92e006c160 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e6e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f92e0163510 con 0x7f92e015ec50 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92d7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015e870 0x7f92e00b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92d7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015e870 0x7f92e00b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58556/0 (socket says 172.21.15.73:58556) 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92d7400640 1 -- 172.21.15.73:0/2724455599 learned_addr learned my addr 172.21.15.73:0/2724455599 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92dfe00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e006c160 0x7f92e01509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92e4e00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92e015ec50 0x7f92e00ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92d7400640 1 -- 172.21.15.73:0/2724455599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92e015ec50 msgr2=0x7f92e00ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92d7400640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92e015ec50 0x7f92e00ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:39.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92d7400640 1 -- 172.21.15.73:0/2724455599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e006c160 msgr2=0x7f92e01509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92d7400640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e006c160 0x7f92e01509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92d7400640 1 -- 172.21.15.73:0/2724455599 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e0150ee0 con 0x7f92e015e870 2024-04-15T15:32:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.845+0000 7f92dfe00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e006c160 0x7f92e01509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92d7400640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015e870 0x7f92e00b20a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f92c800d830 tx=0x7f92c800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92dcc00640 1 -- 172.21.15.73:0/2724455599 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c800b6c0 con 0x7f92e015e870 2024-04-15T15:32:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92dcc00640 1 -- 172.21.15.73:0/2724455599 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c8019070 con 0x7f92e015e870 2024-04-15T15:32:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92dcc00640 1 -- 172.21.15.73:0/2724455599 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c800ba60 con 0x7f92e015e870 2024-04-15T15:32:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92e6e00640 1 -- 172.21.15.73:0/2724455599 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e00b25e0 con 0x7f92e015e870 2024-04-15T15:32:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92e6e00640 1 -- 172.21.15.73:0/2724455599 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e0158bc0 con 0x7f92e015e870 2024-04-15T15:32:39.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92e6e00640 1 -- 172.21.15.73:0/2724455599 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e0068b20 con 0x7f92e015e870 2024-04-15T15:32:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92dcc00640 1 -- 172.21.15.73:0/2724455599 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f92c801e460 con 0x7f92e015e870 2024-04-15T15:32:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92dcc00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f92bc068380 0x7f92bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92dcc00640 1 -- 172.21.15.73:0/2724455599 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6391+0+0 (secure 0 0 0) 0x7f92c80873d0 con 0x7f92e015e870 2024-04-15T15:32:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.849+0000 7f92dfe00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f92bc068380 0x7f92bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:39.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.853+0000 7f92dfe00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f92bc068380 0x7f92bc06a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92d00012f0 tx=0x7f92d0005b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:39.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:39.853+0000 7f92dcc00640 1 -- 172.21.15.73:0/2724455599 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f92e00b25e0 con 0x7f92e015e870 2024-04-15T15:32:40.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.009+0000 7f92e6e00640 1 -- 172.21.15.73:0/2724455599 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f92e006bdd0 con 0x7f92e015e870 2024-04-15T15:32:40.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.669+0000 7f92dcc00640 1 -- 172.21.15.73:0/2724455599 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f92c8057640 con 0x7f92e015e870 2024-04-15T15:32:40.670 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-04-15T15:32:40.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 -- 172.21.15.73:0/2724455599 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f92bc068380 msgr2=0x7f92bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:40.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f92bc068380 0x7f92bc06a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92d00012f0 tx=0x7f92d0005b80 comp rx=0 tx=0).stop 2024-04-15T15:32:40.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 -- 172.21.15.73:0/2724455599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015e870 msgr2=0x7f92e00b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:40.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015e870 0x7f92e00b20a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f92c800d830 tx=0x7f92c800dcf0 comp rx=0 tx=0).stop 2024-04-15T15:32:40.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 -- 172.21.15.73:0/2724455599 shutdown_connections 2024-04-15T15:32:40.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f92bc068380 0x7f92bc06a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:40.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92e015ec50 0x7f92e00ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:40.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92e015e870 0x7f92e00b20a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:40.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 --2- 172.21.15.73:0/2724455599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e006c160 0x7f92e01509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:40.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 -- 172.21.15.73:0/2724455599 >> 172.21.15.73:0/2724455599 conn(0x7f92e0067e30 msgr2=0x7f92e00ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:40.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 -- 172.21.15.73:0/2724455599 shutdown_connections 2024-04-15T15:32:40.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.673+0000 7f92e6e00640 1 -- 172.21.15.73:0/2724455599 wait complete. 2024-04-15T15:32:40.702 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-15T15:32:40.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.841+0000 7f1bf9e00640 1 Processor -- start 2024-04-15T15:32:40.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.841+0000 7f1bf9e00640 1 -- start start 2024-04-15T15:32:40.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bf9e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1bf4142c90 0x7f1bf40b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:40.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bf9e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bf406c010 con 0x7f1bf4143070 2024-04-15T15:32:40.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bf9e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bf406c2f0 con 0x7f1bf40cff20 2024-04-15T15:32:40.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bf9e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1bf40b4ae0 con 0x7f1bf4142c90 2024-04-15T15:32:40.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bebe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1bf4143070 0x7f1bf40cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52660/0 (socket says 172.21.15.73:52660) 2024-04-15T15:32:40.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bebe00640 1 -- 172.21.15.73:0/1261049393 learned_addr learned my addr 172.21.15.73:0/1261049393 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:40.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bf2a00640 1 --2- 172.21.15.73:0/1261049393 >> v2:172.21.15.73:3300/0 conn(0x7f1bf4142c90 0x7f1bf40b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:40.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bf2000640 1 -- 172.21.15.73:0/1261049393 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168638779 0 0) 0x7f1bf406c010 con 0x7f1bf4143070 2024-04-15T15:32:40.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bf2000640 1 -- 172.21.15.73:0/1261049393 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bd8003530 con 0x7f1bf4143070 2024-04-15T15:32:40.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bf2a00640 1 -- 172.21.15.73:0/1261049393 >> v1:172.21.15.118:6789/0 conn(0x7f1bf40cff20 legacy=0x7f1bf40ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:40.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bf2a00640 1 -- 172.21.15.73:0/1261049393 >> v1:172.21.15.73:6789/0 conn(0x7f1bf4143070 legacy=0x7f1bf40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:40.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.845+0000 7f1bf2a00640 1 -- 172.21.15.73:0/1261049393 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf40b4d10 con 0x7f1bf4142c90 2024-04-15T15:32:40.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf2a00640 1 --2- 172.21.15.73:0/1261049393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf4142c90 0x7f1bf40b5510 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1be40097c0 tx=0x7f1be401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78bcb719787b35d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:40.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf2000640 1 -- 172.21.15.73:0/1261049393 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be40b0070 con 0x7f1bf4142c90 2024-04-15T15:32:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf2000640 1 -- 172.21.15.73:0/1261049393 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be40ab600 con 0x7f1bf4142c90 2024-04-15T15:32:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf2000640 1 -- 172.21.15.73:0/1261049393 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be40ab9d0 con 0x7f1bf4142c90 2024-04-15T15:32:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 -- 172.21.15.73:0/1261049393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf4142c90 msgr2=0x7f1bf40b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 --2- 172.21.15.73:0/1261049393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf4142c90 0x7f1bf40b5510 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1be40097c0 tx=0x7f1be401c4a0 comp rx=0 tx=0).stop 2024-04-15T15:32:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 -- 172.21.15.73:0/1261049393 shutdown_connections 2024-04-15T15:32:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 --2- 172.21.15.73:0/1261049393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf4142c90 0x7f1bf40b5510 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 -- 172.21.15.73:0/1261049393 >> 172.21.15.73:0/1261049393 conn(0x7f1bf4067e30 msgr2=0x7f1bf40b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 -- 172.21.15.73:0/1261049393 shutdown_connections 2024-04-15T15:32:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 -- 172.21.15.73:0/1261049393 wait complete. 2024-04-15T15:32:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 Processor -- start 2024-04-15T15:32:40.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 -- start start 2024-04-15T15:32:40.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf40cff20 0x7f1bf415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:40.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bf4142c90 0x7f1bf4144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bf4143070 0x7f1bf4144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf416a9c0 con 0x7f1bf40cff20 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf416a840 con 0x7f1bf4142c90 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.849+0000 7f1bf9e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf416ab40 con 0x7f1bf4143070 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf2a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf40cff20 0x7f1bf415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf2a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf40cff20 0x7f1bf415bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58584/0 (socket says 172.21.15.73:58584) 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf2a00640 1 -- 172.21.15.73:0/217257011 learned_addr learned my addr 172.21.15.73:0/217257011 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf2a00640 1 -- 172.21.15.73:0/217257011 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bf4143070 msgr2=0x7f1bf4144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bebe00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bf4142c90 0x7f1bf4144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf2a00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bf4143070 0x7f1bf4144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf2a00640 1 -- 172.21.15.73:0/217257011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bf4142c90 msgr2=0x7f1bf4144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:40.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf2a00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bf4142c90 0x7f1bf4144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:40.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf2a00640 1 -- 172.21.15.73:0/217257011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf4139710 con 0x7f1bf40cff20 2024-04-15T15:32:40.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bebe00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bf4142c90 0x7f1bf4144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:40.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf2a00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf40cff20 0x7f1bf415bde0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1be40ae040 tx=0x7f1be401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:40.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1beb400640 1 -- 172.21.15.73:0/217257011 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be40b0050 con 0x7f1bf40cff20 2024-04-15T15:32:40.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1beb400640 1 -- 172.21.15.73:0/217257011 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be40bc070 con 0x7f1bf40cff20 2024-04-15T15:32:40.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1beb400640 1 -- 172.21.15.73:0/217257011 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be40b5870 con 0x7f1bf40cff20 2024-04-15T15:32:40.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf9e00640 1 -- 172.21.15.73:0/217257011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf41399f0 con 0x7f1bf40cff20 2024-04-15T15:32:40.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf9e00640 1 -- 172.21.15.73:0/217257011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf4139fb0 con 0x7f1bf40cff20 2024-04-15T15:32:40.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1bf9e00640 1 -- 172.21.15.73:0/217257011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf4068b20 con 0x7f1bf40cff20 2024-04-15T15:32:40.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1beb400640 1 -- 172.21.15.73:0/217257011 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1be40b5a10 con 0x7f1bf40cff20 2024-04-15T15:32:40.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1beb400640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1bd0068380 0x7f1bd006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:40.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.853+0000 7f1beb400640 1 -- 172.21.15.73:0/217257011 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f1be41212a0 con 0x7f1bf40cff20 2024-04-15T15:32:40.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.857+0000 7f1bebe00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1bd0068380 0x7f1bd006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:40.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.857+0000 7f1bebe00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1bd0068380 0x7f1bd006a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40cc4b0 tx=0x7f1bdc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:40.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:40.861+0000 7f1beb400640 1 -- 172.21.15.73:0/217257011 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1be4016090 con 0x7f1bf40cff20 2024-04-15T15:32:41.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.017+0000 7f1bf9e00640 1 -- 172.21.15.73:0/217257011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1bf4073080 con 0x7f1bf40cff20 2024-04-15T15:32:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.681+0000 7f1beb400640 1 -- 172.21.15.73:0/217257011 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f1be40f1850 con 0x7f1bf40cff20 2024-04-15T15:32:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data_ec' removed 2024-04-15T15:32:41.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 -- 172.21.15.73:0/217257011 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1bd0068380 msgr2=0x7f1bd006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:41.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1bd0068380 0x7f1bd006a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40cc4b0 tx=0x7f1bdc009040 comp rx=0 tx=0).stop 2024-04-15T15:32:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 -- 172.21.15.73:0/217257011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf40cff20 msgr2=0x7f1bf415bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf40cff20 0x7f1bf415bde0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1be40ae040 tx=0x7f1be401ace0 comp rx=0 tx=0).stop 2024-04-15T15:32:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 -- 172.21.15.73:0/217257011 shutdown_connections 2024-04-15T15:32:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1bd0068380 0x7f1bd006a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bf4143070 0x7f1bf4144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bf4142c90 0x7f1bf4144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 --2- 172.21.15.73:0/217257011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf40cff20 0x7f1bf415bde0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 -- 172.21.15.73:0/217257011 >> 172.21.15.73:0/217257011 conn(0x7f1bf4067e30 msgr2=0x7f1bf40ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 -- 172.21.15.73:0/217257011 shutdown_connections 2024-04-15T15:32:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.685+0000 7f1bf9e00640 1 -- 172.21.15.73:0/217257011 wait complete. 2024-04-15T15:32:41.711 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-15T15:32:41.711 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-15T15:32:41.712 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-15T15:32:41.712 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:32:41.712 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-15T15:32:41.712 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-15T15:32:41.712 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-15T15:32:41.712 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:32:41.712 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-15T15:32:41.713 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-15T15:32:41.713 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-15T15:32:41.713 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:32:41.713 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-15T15:32:41.713 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-15T15:32:41.713 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-15T15:32:41.713 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:32:41.725 INFO:tasks.ceph.mds.c:Stopped 2024-04-15T15:32:41.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-15T15:32:41.726 INFO:tasks.ceph.mds.a:Stopped 2024-04-15T15:32:41.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-15T15:32:41.727 INFO:tasks.ceph.mds.b:Stopped 2024-04-15T15:32:41.727 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-15T15:32:41.728 INFO:tasks.ceph.mds.d:Stopped 2024-04-15T15:32:41.728 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-15T15:32:41.774 INFO:tasks.ceph.mds.b:Started 2024-04-15T15:32:41.776 DEBUG:teuthology.parallel:result is None 2024-04-15T15:32:41.778 INFO:tasks.ceph.mds.c:Started 2024-04-15T15:32:41.778 INFO:tasks.ceph.mds.d:Started 2024-04-15T15:32:41.779 INFO:tasks.ceph.mds.a:Started 2024-04-15T15:32:41.779 DEBUG:teuthology.parallel:result is None 2024-04-15T15:32:41.779 DEBUG:teuthology.parallel:result is None 2024-04-15T15:32:41.780 DEBUG:teuthology.parallel:result is None 2024-04-15T15:32:41.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-15T15:32:41.861 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-04-15T15:32:41.861 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-04-15T15:32:41.863 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2024-04-15T15:32:41.864 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2024-04-15T15:32:41.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeebe00640 1 Processor -- start 2024-04-15T15:32:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeebe00640 1 -- start start 2024-04-15T15:32:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeebe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efeec15c640 0x7efeec0b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeebe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeec0cede0 0x7efeec0cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeebe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeec15ca20 con 0x7efeec06fdd0 2024-04-15T15:32:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeebe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7efeec0d1310 con 0x7efeec15c640 2024-04-15T15:32:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeebe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efeec0cf780 con 0x7efeec0cede0 2024-04-15T15:32:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeeaa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efeec15c640 0x7efeec0b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeeaa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efeec15c640 0x7efeec0b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:34490/0 (socket says 172.21.15.73:34490) 2024-04-15T15:32:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeeaa00640 1 -- 172.21.15.73:0/709309468 learned_addr learned my addr 172.21.15.73:0/709309468 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efee3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeec0cede0 0x7efeec0cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeeb400640 1 --1- 172.21.15.73:0/709309468 >> v1:172.21.15.118:6789/0 conn(0x7efeec06fdd0 0x7efeec070220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:53394/0 (socket says 172.21.15.73:53394) 2024-04-15T15:32:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeeaa00640 1 -- 172.21.15.73:0/709309468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeec0cede0 msgr2=0x7efeec0cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeeaa00640 1 --2- 172.21.15.73:0/709309468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeec0cede0 0x7efeec0cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeeaa00640 1 -- 172.21.15.73:0/709309468 >> v1:172.21.15.118:6789/0 conn(0x7efeec06fdd0 legacy=0x7efeec070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.925+0000 7efeeaa00640 1 -- 172.21.15.73:0/709309468 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec0d0270 con 0x7efeec15c640 2024-04-15T15:32:41.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeeaa00640 1 --2- 172.21.15.73:0/709309468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeec15c640 0x7efeec0b4710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efedc009870 tx=0x7efedc01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=712d400adf169b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:41.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeea000640 1 -- 172.21.15.73:0/709309468 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc0ab650 con 0x7efeec15c640 2024-04-15T15:32:41.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeea000640 1 -- 172.21.15.73:0/709309468 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efedc0b0070 con 0x7efeec15c640 2024-04-15T15:32:41.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeea000640 1 -- 172.21.15.73:0/709309468 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc0aba10 con 0x7efeec15c640 2024-04-15T15:32:41.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeebe00640 1 -- 172.21.15.73:0/709309468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeec15c640 msgr2=0x7efeec0b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeebe00640 1 --2- 172.21.15.73:0/709309468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeec15c640 0x7efeec0b4710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efedc009870 tx=0x7efedc01c560 comp rx=0 tx=0).stop 2024-04-15T15:32:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeebe00640 1 -- 172.21.15.73:0/709309468 shutdown_connections 2024-04-15T15:32:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeebe00640 1 --2- 172.21.15.73:0/709309468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeec0cede0 0x7efeec0cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeebe00640 1 --2- 172.21.15.73:0/709309468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeec15c640 0x7efeec0b4710 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeebe00640 1 -- 172.21.15.73:0/709309468 >> 172.21.15.73:0/709309468 conn(0x7efeec06ba50 msgr2=0x7efeec06be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeebe00640 1 -- 172.21.15.73:0/709309468 shutdown_connections 2024-04-15T15:32:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeebe00640 1 -- 172.21.15.73:0/709309468 wait complete. 2024-04-15T15:32:41.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeebe00640 1 Processor -- start 2024-04-15T15:32:41.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.929+0000 7efeebe00640 1 -- start start 2024-04-15T15:32:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeebe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeec06fdd0 0x7efeec15db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeebe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeec0cede0 0x7efeec0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeebe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeec15c640 0x7efeec0b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeebe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efeec0ceaa0 con 0x7efeec06fdd0 2024-04-15T15:32:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeebe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efeec0c6ea0 con 0x7efeec0cede0 2024-04-15T15:32:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeebe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efeec0b56f0 con 0x7efeec15c640 2024-04-15T15:32:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeeaa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeec06fdd0 0x7efeec15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeeaa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeec06fdd0 0x7efeec15db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58630/0 (socket says 172.21.15.73:58630) 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeeaa00640 1 -- 172.21.15.73:0/1798113073 learned_addr learned my addr 172.21.15.73:0/1798113073 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efee3e00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeec0cede0 0x7efeec0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeeb400640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeec15c640 0x7efeec0b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeeaa00640 1 -- 172.21.15.73:0/1798113073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeec15c640 msgr2=0x7efeec0b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeeaa00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeec15c640 0x7efeec0b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeeaa00640 1 -- 172.21.15.73:0/1798113073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeec0cede0 msgr2=0x7efeec0b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeeaa00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeec0cede0 0x7efeec0b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeeaa00640 1 -- 172.21.15.73:0/1798113073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec0b50b0 con 0x7efeec06fdd0 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efee3e00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeec0cede0 0x7efeec0b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeeaa00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeec06fdd0 0x7efeec15db30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efedc01ac10 tx=0x7efedc01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efee2a00640 1 -- 172.21.15.73:0/1798113073 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc0be5f0 con 0x7efeec06fdd0 2024-04-15T15:32:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efee2a00640 1 -- 172.21.15.73:0/1798113073 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efedc0be790 con 0x7efeec06fdd0 2024-04-15T15:32:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efee2a00640 1 -- 172.21.15.73:0/1798113073 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc0beb80 con 0x7efeec06fdd0 2024-04-15T15:32:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeebe00640 1 -- 172.21.15.73:0/1798113073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeec1600a0 con 0x7efeec06fdd0 2024-04-15T15:32:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeebe00640 1 -- 172.21.15.73:0/1798113073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeec160660 con 0x7efeec06fdd0 2024-04-15T15:32:41.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.933+0000 7efeebe00640 1 -- 172.21.15.73:0/1798113073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeec160830 con 0x7efeec06fdd0 2024-04-15T15:32:41.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.937+0000 7efee2a00640 1 -- 172.21.15.73:0/1798113073 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efedc0b43f0 con 0x7efeec06fdd0 2024-04-15T15:32:41.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.937+0000 7efee2a00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efec80683b0 0x7efec806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:41.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.937+0000 7efee2a00640 1 -- 172.21.15.73:0/1798113073 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7efedc121200 con 0x7efeec06fdd0 2024-04-15T15:32:41.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.937+0000 7efee3e00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efec80683b0 0x7efec806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:41.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.937+0000 7efee3e00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efec80683b0 0x7efec806a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efeec0c84b0 tx=0x7efed4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:41.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:41.941+0000 7efee2a00640 1 -- 172.21.15.73:0/1798113073 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efedc016150 con 0x7efeec06fdd0 2024-04-15T15:32:42.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.109+0000 7efeebe00640 1 -- 172.21.15.73:0/1798113073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efeec04fd60 con 0x7efeec06fdd0 2024-04-15T15:32:42.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.697+0000 7efee2a00640 1 -- 172.21.15.73:0/1798113073 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7efedc0f1240 con 0x7efeec06fdd0 2024-04-15T15:32:42.699 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2024-04-15T15:32:42.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 -- 172.21.15.73:0/1798113073 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efec80683b0 msgr2=0x7efec806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:42.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efec80683b0 0x7efec806a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efeec0c84b0 tx=0x7efed4009190 comp rx=0 tx=0).stop 2024-04-15T15:32:42.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 -- 172.21.15.73:0/1798113073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeec06fdd0 msgr2=0x7efeec15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:42.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeec06fdd0 0x7efeec15db30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efedc01ac10 tx=0x7efedc01ada0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 -- 172.21.15.73:0/1798113073 shutdown_connections 2024-04-15T15:32:42.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efec80683b0 0x7efec806a870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeec15c640 0x7efeec0b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeec0cede0 0x7efeec0b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 --2- 172.21.15.73:0/1798113073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeec06fdd0 0x7efeec15db30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 -- 172.21.15.73:0/1798113073 >> 172.21.15.73:0/1798113073 conn(0x7efeec06ba50 msgr2=0x7efeec15cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:42.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 -- 172.21.15.73:0/1798113073 shutdown_connections 2024-04-15T15:32:42.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.701+0000 7efeebe00640 1 -- 172.21.15.73:0/1798113073 wait complete. 2024-04-15T15:32:42.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-15T15:32:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f7a02a00640 1 Processor -- start 2024-04-15T15:32:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f7a02a00640 1 -- start start 2024-04-15T15:32:42.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f7a02a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79fc0cd1b0 0x7f79fc09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f7a02a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79fc15cab0 0x7f79fc09afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f7a02a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79fc0cd690 con 0x7f79fc15c6d0 2024-04-15T15:32:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f7a02a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f79fc0cd970 con 0x7f79fc15cab0 2024-04-15T15:32:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f7a02a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f79fc0cdc50 con 0x7f79fc0cd1b0 2024-04-15T15:32:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fbe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f79fc15c6d0 0x7f79fc0d0d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52676/0 (socket says 172.21.15.73:52676) 2024-04-15T15:32:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fbe00640 1 -- 172.21.15.73:0/174107205 learned_addr learned my addr 172.21.15.73:0/174107205 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:42.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f7a00a00640 1 --2- 172.21.15.73:0/174107205 >> v2:172.21.15.118:3300/0 conn(0x7f79fc15cab0 0x7f79fc09afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:42.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fb400640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79fc0cd1b0 0x7f79fc09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:42.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159975347 0 0) 0x7f79fc0cd690 con 0x7f79fc15c6d0 2024-04-15T15:32:42.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79e0003530 con 0x7f79fc15c6d0 2024-04-15T15:32:42.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1952766039 0 0) 0x7f79e0003530 con 0x7f79fc15c6d0 2024-04-15T15:32:42.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79fc0cd1b0 msgr2=0x7f79fc09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:42.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79fc0cd1b0 0x7f79fc09aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 >> v2:172.21.15.118:3300/0 conn(0x7f79fc15cab0 msgr2=0x7f79fc09afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 --2- 172.21.15.73:0/174107205 >> v2:172.21.15.118:3300/0 conn(0x7f79fc15cab0 0x7f79fc09afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc0cdf30 con 0x7f79fc15c6d0 2024-04-15T15:32:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f79ec001800 con 0x7f79fc15c6d0 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f7a00a00640 1 --2- 172.21.15.73:0/174107205 >> v2:172.21.15.118:3300/0 conn(0x7f79fc15cab0 0x7f79fc09afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 >> v1:172.21.15.73:6789/0 conn(0x7f79fc15c6d0 legacy=0x7f79fc0d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79e00039c0 0x7f79e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e0004810 0x7f79e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e00051d0 0x7f79e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc0cd970 con 0x7f79e0004810 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc0cdc50 con 0x7f79e00051d0 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f79e000bf10 con 0x7f79e00039c0 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fb400640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79fc0cd1b0 0x7f79fc09aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fb400640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e0004810 0x7f79e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fbe00640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79e00039c0 0x7f79e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:42.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f7a00a00640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e00051d0 0x7f79e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:42.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fb400640 1 -- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79e00039c0 msgr2=0x7f79e0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:42.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fb400640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79e00039c0 0x7f79e0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fb400640 1 -- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e00051d0 msgr2=0x7f79e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:42.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fb400640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e00051d0 0x7f79e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.861+0000 7f79fb400640 1 -- 172.21.15.73:0/174107205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e0003530 con 0x7f79e0004810 2024-04-15T15:32:42.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f79fb400640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e0004810 0x7f79e0004c90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009b20 tx=0x7f79e801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1af72722460bf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:42.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80097f0 con 0x7f79e0004810 2024-04-15T15:32:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e8004030 con 0x7f79e0004810 2024-04-15T15:32:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f79faa00640 1 -- 172.21.15.73:0/174107205 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8004400 con 0x7f79e0004810 2024-04-15T15:32:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f7a02a00640 1 -- 172.21.15.73:0/174107205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e0004810 msgr2=0x7f79e0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f7a02a00640 1 --2- 172.21.15.73:0/174107205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e0004810 0x7f79e0004c90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009b20 tx=0x7f79e801cab0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f7a00a00640 1 -- 172.21.15.73:0/174107205 reap_dead start 2024-04-15T15:32:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f7a02a00640 1 -- 172.21.15.73:0/174107205 shutdown_connections 2024-04-15T15:32:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f7a02a00640 1 -- 172.21.15.73:0/174107205 >> 172.21.15.73:0/174107205 conn(0x7f79fc0b3fe0 msgr2=0x7f79fc0b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f7a02a00640 1 -- 172.21.15.73:0/174107205 shutdown_connections 2024-04-15T15:32:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.865+0000 7f7a02a00640 1 -- 172.21.15.73:0/174107205 wait complete. 2024-04-15T15:32:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a02a00640 1 Processor -- start 2024-04-15T15:32:42.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a02a00640 1 -- start start 2024-04-15T15:32:42.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a02a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e0004810 0x7f79fc0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:42.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a02a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc0b0230 0x7f79fc1f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:42.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a02a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79fc14d930 0x7f79fc0b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:42.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a02a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc0d1600 con 0x7f79fc0b0230 2024-04-15T15:32:42.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a02a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc0d1480 con 0x7f79e0004810 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a02a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f79fc09aa60 con 0x7f79fc14d930 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79fb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc0b0230 0x7f79fc1f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79fb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc0b0230 0x7f79fc1f66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58642/0 (socket says 172.21.15.73:58642) 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79fb400640 1 -- 172.21.15.73:0/2618407606 learned_addr learned my addr 172.21.15.73:0/2618407606 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79fbe00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e0004810 0x7f79fc0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a00a00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79fc14d930 0x7f79fc0b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79fb400640 1 -- 172.21.15.73:0/2618407606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79fc14d930 msgr2=0x7f79fc0b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79fb400640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79fc14d930 0x7f79fc0b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79fb400640 1 -- 172.21.15.73:0/2618407606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e0004810 msgr2=0x7f79fc0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79fb400640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e0004810 0x7f79fc0b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79fb400640 1 -- 172.21.15.73:0/2618407606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc0af190 con 0x7f79fc0b0230 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79fb400640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc0b0230 0x7f79fc1f66b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f79e801cf90 tx=0x7f79e0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:42.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79f3e00640 1 -- 172.21.15.73:0/2618407606 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80a58b0 con 0x7f79fc0b0230 2024-04-15T15:32:42.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79f3e00640 1 -- 172.21.15.73:0/2618407606 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e80bc070 con 0x7f79fc0b0230 2024-04-15T15:32:42.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a02a00640 1 -- 172.21.15.73:0/2618407606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79fc0af470 con 0x7f79fc0b0230 2024-04-15T15:32:42.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f79f3e00640 1 -- 172.21.15.73:0/2618407606 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80a5c50 con 0x7f79fc0b0230 2024-04-15T15:32:42.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.869+0000 7f7a02a00640 1 -- 172.21.15.73:0/2618407606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79fc0afa30 con 0x7f79fc0b0230 2024-04-15T15:32:42.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.873+0000 7f7a02a00640 1 -- 172.21.15.73:0/2618407606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79fc068ab0 con 0x7f79fc0b0230 2024-04-15T15:32:42.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.873+0000 7f79f3e00640 1 -- 172.21.15.73:0/2618407606 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f79e8003620 con 0x7f79fc0b0230 2024-04-15T15:32:42.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.873+0000 7f79f3e00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f79dc068380 0x7f79dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:42.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.873+0000 7f79f3e00640 1 -- 172.21.15.73:0/2618407606 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f79e81207c0 con 0x7f79fc0b0230 2024-04-15T15:32:42.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.873+0000 7f79fbe00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f79dc068380 0x7f79dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:42.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.873+0000 7f79fbe00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f79dc068380 0x7f79dc06a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f79ec000c10 tx=0x7f79ec007880 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:42.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:42.877+0000 7f79f3e00640 1 -- 172.21.15.73:0/2618407606 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f79e8016800 con 0x7f79fc0b0230 2024-04-15T15:32:43.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.085+0000 7f7a02a00640 1 -- 172.21.15.73:0/2618407606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f79fc0b4d80 con 0x7f79fc0b0230 2024-04-15T15:32:43.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.085+0000 7f79f3e00640 1 -- 172.21.15.73:0/2618407606 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f79e80f08e0 con 0x7f79fc0b0230 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAbSB1mE/8OGhAAjTzwB87bnkwdxGQOU1NTQw==", 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAbSB1mDtttJhAA6VNBgxvlM9+s5ESEiC4uhQ==", 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2024-04-15T15:32:43.088 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAbSB1m4zpXIRAAPaJNSQuTI/1zYGE5W57+XA==", 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAbSB1mbUP3LRAAZfeG5ghHXihslXSCYoUqJg==", 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-04-15T15:32:43.089 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAeSB1m0aXJNRAAluOSe91ime2Lmw5arAxjVQ==", 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.090 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2024-04-15T15:32:43.095 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAiSB1mpzIxBBAAVmRcjWCwy2l0w9a4ByisRQ==", 2024-04-15T15:32:43.095 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-04-15T15:32:43.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-04-15T15:32:43.095 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAlSB1mItisDRAA77ztxcsPX24ZuyjD401k2A==", 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAoSB1mUpX9FhAA1iRcGp/5zUVBC1tD5LI3uQ==", 2024-04-15T15:32:43.096 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAsSB1mxNxZKBAAZEowCNbSBkfXdi/HHjSvTw==", 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAvSB1mOj5DMhAADWQxVRwLZtj0zuRykn8QcA==", 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAySB1mxQOTOxAAMO6eJOcJlY2YJ2pYK+Jk1w==", 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA2SB1mI8SoCRAAnZqLgor4fri4I4wrkcWLiA==", 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAbSB1mysrBMRAASR9v0p/QS/vXby5B449DsA==", 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2024-04-15T15:32:43.100 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAbSB1mfzxIOxAA7FDp5dmIqBfa3e5obY6fjA==", 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.2", 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAbSB1mlmzJNxAAB8iXUEkqY9VSNaQWH1SypA==", 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-04-15T15:32:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.3", 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAcSB1mUsrCBRAApqSqvkHxPNS7UqpVKupYjA==", 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAaSB1mYWFWOBAAghbeMKps8ODKQVEIkeNcSA==", 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mds", 2024-04-15T15:32:43.103 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA8SB1mMsVLFBAAmvXoglqZ6nnjmWBgWO3I0g==", 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mds" 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mgr", 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA8SB1mSc9LFBAAFpzwtBkRkS6HHR/HM+HPwA==", 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-osd", 2024-04-15T15:32:43.104 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA8SB1mmtdLFBAAVsIslGlPJ9X7JRma6CjxCQ==", 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-osd" 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd", 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA8SB1mnt9LFBAABJ1Xke53UlbIy+Cm+M+Reg==", 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.105 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA8SB1m4+dLFBAAHl9y5j1wRrSucOy4uxTOiw==", 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rgw", 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA8SB1mdvBLFBAAfipvloNAhPEO2phY6We7Wg==", 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAbSB1mRf/hFRAAAYGd3wzdUvONb2qwwcm7Ag==", 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAbSB1mFL0DEhAACcwKtDj+vQSJpBRVSAIBhw==", 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-04-15T15:32:43.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-04-15T15:32:43.108 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-04-15T15:32:43.108 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.108 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:43.108 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-15T15:32:43.108 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:32:43.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 -- 172.21.15.73:0/2618407606 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f79dc068380 msgr2=0x7f79dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f79dc068380 0x7f79dc06a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f79ec000c10 tx=0x7f79ec007880 comp rx=0 tx=0).stop 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 -- 172.21.15.73:0/2618407606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc0b0230 msgr2=0x7f79fc1f66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc0b0230 0x7f79fc1f66b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f79e801cf90 tx=0x7f79e0005840 comp rx=0 tx=0).stop 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 -- 172.21.15.73:0/2618407606 shutdown_connections 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f79dc068380 0x7f79dc06a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79fc14d930 0x7f79fc0b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79fc0b0230 0x7f79fc1f66b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 --2- 172.21.15.73:0/2618407606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e0004810 0x7f79fc0b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 -- 172.21.15.73:0/2618407606 >> 172.21.15.73:0/2618407606 conn(0x7f79fc0b3fe0 msgr2=0x7f79fc160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 -- 172.21.15.73:0/2618407606 shutdown_connections 2024-04-15T15:32:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.089+0000 7f7a02a00640 1 -- 172.21.15.73:0/2618407606 wait complete. 2024-04-15T15:32:43.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-15T15:32:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.245+0000 7f98a6000640 1 Processor -- start 2024-04-15T15:32:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.245+0000 7f98a6000640 1 -- start start 2024-04-15T15:32:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.245+0000 7f98a6000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98a0146110 0x7f98a00cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f98a6000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a0072c30 con 0x7f98a00b2530 2024-04-15T15:32:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f98a6000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a00cd3a0 con 0x7f98a00b20b0 2024-04-15T15:32:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f98a6000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f98a00b5160 con 0x7f98a0146110 2024-04-15T15:32:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f989f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98a0146110 0x7f98a00cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f989fe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f98a00b2530 0x7f98a0072520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52678/0 (socket says 172.21.15.73:52678) 2024-04-15T15:32:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f989fe00640 1 -- 172.21.15.73:0/3620930886 learned_addr learned my addr 172.21.15.73:0/3620930886 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f989f400640 1 -- 172.21.15.73:0/3620930886 >> v1:172.21.15.118:6789/0 conn(0x7f98a00b20b0 legacy=0x7f98a0071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f989f400640 1 -- 172.21.15.73:0/3620930886 >> v1:172.21.15.73:6789/0 conn(0x7f98a00b2530 legacy=0x7f98a0072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f989f400640 1 -- 172.21.15.73:0/3620930886 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a00b40c0 con 0x7f98a0146110 2024-04-15T15:32:43.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f989f400640 1 --2- 172.21.15.73:0/3620930886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a0146110 0x7f98a00cd7b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98a00cd570 tx=0x7f989001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc805a72cb8c548 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:43.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f989e000640 1 -- 172.21.15.73:0/3620930886 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98900b2070 con 0x7f98a0146110 2024-04-15T15:32:43.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f989e000640 1 -- 172.21.15.73:0/3620930886 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98900a59e0 con 0x7f98a0146110 2024-04-15T15:32:43.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.249+0000 7f989e000640 1 -- 172.21.15.73:0/3620930886 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98900a5db0 con 0x7f98a0146110 2024-04-15T15:32:43.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 -- 172.21.15.73:0/3620930886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a0146110 msgr2=0x7f98a00cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 --2- 172.21.15.73:0/3620930886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a0146110 0x7f98a00cd7b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98a00cd570 tx=0x7f989001c920 comp rx=0 tx=0).stop 2024-04-15T15:32:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 -- 172.21.15.73:0/3620930886 shutdown_connections 2024-04-15T15:32:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 --2- 172.21.15.73:0/3620930886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a0146110 0x7f98a00cd7b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 -- 172.21.15.73:0/3620930886 >> 172.21.15.73:0/3620930886 conn(0x7f98a0067dd0 msgr2=0x7f98a00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 -- 172.21.15.73:0/3620930886 shutdown_connections 2024-04-15T15:32:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 -- 172.21.15.73:0/3620930886 wait complete. 2024-04-15T15:32:43.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 Processor -- start 2024-04-15T15:32:43.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 -- start start 2024-04-15T15:32:43.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a00b20b0 0x7f98a0151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98a00b2530 0x7f98a013dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98a0146110 0x7f98a01670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98a00b2940 con 0x7f98a00b20b0 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f98a00b4c40 con 0x7f98a0146110 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f98a6000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f98a00b3d70 con 0x7f98a00b2530 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f989f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a00b20b0 0x7f98a0151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f989f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a00b20b0 0x7f98a0151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58652/0 (socket says 172.21.15.73:58652) 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f989f400640 1 -- 172.21.15.73:0/3687518371 learned_addr learned my addr 172.21.15.73:0/3687518371 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f989fe00640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98a0146110 0x7f98a01670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f989ea00640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98a00b2530 0x7f98a013dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f989f400640 1 -- 172.21.15.73:0/3687518371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98a00b2530 msgr2=0x7f98a013dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f989f400640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98a00b2530 0x7f98a013dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f989f400640 1 -- 172.21.15.73:0/3687518371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98a0146110 msgr2=0x7f98a01670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f989f400640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98a0146110 0x7f98a01670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.253+0000 7f989f400640 1 -- 172.21.15.73:0/3687518371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a014f7e0 con 0x7f98a00b20b0 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f989f400640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a00b20b0 0x7f98a0151690 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f98900b0040 tx=0x7f98900196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f9897400640 1 -- 172.21.15.73:0/3687518371 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98900b2040 con 0x7f98a00b20b0 2024-04-15T15:32:43.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f9897400640 1 -- 172.21.15.73:0/3687518371 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98900bf070 con 0x7f98a00b20b0 2024-04-15T15:32:43.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f98a6000640 1 -- 172.21.15.73:0/3687518371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a014fac0 con 0x7f98a00b20b0 2024-04-15T15:32:43.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f9897400640 1 -- 172.21.15.73:0/3687518371 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98900adaa0 con 0x7f98a00b20b0 2024-04-15T15:32:43.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f98a6000640 1 -- 172.21.15.73:0/3687518371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a0150080 con 0x7f98a00b20b0 2024-04-15T15:32:43.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f98a6000640 1 -- 172.21.15.73:0/3687518371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a0068ab0 con 0x7f98a00b20b0 2024-04-15T15:32:43.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f9897400640 1 -- 172.21.15.73:0/3687518371 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98900adc40 con 0x7f98a00b20b0 2024-04-15T15:32:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f9897400640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9880068380 0x7f988006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f9897400640 1 -- 172.21.15.73:0/3687518371 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9890121cb0 con 0x7f98a00b20b0 2024-04-15T15:32:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f989ea00640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9880068380 0x7f988006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.257+0000 7f989ea00640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9880068380 0x7f988006a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f98a01f8d70 tx=0x7f988c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.261+0000 7f9897400640 1 -- 172.21.15.73:0/3687518371 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9890016540 con 0x7f98a00b20b0 2024-04-15T15:32:43.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.477+0000 7f98a6000640 1 -- 172.21.15.73:0/3687518371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f98a0144450 con 0x7f98a00b20b0 2024-04-15T15:32:43.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f9897400640 1 -- 172.21.15.73:0/3687518371 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f98900ab340 con 0x7f98a00b20b0 2024-04-15T15:32:43.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 -- 172.21.15.73:0/3687518371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9880068380 msgr2=0x7f988006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9880068380 0x7f988006a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f98a01f8d70 tx=0x7f988c009040 comp rx=0 tx=0).stop 2024-04-15T15:32:43.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 -- 172.21.15.73:0/3687518371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a00b20b0 msgr2=0x7f98a0151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a00b20b0 0x7f98a0151690 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f98900b0040 tx=0x7f98900196c0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 -- 172.21.15.73:0/3687518371 shutdown_connections 2024-04-15T15:32:43.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98a0146110 0x7f98a01670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9880068380 0x7f988006a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98a00b2530 0x7f98a013dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 --2- 172.21.15.73:0/3687518371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a00b20b0 0x7f98a0151690 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 -- 172.21.15.73:0/3687518371 >> 172.21.15.73:0/3687518371 conn(0x7f98a0067dd0 msgr2=0x7f98a00cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 -- 172.21.15.73:0/3687518371 shutdown_connections 2024-04-15T15:32:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.481+0000 7f98a6000640 1 -- 172.21.15.73:0/3687518371 wait complete. 2024-04-15T15:32:43.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-15T15:32:43.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75aee00640 1 Processor -- start 2024-04-15T15:32:43.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75aee00640 1 -- start start 2024-04-15T15:32:43.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75aee00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75a8146110 0x7f75a80cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75aee00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 0x7f75a80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75aee00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f75a8071e10 0x7f75a80722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75aee00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f75a80cd3a0 con 0x7f75a8071e10 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75aee00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f75a80b5160 con 0x7f75a8146110 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75aee00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f75a80b40c0 con 0x7f75a80b20b0 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75ace00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f75a8071e10 0x7f75a80722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75ace00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f75a8071e10 0x7f75a80722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58666/0 (socket says 172.21.15.73:58666) 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75ace00640 1 -- 172.21.15.73:0/4062304092 learned_addr learned my addr 172.21.15.73:0/4062304092 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75a7400640 1 --2- 172.21.15.73:0/4062304092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 0x7f75a80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75a7e00640 1 --2- 172.21.15.73:0/4062304092 >> v2:172.21.15.118:3300/0 conn(0x7f75a8146110 0x7f75a80cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75ace00640 1 -- 172.21.15.73:0/4062304092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 msgr2=0x7f75a80b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75ace00640 1 --2- 172.21.15.73:0/4062304092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 0x7f75a80b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75ace00640 1 -- 172.21.15.73:0/4062304092 >> v2:172.21.15.118:3300/0 conn(0x7f75a8146110 msgr2=0x7f75a80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:43.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75ace00640 1 --2- 172.21.15.73:0/4062304092 >> v2:172.21.15.118:3300/0 conn(0x7f75a8146110 0x7f75a80cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75ace00640 1 -- 172.21.15.73:0/4062304092 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a80b43a0 con 0x7f75a8071e10 2024-04-15T15:32:43.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.641+0000 7f75a7e00640 1 --2- 172.21.15.73:0/4062304092 >> v2:172.21.15.118:3300/0 conn(0x7f75a8146110 0x7f75a80cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:43.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75ace00640 1 --2- 172.21.15.73:0/4062304092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8071e10 0x7f75a80722a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f75a80d0fa0 tx=0x7f75a001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c233ce6aa5b34e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:43.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75a6a00640 1 -- 172.21.15.73:0/4062304092 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a00b1070 con 0x7f75a8071e10 2024-04-15T15:32:43.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75a6a00640 1 -- 172.21.15.73:0/4062304092 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a00ac630 con 0x7f75a8071e10 2024-04-15T15:32:43.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75a6a00640 1 -- 172.21.15.73:0/4062304092 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a00a8050 con 0x7f75a8071e10 2024-04-15T15:32:43.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75aee00640 1 -- 172.21.15.73:0/4062304092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8071e10 msgr2=0x7f75a80722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75aee00640 1 --2- 172.21.15.73:0/4062304092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8071e10 0x7f75a80722a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f75a80d0fa0 tx=0x7f75a001c520 comp rx=0 tx=0).stop 2024-04-15T15:32:43.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75aee00640 1 -- 172.21.15.73:0/4062304092 shutdown_connections 2024-04-15T15:32:43.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75aee00640 1 --2- 172.21.15.73:0/4062304092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8071e10 0x7f75a80722a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75aee00640 1 --2- 172.21.15.73:0/4062304092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 0x7f75a80b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75aee00640 1 --2- 172.21.15.73:0/4062304092 >> v2:172.21.15.118:3300/0 conn(0x7f75a8146110 0x7f75a80cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75aee00640 1 -- 172.21.15.73:0/4062304092 >> 172.21.15.73:0/4062304092 conn(0x7f75a8067dd0 msgr2=0x7f75a80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75aee00640 1 -- 172.21.15.73:0/4062304092 shutdown_connections 2024-04-15T15:32:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.645+0000 7f75aee00640 1 -- 172.21.15.73:0/4062304092 wait complete. 2024-04-15T15:32:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 Processor -- start 2024-04-15T15:32:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 -- start start 2024-04-15T15:32:43.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a8071e10 0x7f75a813dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 0x7f75a813f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8146110 0x7f75a80b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f75a80b3d70 con 0x7f75a8146110 2024-04-15T15:32:43.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f75a80b4c40 con 0x7f75a8071e10 2024-04-15T15:32:43.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f75a80cdcf0 con 0x7f75a80b20b0 2024-04-15T15:32:43.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75ace00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8146110 0x7f75a80b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75ace00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8146110 0x7f75a80b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58680/0 (socket says 172.21.15.73:58680) 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75ace00640 1 -- 172.21.15.73:0/2577359942 learned_addr learned my addr 172.21.15.73:0/2577359942 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75a7e00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a8071e10 0x7f75a813dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75a7400640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 0x7f75a813f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75ace00640 1 -- 172.21.15.73:0/2577359942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 msgr2=0x7f75a813f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75ace00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 0x7f75a813f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75ace00640 1 -- 172.21.15.73:0/2577359942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a8071e10 msgr2=0x7f75a813dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75ace00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a8071e10 0x7f75a813dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75ace00640 1 -- 172.21.15.73:0/2577359942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a806deb0 con 0x7f75a8146110 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75a7400640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 0x7f75a813f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75a7e00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a8071e10 0x7f75a813dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75ace00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8146110 0x7f75a80b04f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f75a00af040 tx=0x7f75a00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f759fe00640 1 -- 172.21.15.73:0/2577359942 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a00bc070 con 0x7f75a8146110 2024-04-15T15:32:43.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f759fe00640 1 -- 172.21.15.73:0/2577359942 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a00b7430 con 0x7f75a8146110 2024-04-15T15:32:43.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f759fe00640 1 -- 172.21.15.73:0/2577359942 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a00b1040 con 0x7f75a8146110 2024-04-15T15:32:43.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 -- 172.21.15.73:0/2577359942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a813e4a0 con 0x7f75a8146110 2024-04-15T15:32:43.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 -- 172.21.15.73:0/2577359942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a813ea60 con 0x7f75a8146110 2024-04-15T15:32:43.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.649+0000 7f75aee00640 1 -- 172.21.15.73:0/2577359942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a806e080 con 0x7f75a8146110 2024-04-15T15:32:43.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.653+0000 7f759fe00640 1 -- 172.21.15.73:0/2577359942 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f75a00b63d0 con 0x7f75a8146110 2024-04-15T15:32:43.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.653+0000 7f759fe00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7588068380 0x7f758806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:43.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.653+0000 7f759fe00640 1 -- 172.21.15.73:0/2577359942 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f75a011fff0 con 0x7f75a8146110 2024-04-15T15:32:43.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.653+0000 7f75a7e00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7588068380 0x7f758806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:43.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.653+0000 7f75a7e00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7588068380 0x7f758806a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75a80cd010 tx=0x7f75980039a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:43.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.657+0000 7f759fe00640 1 -- 172.21.15.73:0/2577359942 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f75a0016110 con 0x7f75a8146110 2024-04-15T15:32:43.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.869+0000 7f75aee00640 1 -- 172.21.15.73:0/2577359942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f75a8075150 con 0x7f75a8146110 2024-04-15T15:32:43.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.873+0000 7f759fe00640 1 -- 172.21.15.73:0/2577359942 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f75a00f06d0 con 0x7f75a8146110 2024-04-15T15:32:43.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 -- 172.21.15.73:0/2577359942 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7588068380 msgr2=0x7f758806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7588068380 0x7f758806a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75a80cd010 tx=0x7f75980039a0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 -- 172.21.15.73:0/2577359942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8146110 msgr2=0x7f75a80b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8146110 0x7f75a80b04f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f75a00af040 tx=0x7f75a00192c0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 -- 172.21.15.73:0/2577359942 shutdown_connections 2024-04-15T15:32:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75a8146110 0x7f75a80b04f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7588068380 0x7f758806a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a80b20b0 0x7f75a813f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 --2- 172.21.15.73:0/2577359942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a8071e10 0x7f75a813dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 -- 172.21.15.73:0/2577359942 >> 172.21.15.73:0/2577359942 conn(0x7f75a8067dd0 msgr2=0x7f75a815e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 -- 172.21.15.73:0/2577359942 shutdown_connections 2024-04-15T15:32:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:43.877+0000 7f75aee00640 1 -- 172.21.15.73:0/2577359942 wait complete. 2024-04-15T15:32:43.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-15T15:32:44.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c0e800640 1 Processor -- start 2024-04-15T15:32:44.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c0e800640 1 -- start start 2024-04-15T15:32:44.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c0e800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4c0815b5d0 0x7f4c0815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c0e800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b27c0 0x7f4c080b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c0e800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c08070160 con 0x7f4c080b3e30 2024-04-15T15:32:44.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c0e800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0815b9b0 con 0x7f4c0815b5d0 2024-04-15T15:32:44.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c0e800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0815f1f0 con 0x7f4c080b27c0 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c07400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4c0815b5d0 0x7f4c0815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c07e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b27c0 0x7f4c080b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c07e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b27c0 0x7f4c080b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:49362/0 (socket says 172.21.15.73:49362) 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c07400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4c0815b5d0 0x7f4c0815fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:34556/0 (socket says 172.21.15.73:34556) 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c07e00640 1 -- 172.21.15.73:0/661702236 learned_addr learned my addr 172.21.15.73:0/661702236 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c06a00640 1 --1- 172.21.15.73:0/661702236 >> v1:172.21.15.118:6789/0 conn(0x7f4c080b3e30 0x7f4c080b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:53400/0 (socket says 172.21.15.73:53400) 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c06000640 1 -- 172.21.15.73:0/661702236 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4141994114 0 0) 0x7f4c08070160 con 0x7f4c080b3e30 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c06000640 1 -- 172.21.15.73:0/661702236 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bec003530 con 0x7f4c080b3e30 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c07e00640 1 -- 172.21.15.73:0/661702236 >> v2:172.21.15.118:3300/0 conn(0x7f4c0815b5d0 msgr2=0x7f4c0815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c07e00640 1 --2- 172.21.15.73:0/661702236 >> v2:172.21.15.118:3300/0 conn(0x7f4c0815b5d0 0x7f4c0815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c07e00640 1 -- 172.21.15.73:0/661702236 >> v1:172.21.15.118:6789/0 conn(0x7f4c080b3e30 legacy=0x7f4c080b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c07e00640 1 -- 172.21.15.73:0/661702236 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0806fe80 con 0x7f4c080b27c0 2024-04-15T15:32:44.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.033+0000 7f4c07400640 1 --2- 172.21.15.73:0/661702236 >> v2:172.21.15.118:3300/0 conn(0x7f4c0815b5d0 0x7f4c0815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:44.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c07e00640 1 --2- 172.21.15.73:0/661702236 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b27c0 0x7f4c080b4740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009e80 tx=0x7f4c0001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4f924162d7f6d5d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:44.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c06000640 1 -- 172.21.15.73:0/661702236 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c000090d0 con 0x7f4c080b27c0 2024-04-15T15:32:44.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c06000640 1 -- 172.21.15.73:0/661702236 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c000a5780 con 0x7f4c080b27c0 2024-04-15T15:32:44.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c06000640 1 -- 172.21.15.73:0/661702236 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00009270 con 0x7f4c080b27c0 2024-04-15T15:32:44.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c0e800640 1 -- 172.21.15.73:0/661702236 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b27c0 msgr2=0x7f4c080b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c0e800640 1 --2- 172.21.15.73:0/661702236 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b27c0 0x7f4c080b4740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009e80 tx=0x7f4c0001c8c0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c0e800640 1 -- 172.21.15.73:0/661702236 shutdown_connections 2024-04-15T15:32:44.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c0e800640 1 --2- 172.21.15.73:0/661702236 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b27c0 0x7f4c080b4740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c0e800640 1 --2- 172.21.15.73:0/661702236 >> v2:172.21.15.118:3300/0 conn(0x7f4c0815b5d0 0x7f4c0815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c0e800640 1 -- 172.21.15.73:0/661702236 >> 172.21.15.73:0/661702236 conn(0x7f4c08067dd0 msgr2=0x7f4c080d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c0e800640 1 -- 172.21.15.73:0/661702236 shutdown_connections 2024-04-15T15:32:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.037+0000 7f4c0e800640 1 -- 172.21.15.73:0/661702236 wait complete. 2024-04-15T15:32:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 Processor -- start 2024-04-15T15:32:44.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 -- start start 2024-04-15T15:32:44.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080b27c0 0x7f4c080ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b3e30 0x7f4c081f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c0815b5d0 0x7f4c08153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0806faa0 con 0x7f4c080b27c0 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4c080b4240 con 0x7f4c0815b5d0 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0806fc20 con 0x7f4c080b3e30 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c07400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080b27c0 0x7f4c080ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c07400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080b27c0 0x7f4c080ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58688/0 (socket says 172.21.15.73:58688) 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c07400640 1 -- 172.21.15.73:0/3594674371 learned_addr learned my addr 172.21.15.73:0/3594674371 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c06a00640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b3e30 0x7f4c081f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c07e00640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c0815b5d0 0x7f4c08153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c07400640 1 -- 172.21.15.73:0/3594674371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b3e30 msgr2=0x7f4c081f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c07400640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b3e30 0x7f4c081f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c07400640 1 -- 172.21.15.73:0/3594674371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c0815b5d0 msgr2=0x7f4c08153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c07400640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c0815b5d0 0x7f4c08153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c07400640 1 -- 172.21.15.73:0/3594674371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c081f6db0 con 0x7f4c080b27c0 2024-04-15T15:32:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c07400640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080b27c0 0x7f4c080ad8d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800ebe0 tx=0x7f4bf800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4bff400640 1 -- 172.21.15.73:0/3594674371 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8017070 con 0x7f4c080b27c0 2024-04-15T15:32:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4bff400640 1 -- 172.21.15.73:0/3594674371 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf800cc30 con 0x7f4c080b27c0 2024-04-15T15:32:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4bff400640 1 -- 172.21.15.73:0/3594674371 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8013470 con 0x7f4c080b27c0 2024-04-15T15:32:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 -- 172.21.15.73:0/3594674371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c080b1a50 con 0x7f4c080b27c0 2024-04-15T15:32:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 -- 172.21.15.73:0/3594674371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c080b1770 con 0x7f4c080b27c0 2024-04-15T15:32:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.041+0000 7f4c0e800640 1 -- 172.21.15.73:0/3594674371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c08068ab0 con 0x7f4c080b27c0 2024-04-15T15:32:44.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.045+0000 7f4bff400640 1 -- 172.21.15.73:0/3594674371 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4bf801a070 con 0x7f4c080b27c0 2024-04-15T15:32:44.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.045+0000 7f4bff400640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4be4068380 0x7f4be406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.045+0000 7f4bff400640 1 -- 172.21.15.73:0/3594674371 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f4bf8086820 con 0x7f4c080b27c0 2024-04-15T15:32:44.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.045+0000 7f4c06a00640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4be4068380 0x7f4be406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.045+0000 7f4c06a00640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4be4068380 0x7f4be406a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c080b3b90 tx=0x7f4bf0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:44.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.049+0000 7f4bff400640 1 -- 172.21.15.73:0/3594674371 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4c081f6db0 con 0x7f4c080b27c0 2024-04-15T15:32:44.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.265+0000 7f4c0e800640 1 -- 172.21.15.73:0/3594674371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f4c08158990 con 0x7f4c080b27c0 2024-04-15T15:32:44.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4bff400640 1 -- 172.21.15.73:0/3594674371 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f4bf8056f00 con 0x7f4c080b27c0 2024-04-15T15:32:44.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 -- 172.21.15.73:0/3594674371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4be4068380 msgr2=0x7f4be406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4be4068380 0x7f4be406a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c080b3b90 tx=0x7f4bf0009040 comp rx=0 tx=0).stop 2024-04-15T15:32:44.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 -- 172.21.15.73:0/3594674371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080b27c0 msgr2=0x7f4c080ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080b27c0 0x7f4c080ad8d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800ebe0 tx=0x7f4bf800c520 comp rx=0 tx=0).stop 2024-04-15T15:32:44.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 -- 172.21.15.73:0/3594674371 shutdown_connections 2024-04-15T15:32:44.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c0815b5d0 0x7f4c08153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4be4068380 0x7f4be406a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c080b3e30 0x7f4c081f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 --2- 172.21.15.73:0/3594674371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080b27c0 0x7f4c080ad8d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 -- 172.21.15.73:0/3594674371 >> 172.21.15.73:0/3594674371 conn(0x7f4c08067dd0 msgr2=0x7f4c080d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:44.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 -- 172.21.15.73:0/3594674371 shutdown_connections 2024-04-15T15:32:44.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.269+0000 7f4c0e800640 1 -- 172.21.15.73:0/3594674371 wait complete. 2024-04-15T15:32:44.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-15T15:32:44.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.425+0000 7f996a400640 1 Processor -- start 2024-04-15T15:32:44.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.425+0000 7f996a400640 1 -- start start 2024-04-15T15:32:44.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.425+0000 7f996a400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640b27c0 0x7f996415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.425+0000 7f996a400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9964070160 con 0x7f996415b5d0 2024-04-15T15:32:44.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.425+0000 7f996a400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996415f1f0 con 0x7f99640b3e30 2024-04-15T15:32:44.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.425+0000 7f996a400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f996415b9b0 con 0x7f99640b27c0 2024-04-15T15:32:44.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9963400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f996415b5d0 0x7f99640b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52680/0 (socket says 172.21.15.73:52680) 2024-04-15T15:32:44.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9963400640 1 -- 172.21.15.73:0/1478699021 learned_addr learned my addr 172.21.15.73:0/1478699021 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1152775033 0 0) 0x7f9964070160 con 0x7f996415b5d0 2024-04-15T15:32:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9948005740 con 0x7f996415b5d0 2024-04-15T15:32:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962a00640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640b27c0 0x7f996415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2728682978 0 0) 0x7f9948005740 con 0x7f996415b5d0 2024-04-15T15:32:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640b27c0 msgr2=0x7f996415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640b27c0 0x7f996415fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 >> v1:172.21.15.118:6789/0 conn(0x7f99640b3e30 legacy=0x7f99640b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996406fe80 con 0x7f996415b5d0 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f9954001a00 con 0x7f996415b5d0 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 >> v1:172.21.15.73:6789/0 conn(0x7f996415b5d0 legacy=0x7f99640b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9948005c00 0x7f9948006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640b27c0 0x7f9948006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9948007080 0x7f994800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9948007840 con 0x7f9948005c00 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f994800e120 con 0x7f9948007080 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f994800e2a0 con 0x7f99640b27c0 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9963400640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9948005c00 0x7f9948006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9963e00640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9948007080 0x7f994800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9962a00640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640b27c0 0x7f9948006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9963400640 1 -- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640b27c0 msgr2=0x7f9948006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:44.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9963400640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640b27c0 0x7f9948006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9963400640 1 -- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9948007080 msgr2=0x7f994800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:44.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9963400640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9948007080 0x7f994800dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9963400640 1 -- 172.21.15.73:0/1478699021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9948005740 con 0x7f9948005c00 2024-04-15T15:32:44.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.429+0000 7f9963e00640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9948007080 0x7f994800dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:44.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f9963400640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9948005c00 0x7f9948006020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f995400a7f0 tx=0x7f995401d270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913fc8099fcf0fc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:44.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995400a3b0 con 0x7f9948005c00 2024-04-15T15:32:44.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99540ad650 con 0x7f9948005c00 2024-04-15T15:32:44.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f9962000640 1 -- 172.21.15.73:0/1478699021 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99540ada40 con 0x7f9948005c00 2024-04-15T15:32:44.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 -- 172.21.15.73:0/1478699021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9948005c00 msgr2=0x7f9948006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 --2- 172.21.15.73:0/1478699021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9948005c00 0x7f9948006020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f995400a7f0 tx=0x7f995401d270 comp rx=0 tx=0).stop 2024-04-15T15:32:44.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f9963e00640 1 -- 172.21.15.73:0/1478699021 reap_dead start 2024-04-15T15:32:44.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 -- 172.21.15.73:0/1478699021 shutdown_connections 2024-04-15T15:32:44.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 -- 172.21.15.73:0/1478699021 >> 172.21.15.73:0/1478699021 conn(0x7f9964067dd0 msgr2=0x7f99640d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:44.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 -- 172.21.15.73:0/1478699021 shutdown_connections 2024-04-15T15:32:44.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 -- 172.21.15.73:0/1478699021 wait complete. 2024-04-15T15:32:44.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 Processor -- start 2024-04-15T15:32:44.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 -- start start 2024-04-15T15:32:44.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9948005c00 0x7f99640b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f996415daf0 0x7f99640b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.433+0000 7f996a400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640ae920 0x7f99640aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f996a400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f996406faa0 con 0x7f996415daf0 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f996a400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f99640b4240 con 0x7f9948005c00 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f996a400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f996406fc20 con 0x7f99640ae920 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9962a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f996415daf0 0x7f99640b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9962a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f996415daf0 0x7f99640b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58702/0 (socket says 172.21.15.73:58702) 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9962a00640 1 -- 172.21.15.73:0/906647377 learned_addr learned my addr 172.21.15.73:0/906647377 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9963400640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9948005c00 0x7f99640b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9963e00640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640ae920 0x7f99640aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9962a00640 1 -- 172.21.15.73:0/906647377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640ae920 msgr2=0x7f99640aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9962a00640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640ae920 0x7f99640aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9962a00640 1 -- 172.21.15.73:0/906647377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9948005c00 msgr2=0x7f99640b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9962a00640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9948005c00 0x7f99640b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9962a00640 1 -- 172.21.15.73:0/906647377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996415df70 con 0x7f996415daf0 2024-04-15T15:32:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f9962a00640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f996415daf0 0x7f99640b1fe0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f995000f580 tx=0x7f995000fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f995b400640 1 -- 172.21.15.73:0/906647377 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950019020 con 0x7f996415daf0 2024-04-15T15:32:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f995b400640 1 -- 172.21.15.73:0/906647377 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9950014870 con 0x7f996415daf0 2024-04-15T15:32:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f996a400640 1 -- 172.21.15.73:0/906647377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99640b0670 con 0x7f996415daf0 2024-04-15T15:32:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f995b400640 1 -- 172.21.15.73:0/906647377 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950014c40 con 0x7f996415daf0 2024-04-15T15:32:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f996a400640 1 -- 172.21.15.73:0/906647377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99640b0c30 con 0x7f996415daf0 2024-04-15T15:32:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f996a400640 1 -- 172.21.15.73:0/906647377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9964068ab0 con 0x7f996415daf0 2024-04-15T15:32:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f995b400640 1 -- 172.21.15.73:0/906647377 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f995001c020 con 0x7f996415daf0 2024-04-15T15:32:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.437+0000 7f995b400640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9944068380 0x7f994406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.441+0000 7f995b400640 1 -- 172.21.15.73:0/906647377 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9950086fd0 con 0x7f996415daf0 2024-04-15T15:32:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.441+0000 7f9963400640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9944068380 0x7f994406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.441+0000 7f9963400640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9944068380 0x7f994406a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f99540ad000 tx=0x7f99540a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:44.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.445+0000 7f995b400640 1 -- 172.21.15.73:0/906647377 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9950023020 con 0x7f996415daf0 2024-04-15T15:32:44.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.653+0000 7f996a400640 1 -- 172.21.15.73:0/906647377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f996406f370 con 0x7f996415daf0 2024-04-15T15:32:44.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.653+0000 7f995b400640 1 -- 172.21.15.73:0/906647377 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f99500576c0 con 0x7f996415daf0 2024-04-15T15:32:44.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 -- 172.21.15.73:0/906647377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9944068380 msgr2=0x7f994406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9944068380 0x7f994406a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f99540ad000 tx=0x7f99540a7000 comp rx=0 tx=0).stop 2024-04-15T15:32:44.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 -- 172.21.15.73:0/906647377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f996415daf0 msgr2=0x7f99640b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f996415daf0 0x7f99640b1fe0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f995000f580 tx=0x7f995000fa40 comp rx=0 tx=0).stop 2024-04-15T15:32:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 -- 172.21.15.73:0/906647377 shutdown_connections 2024-04-15T15:32:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9944068380 0x7f994406a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99640ae920 0x7f99640aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f996415daf0 0x7f99640b1fe0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 --2- 172.21.15.73:0/906647377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9948005c00 0x7f99640b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 -- 172.21.15.73:0/906647377 >> 172.21.15.73:0/906647377 conn(0x7f9964067dd0 msgr2=0x7f99640d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 -- 172.21.15.73:0/906647377 shutdown_connections 2024-04-15T15:32:44.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.657+0000 7f996a400640 1 -- 172.21.15.73:0/906647377 wait complete. 2024-04-15T15:32:44.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-15T15:32:44.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.813+0000 7f7072600640 1 Processor -- start 2024-04-15T15:32:44.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.813+0000 7f7072600640 1 -- start start 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.813+0000 7f7072600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f706c146110 0x7f706c0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.813+0000 7f7072600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f706c0b20b0 0x7f706c0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.813+0000 7f7072600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706c0cd3a0 con 0x7f706c071e10 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f7072600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f706c0b5160 con 0x7f706c146110 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f7072600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f706c0b40c0 con 0x7f706c0b20b0 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f706c146110 0x7f706c0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f706c146110 0x7f706c0cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58710/0 (socket says 172.21.15.73:58710) 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706b400640 1 -- 172.21.15.73:0/2697312254 learned_addr learned my addr 172.21.15.73:0/2697312254 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706aa00640 1 --2- 172.21.15.73:0/2697312254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f706c0b20b0 0x7f706c0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706b400640 1 -- 172.21.15.73:0/2697312254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f706c0b20b0 msgr2=0x7f706c0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:44.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706b400640 1 --2- 172.21.15.73:0/2697312254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f706c0b20b0 0x7f706c0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706b400640 1 -- 172.21.15.73:0/2697312254 >> v1:172.21.15.118:6789/0 conn(0x7f706c071e10 legacy=0x7f706c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706b400640 1 -- 172.21.15.73:0/2697312254 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c0b43a0 con 0x7f706c146110 2024-04-15T15:32:44.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706b400640 1 --2- 172.21.15.73:0/2697312254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 0x7f706c0cd7b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7054009870 tx=0x7f705401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4623de7ba138d0be server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:44.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706a000640 1 -- 172.21.15.73:0/2697312254 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70540ab650 con 0x7f706c146110 2024-04-15T15:32:44.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706a000640 1 -- 172.21.15.73:0/2697312254 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70540b0070 con 0x7f706c146110 2024-04-15T15:32:44.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.817+0000 7f706a000640 1 -- 172.21.15.73:0/2697312254 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70540aba10 con 0x7f706c146110 2024-04-15T15:32:44.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 -- 172.21.15.73:0/2697312254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 msgr2=0x7f706c0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 --2- 172.21.15.73:0/2697312254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 0x7f706c0cd7b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7054009870 tx=0x7f705401c560 comp rx=0 tx=0).stop 2024-04-15T15:32:44.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 -- 172.21.15.73:0/2697312254 shutdown_connections 2024-04-15T15:32:44.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 --2- 172.21.15.73:0/2697312254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f706c0b20b0 0x7f706c0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 --2- 172.21.15.73:0/2697312254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 0x7f706c0cd7b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 -- 172.21.15.73:0/2697312254 >> 172.21.15.73:0/2697312254 conn(0x7f706c067dd0 msgr2=0x7f706c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:44.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 -- 172.21.15.73:0/2697312254 shutdown_connections 2024-04-15T15:32:44.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 -- 172.21.15.73:0/2697312254 wait complete. 2024-04-15T15:32:44.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 Processor -- start 2024-04-15T15:32:44.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 -- start start 2024-04-15T15:32:44.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c071e10 0x7f706c0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f706c0b20b0 0x7f706c1f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 0x7f706c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f706c0cdcf0 con 0x7f706c146110 2024-04-15T15:32:44.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f706c0b3d70 con 0x7f706c071e10 2024-04-15T15:32:44.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f7072600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f706c15dbe0 con 0x7f706c0b20b0 2024-04-15T15:32:44.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f706be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 0x7f706c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f706be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 0x7f706c157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58722/0 (socket says 172.21.15.73:58722) 2024-04-15T15:32:44.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f706be00640 1 -- 172.21.15.73:0/880900947 learned_addr learned my addr 172.21.15.73:0/880900947 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:44.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f706b400640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c071e10 0x7f706c0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.821+0000 7f706aa00640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f706c0b20b0 0x7f706c1f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f706be00640 1 -- 172.21.15.73:0/880900947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f706c0b20b0 msgr2=0x7f706c1f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f706be00640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f706c0b20b0 0x7f706c1f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f706be00640 1 -- 172.21.15.73:0/880900947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c071e10 msgr2=0x7f706c0aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f706be00640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c071e10 0x7f706c0aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f706be00640 1 -- 172.21.15.73:0/880900947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c155cc0 con 0x7f706c146110 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f706be00640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 0x7f706c157f20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f706400c730 tx=0x7f706400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f7063400640 1 -- 172.21.15.73:0/880900947 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7064003b80 con 0x7f706c146110 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f7063400640 1 -- 172.21.15.73:0/880900947 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7064003d20 con 0x7f706c146110 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f7063400640 1 -- 172.21.15.73:0/880900947 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706400aa30 con 0x7f706c146110 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f7072600640 1 -- 172.21.15.73:0/880900947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f706c155fa0 con 0x7f706c146110 2024-04-15T15:32:44.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f7072600640 1 -- 172.21.15.73:0/880900947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f706c156560 con 0x7f706c146110 2024-04-15T15:32:44.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f7072600640 1 -- 172.21.15.73:0/880900947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706c06e020 con 0x7f706c146110 2024-04-15T15:32:44.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f7063400640 1 -- 172.21.15.73:0/880900947 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f706400abd0 con 0x7f706c146110 2024-04-15T15:32:44.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f7063400640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7048068380 0x7f704806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:44.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f7063400640 1 -- 172.21.15.73:0/880900947 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f70640865d0 con 0x7f706c146110 2024-04-15T15:32:44.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.825+0000 7f706b400640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7048068380 0x7f704806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:44.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.829+0000 7f706b400640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7048068380 0x7f704806a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70540af000 tx=0x7f70540a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:44.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:44.829+0000 7f7063400640 1 -- 172.21.15.73:0/880900947 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7064056660 con 0x7f706c146110 2024-04-15T15:32:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.045+0000 7f7072600640 1 -- 172.21.15.73:0/880900947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f706c068ab0 con 0x7f706c146110 2024-04-15T15:32:45.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7063400640 1 -- 172.21.15.73:0/880900947 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f706405a960 con 0x7f706c146110 2024-04-15T15:32:45.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 -- 172.21.15.73:0/880900947 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7048068380 msgr2=0x7f704806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7048068380 0x7f704806a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70540af000 tx=0x7f70540a7000 comp rx=0 tx=0).stop 2024-04-15T15:32:45.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 -- 172.21.15.73:0/880900947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 msgr2=0x7f706c157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 0x7f706c157f20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f706400c730 tx=0x7f706400cbf0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 -- 172.21.15.73:0/880900947 shutdown_connections 2024-04-15T15:32:45.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c146110 0x7f706c157f20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7048068380 0x7f704806a840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f706c0b20b0 0x7f706c1f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 --2- 172.21.15.73:0/880900947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c071e10 0x7f706c0aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 -- 172.21.15.73:0/880900947 >> 172.21.15.73:0/880900947 conn(0x7f706c067dd0 msgr2=0x7f706c15f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:45.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 -- 172.21.15.73:0/880900947 shutdown_connections 2024-04-15T15:32:45.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.049+0000 7f7072600640 1 -- 172.21.15.73:0/880900947 wait complete. 2024-04-15T15:32:45.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-15T15:32:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc59200640 1 Processor -- start 2024-04-15T15:32:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc59200640 1 -- start start 2024-04-15T15:32:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc59200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc5415be70 0x7fbc54071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc59200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5406f5a0 con 0x7fbc54072350 2024-04-15T15:32:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc59200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5415f480 con 0x7fbc5406fc90 2024-04-15T15:32:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc59200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fbc540727a0 con 0x7fbc5415be70 2024-04-15T15:32:45.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc52800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbc54072350 0x7fbc540b3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52694/0 (socket says 172.21.15.73:52694) 2024-04-15T15:32:45.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc52800640 1 -- 172.21.15.73:0/224467992 learned_addr learned my addr 172.21.15.73:0/224467992 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:45.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc49400640 1 --2- 172.21.15.73:0/224467992 >> v2:172.21.15.118:3300/0 conn(0x7fbc5415be70 0x7fbc54071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc51400640 1 -- 172.21.15.73:0/224467992 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672474425 0 0) 0x7fbc4c001120 con 0x7fbc54072350 2024-04-15T15:32:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc51400640 1 -- 172.21.15.73:0/224467992 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc38003530 con 0x7fbc54072350 2024-04-15T15:32:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc49400640 1 -- 172.21.15.73:0/224467992 >> v1:172.21.15.118:6789/0 conn(0x7fbc5406fc90 legacy=0x7fbc5415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc49400640 1 -- 172.21.15.73:0/224467992 >> v1:172.21.15.73:6789/0 conn(0x7fbc54072350 legacy=0x7fbc540b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc51400640 1 -- 172.21.15.73:0/224467992 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1070322595 0 0) 0x7fbc38003530 con 0x7fbc54072350 2024-04-15T15:32:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.205+0000 7fbc49400640 1 -- 172.21.15.73:0/224467992 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5415f760 con 0x7fbc5415be70 2024-04-15T15:32:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc49400640 1 --2- 172.21.15.73:0/224467992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc5415be70 0x7fbc54071e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0097c0 tx=0x7fbc3c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc35dff9f9327a83 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc51400640 1 -- 172.21.15.73:0/224467992 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0b0070 con 0x7fbc5415be70 2024-04-15T15:32:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc51400640 1 -- 172.21.15.73:0/224467992 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c0ab400 con 0x7fbc5415be70 2024-04-15T15:32:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc51400640 1 -- 172.21.15.73:0/224467992 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c001850 con 0x7fbc5415be70 2024-04-15T15:32:45.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc59200640 1 -- 172.21.15.73:0/224467992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc5415be70 msgr2=0x7fbc54071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc59200640 1 --2- 172.21.15.73:0/224467992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc5415be70 0x7fbc54071e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0097c0 tx=0x7fbc3c01c3c0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc59200640 1 -- 172.21.15.73:0/224467992 shutdown_connections 2024-04-15T15:32:45.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc59200640 1 --2- 172.21.15.73:0/224467992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc5415be70 0x7fbc54071e10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc59200640 1 -- 172.21.15.73:0/224467992 >> 172.21.15.73:0/224467992 conn(0x7fbc54067dd0 msgr2=0x7fbc540d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:45.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc59200640 1 -- 172.21.15.73:0/224467992 shutdown_connections 2024-04-15T15:32:45.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.209+0000 7fbc59200640 1 -- 172.21.15.73:0/224467992 wait complete. 2024-04-15T15:32:45.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc59200640 1 Processor -- start 2024-04-15T15:32:45.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc59200640 1 -- start start 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc59200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc5406fc90 0x7fbc5414d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc59200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54072350 0x7fbc54154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc59200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5415be70 0x7fbc54159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc59200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbc540b4ab0 con 0x7fbc5415be70 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc59200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbc540b4930 con 0x7fbc54072350 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc59200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5415f020 con 0x7fbc5406fc90 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc52800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5415be70 0x7fbc54159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc52800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5415be70 0x7fbc54159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58728/0 (socket says 172.21.15.73:58728) 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc52800640 1 -- 172.21.15.73:0/1802077291 learned_addr learned my addr 172.21.15.73:0/1802077291 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc51e00640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc5406fc90 0x7fbc5414d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc49400640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54072350 0x7fbc54154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc52800640 1 -- 172.21.15.73:0/1802077291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc5406fc90 msgr2=0x7fbc5414d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc52800640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc5406fc90 0x7fbc5414d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc52800640 1 -- 172.21.15.73:0/1802077291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54072350 msgr2=0x7fbc54154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc52800640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54072350 0x7fbc54154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc52800640 1 -- 172.21.15.73:0/1802077291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5414dbb0 con 0x7fbc5415be70 2024-04-15T15:32:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc52800640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5415be70 0x7fbc54159420 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c750 tx=0x7fbc4c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc4aa00640 1 -- 172.21.15.73:0/1802077291 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c005ae0 con 0x7fbc5415be70 2024-04-15T15:32:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc4aa00640 1 -- 172.21.15.73:0/1802077291 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c005c80 con 0x7fbc5415be70 2024-04-15T15:32:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc59200640 1 -- 172.21.15.73:0/1802077291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5414de90 con 0x7fbc5415be70 2024-04-15T15:32:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.213+0000 7fbc4aa00640 1 -- 172.21.15.73:0/1802077291 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c0072b0 con 0x7fbc5415be70 2024-04-15T15:32:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.217+0000 7fbc59200640 1 -- 172.21.15.73:0/1802077291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5414e450 con 0x7fbc5415be70 2024-04-15T15:32:45.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.217+0000 7fbc59200640 1 -- 172.21.15.73:0/1802077291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc54155410 con 0x7fbc5415be70 2024-04-15T15:32:45.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.217+0000 7fbc4aa00640 1 -- 172.21.15.73:0/1802077291 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbc4c007450 con 0x7fbc5415be70 2024-04-15T15:32:45.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.217+0000 7fbc4aa00640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbc30068380 0x7fbc3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.217+0000 7fbc4aa00640 1 -- 172.21.15.73:0/1802077291 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fbc4c086610 con 0x7fbc5415be70 2024-04-15T15:32:45.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.217+0000 7fbc51e00640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbc30068380 0x7fbc3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.217+0000 7fbc51e00640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbc30068380 0x7fbc3006a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbc44001d50 tx=0x7fbc44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:45.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.221+0000 7fbc4aa00640 1 -- 172.21.15.73:0/1802077291 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbc5406f5a0 con 0x7fbc5415be70 2024-04-15T15:32:45.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.437+0000 7fbc59200640 1 -- 172.21.15.73:0/1802077291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fbc54068ab0 con 0x7fbc5415be70 2024-04-15T15:32:45.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.437+0000 7fbc4aa00640 1 -- 172.21.15.73:0/1802077291 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fbc4c019300 con 0x7fbc5415be70 2024-04-15T15:32:45.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 -- 172.21.15.73:0/1802077291 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbc30068380 msgr2=0x7fbc3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbc30068380 0x7fbc3006a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbc44001d50 tx=0x7fbc44009040 comp rx=0 tx=0).stop 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 -- 172.21.15.73:0/1802077291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5415be70 msgr2=0x7fbc54159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5415be70 0x7fbc54159420 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c750 tx=0x7fbc4c00cc10 comp rx=0 tx=0).stop 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 -- 172.21.15.73:0/1802077291 shutdown_connections 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5415be70 0x7fbc54159420 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc54072350 0x7fbc54154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbc30068380 0x7fbc3006a840 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 --2- 172.21.15.73:0/1802077291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc5406fc90 0x7fbc5414d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 -- 172.21.15.73:0/1802077291 >> 172.21.15.73:0/1802077291 conn(0x7fbc54067dd0 msgr2=0x7fbc540d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 -- 172.21.15.73:0/1802077291 shutdown_connections 2024-04-15T15:32:45.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.441+0000 7fbc59200640 1 -- 172.21.15.73:0/1802077291 wait complete. 2024-04-15T15:32:45.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:45.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f0356200640 1 Processor -- start 2024-04-15T15:32:45.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f0356200640 1 -- start start 2024-04-15T15:32:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f0356200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f035009b170 0x7f035015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f0356200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03500d0d40 con 0x7f03500d08b0 2024-04-15T15:32:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f0356200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03500d1000 con 0x7f03500b17a0 2024-04-15T15:32:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f0356200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f03500d12e0 con 0x7f035009b170 2024-04-15T15:32:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f0346a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f03500d08b0 0x7f035009aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52706/0 (socket says 172.21.15.73:52706) 2024-04-15T15:32:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f0346a00640 1 -- 172.21.15.73:0/1971987414 learned_addr learned my addr 172.21.15.73:0/1971987414 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:45.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f034fe00640 1 --2- 172.21.15.73:0/1971987414 >> v2:172.21.15.73:3300/0 conn(0x7f035009b170 0x7f035015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f034fe00640 1 -- 172.21.15.73:0/1971987414 >> v1:172.21.15.118:6789/0 conn(0x7f03500b17a0 legacy=0x7f035006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:45.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f034fe00640 1 -- 172.21.15.73:0/1971987414 >> v1:172.21.15.73:6789/0 conn(0x7f03500d08b0 legacy=0x7f035009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f034ea00640 1 -- 172.21.15.73:0/1971987414 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730209535 0 0) 0x7f03500d0d40 con 0x7f03500d08b0 2024-04-15T15:32:45.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.597+0000 7f034fe00640 1 -- 172.21.15.73:0/1971987414 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03500d15c0 con 0x7f035009b170 2024-04-15T15:32:45.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f034fe00640 1 --2- 172.21.15.73:0/1971987414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 0x7f035015e160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0348009d90 tx=0x7f034801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c68719b6855314e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:45.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f034ea00640 1 -- 172.21.15.73:0/1971987414 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03480b2070 con 0x7f035009b170 2024-04-15T15:32:45.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f034ea00640 1 -- 172.21.15.73:0/1971987414 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03480a5a00 con 0x7f035009b170 2024-04-15T15:32:45.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f034ea00640 1 -- 172.21.15.73:0/1971987414 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03480a5dd0 con 0x7f035009b170 2024-04-15T15:32:45.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f0356200640 1 -- 172.21.15.73:0/1971987414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 msgr2=0x7f035015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f0356200640 1 --2- 172.21.15.73:0/1971987414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 0x7f035015e160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0348009d90 tx=0x7f034801c940 comp rx=0 tx=0).stop 2024-04-15T15:32:45.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f0356200640 1 -- 172.21.15.73:0/1971987414 shutdown_connections 2024-04-15T15:32:45.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f0356200640 1 --2- 172.21.15.73:0/1971987414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 0x7f035015e160 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f0356200640 1 -- 172.21.15.73:0/1971987414 >> 172.21.15.73:0/1971987414 conn(0x7f03500b3fe0 msgr2=0x7f03500b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:45.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f0356200640 1 -- 172.21.15.73:0/1971987414 shutdown_connections 2024-04-15T15:32:45.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.601+0000 7f0356200640 1 -- 172.21.15.73:0/1971987414 wait complete. 2024-04-15T15:32:45.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 Processor -- start 2024-04-15T15:32:45.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 -- start start 2024-04-15T15:32:45.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 0x7f035015fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03500b17a0 0x7f03501559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03500d08b0 0x7f03500c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f035016c890 con 0x7f035009b170 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f03500b1d90 con 0x7f03500d08b0 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f035016ca10 con 0x7f03500b17a0 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f034f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 0x7f035015fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f034f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 0x7f035015fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58738/0 (socket says 172.21.15.73:58738) 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f034f400640 1 -- 172.21.15.73:0/1736905680 learned_addr learned my addr 172.21.15.73:0/1736905680 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0346a00640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03500b17a0 0x7f03501559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f034fe00640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03500d08b0 0x7f03500c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f034f400640 1 -- 172.21.15.73:0/1736905680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03500b17a0 msgr2=0x7f03501559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f034f400640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03500b17a0 0x7f03501559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f034f400640 1 -- 172.21.15.73:0/1736905680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03500d08b0 msgr2=0x7f03500c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f034f400640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03500d08b0 0x7f03500c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f034f400640 1 -- 172.21.15.73:0/1736905680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03501601c0 con 0x7f035009b170 2024-04-15T15:32:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f034f400640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 0x7f035015fa50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f034000c450 tx=0x7f034000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:45.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0347e00640 1 -- 172.21.15.73:0/1736905680 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03400052d0 con 0x7f035009b170 2024-04-15T15:32:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0347e00640 1 -- 172.21.15.73:0/1736905680 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0340005470 con 0x7f035009b170 2024-04-15T15:32:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 -- 172.21.15.73:0/1736905680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03501604a0 con 0x7f035009b170 2024-04-15T15:32:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0347e00640 1 -- 172.21.15.73:0/1736905680 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340003890 con 0x7f035009b170 2024-04-15T15:32:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 -- 172.21.15.73:0/1736905680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f035015b640 con 0x7f035009b170 2024-04-15T15:32:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.605+0000 7f0356200640 1 -- 172.21.15.73:0/1736905680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0350068ab0 con 0x7f035009b170 2024-04-15T15:32:45.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.609+0000 7f0347e00640 1 -- 172.21.15.73:0/1736905680 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0340003a30 con 0x7f035009b170 2024-04-15T15:32:45.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.609+0000 7f0347e00640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f032c068380 0x7f032c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.609+0000 7f0347e00640 1 -- 172.21.15.73:0/1736905680 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f0340086460 con 0x7f035009b170 2024-04-15T15:32:45.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.609+0000 7f0346a00640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f032c068380 0x7f032c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.609+0000 7f0346a00640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f032c068380 0x7f032c06a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0350161910 tx=0x7f0338007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:45.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.613+0000 7f0347e00640 1 -- 172.21.15.73:0/1736905680 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0340056bd0 con 0x7f035009b170 2024-04-15T15:32:45.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 -- 172.21.15.73:0/1736905680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03500d22b0 con 0x7f035009b170 2024-04-15T15:32:45.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0347e00640 1 -- 172.21.15.73:0/1736905680 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13140 (secure 0 0 0) 0x7f03400564d0 con 0x7f035009b170 2024-04-15T15:32:45.774 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:45.774 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:42.708102+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 -- 172.21.15.73:0/1736905680 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f032c068380 msgr2=0x7f032c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f032c068380 0x7f032c06a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0350161910 tx=0x7f0338007d10 comp rx=0 tx=0).stop 2024-04-15T15:32:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 -- 172.21.15.73:0/1736905680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 msgr2=0x7f035015fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 0x7f035015fa50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f034000c450 tx=0x7f034000c910 comp rx=0 tx=0).stop 2024-04-15T15:32:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 -- 172.21.15.73:0/1736905680 shutdown_connections 2024-04-15T15:32:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03500d08b0 0x7f03500c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f032c068380 0x7f032c06a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03500b17a0 0x7f03501559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 --2- 172.21.15.73:0/1736905680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f035009b170 0x7f035015fa50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.773+0000 7f0356200640 1 -- 172.21.15.73:0/1736905680 >> 172.21.15.73:0/1736905680 conn(0x7f03500b3fe0 msgr2=0x7f03501562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:45.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.777+0000 7f0356200640 1 -- 172.21.15.73:0/1736905680 shutdown_connections 2024-04-15T15:32:45.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.777+0000 7f0356200640 1 -- 172.21.15.73:0/1736905680 wait complete. 2024-04-15T15:32:45.796 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T15:32:45.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:45.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.933+0000 7f465fe00640 1 Processor -- start 2024-04-15T15:32:45.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.933+0000 7f465fe00640 1 -- start start 2024-04-15T15:32:45.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f466015c710 0x7f46600b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465fe00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46600d1230 con 0x7f46600cd9c0 2024-04-15T15:32:45.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465fe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46600cdf30 con 0x7f466009b170 2024-04-15T15:32:45.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465fe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f46600ce210 con 0x7f466015c710 2024-04-15T15:32:45.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465e000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f46600cd9c0 0x7f466009aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52710/0 (socket says 172.21.15.73:52710) 2024-04-15T15:32:45.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465e000640 1 -- 172.21.15.73:0/556850833 learned_addr learned my addr 172.21.15.73:0/556850833 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:45.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465ea00640 1 --2- 172.21.15.73:0/556850833 >> v2:172.21.15.118:3300/0 conn(0x7f466015c710 0x7f46600b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465d600640 1 -- 172.21.15.73:0/556850833 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269909251 0 0) 0x7f46600d1230 con 0x7f46600cd9c0 2024-04-15T15:32:45.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465d600640 1 -- 172.21.15.73:0/556850833 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4644003530 con 0x7f46600cd9c0 2024-04-15T15:32:45.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465d600640 1 -- 172.21.15.73:0/556850833 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506435595 0 0) 0x7f46600cdf30 con 0x7f466009b170 2024-04-15T15:32:45.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465d600640 1 -- 172.21.15.73:0/556850833 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46600d1230 con 0x7f466009b170 2024-04-15T15:32:45.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465ea00640 1 -- 172.21.15.73:0/556850833 >> v1:172.21.15.118:6789/0 conn(0x7f466009b170 legacy=0x7f46600c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465ea00640 1 -- 172.21.15.73:0/556850833 >> v1:172.21.15.73:6789/0 conn(0x7f46600cd9c0 legacy=0x7f466009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.937+0000 7f465ea00640 1 -- 172.21.15.73:0/556850833 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46600ce4f0 con 0x7f466015c710 2024-04-15T15:32:45.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465ea00640 1 --2- 172.21.15.73:0/556850833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f466015c710 0x7f46600b49b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4650009dc0 tx=0x7f465001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cc9144bb7852e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:45.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465d600640 1 -- 172.21.15.73:0/556850833 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46500b2070 con 0x7f466015c710 2024-04-15T15:32:45.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465d600640 1 -- 172.21.15.73:0/556850833 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46500a58f0 con 0x7f466015c710 2024-04-15T15:32:45.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465d600640 1 -- 172.21.15.73:0/556850833 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46500a5cc0 con 0x7f466015c710 2024-04-15T15:32:45.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 -- 172.21.15.73:0/556850833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f466015c710 msgr2=0x7f46600b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 --2- 172.21.15.73:0/556850833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f466015c710 0x7f46600b49b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4650009dc0 tx=0x7f465001c890 comp rx=0 tx=0).stop 2024-04-15T15:32:45.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 -- 172.21.15.73:0/556850833 shutdown_connections 2024-04-15T15:32:45.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 --2- 172.21.15.73:0/556850833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f466015c710 0x7f46600b49b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 -- 172.21.15.73:0/556850833 >> 172.21.15.73:0/556850833 conn(0x7f46600b3e90 msgr2=0x7f46600b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:45.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 -- 172.21.15.73:0/556850833 shutdown_connections 2024-04-15T15:32:45.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 -- 172.21.15.73:0/556850833 wait complete. 2024-04-15T15:32:45.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 Processor -- start 2024-04-15T15:32:45.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 -- start start 2024-04-15T15:32:45.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466009b170 0x7f466014c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46600cd9c0 0x7f46600b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f466015c710 0x7f4660157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f46600cab40 con 0x7f466009b170 2024-04-15T15:32:45.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f46600ca9c0 con 0x7f46600cd9c0 2024-04-15T15:32:45.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.941+0000 7f465fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f466016a2e0 con 0x7f466015c710 2024-04-15T15:32:45.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466009b170 0x7f466014c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466009b170 0x7f466014c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58754/0 (socket says 172.21.15.73:58754) 2024-04-15T15:32:45.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465ea00640 1 -- 172.21.15.73:0/656079950 learned_addr learned my addr 172.21.15.73:0/656079950 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:45.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465e000640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46600cd9c0 0x7f46600b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465f400640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f466015c710 0x7f4660157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465ea00640 1 -- 172.21.15.73:0/656079950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f466015c710 msgr2=0x7f4660157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465ea00640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f466015c710 0x7f4660157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465ea00640 1 -- 172.21.15.73:0/656079950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46600cd9c0 msgr2=0x7f46600b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:45.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465ea00640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46600cd9c0 0x7f46600b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:45.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465ea00640 1 -- 172.21.15.73:0/656079950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466015da40 con 0x7f466009b170 2024-04-15T15:32:45.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465f400640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f466015c710 0x7f4660157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:45.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465ea00640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466009b170 0x7f466014c6a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f46500b0040 tx=0x7f4650019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:45.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f4657400640 1 -- 172.21.15.73:0/656079950 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46500bd020 con 0x7f466009b170 2024-04-15T15:32:45.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f4657400640 1 -- 172.21.15.73:0/656079950 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46500b8470 con 0x7f466009b170 2024-04-15T15:32:45.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465fe00640 1 -- 172.21.15.73:0/656079950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466015dd20 con 0x7f466009b170 2024-04-15T15:32:45.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f4657400640 1 -- 172.21.15.73:0/656079950 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46500b2040 con 0x7f466009b170 2024-04-15T15:32:45.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465fe00640 1 -- 172.21.15.73:0/656079950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466015e2e0 con 0x7f466009b170 2024-04-15T15:32:45.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f465fe00640 1 -- 172.21.15.73:0/656079950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466004fd60 con 0x7f466009b170 2024-04-15T15:32:45.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.945+0000 7f4657400640 1 -- 172.21.15.73:0/656079950 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f46500c0020 con 0x7f466009b170 2024-04-15T15:32:45.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.949+0000 7f4657400640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4640068380 0x7f464006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:45.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.949+0000 7f4657400640 1 -- 172.21.15.73:0/656079950 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f4650121730 con 0x7f466009b170 2024-04-15T15:32:45.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.949+0000 7f465e000640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4640068380 0x7f464006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:45.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.949+0000 7f465e000640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4640068380 0x7f464006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f46600c88d0 tx=0x7f464c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:45.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:45.953+0000 7f4657400640 1 -- 172.21.15.73:0/656079950 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f46500c7030 con 0x7f466009b170 2024-04-15T15:32:46.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.109+0000 7f465fe00640 1 -- 172.21.15.73:0/656079950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f466006cf70 con 0x7f466009b170 2024-04-15T15:32:46.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.109+0000 7f4657400640 1 -- 172.21.15.73:0/656079950 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7f4650016540 con 0x7f466009b170 2024-04-15T15:32:46.110 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:32:46.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 -- 172.21.15.73:0/656079950 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4640068380 msgr2=0x7f464006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4640068380 0x7f464006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f46600c88d0 tx=0x7f464c009040 comp rx=0 tx=0).stop 2024-04-15T15:32:46.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 -- 172.21.15.73:0/656079950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466009b170 msgr2=0x7f466014c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466009b170 0x7f466014c6a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f46500b0040 tx=0x7f4650019630 comp rx=0 tx=0).stop 2024-04-15T15:32:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 -- 172.21.15.73:0/656079950 shutdown_connections 2024-04-15T15:32:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4640068380 0x7f464006a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f466015c710 0x7f4660157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46600cd9c0 0x7f46600b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 --2- 172.21.15.73:0/656079950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466009b170 0x7f466014c6a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 -- 172.21.15.73:0/656079950 >> 172.21.15.73:0/656079950 conn(0x7f46600b3e90 msgr2=0x7f4660156c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 -- 172.21.15.73:0/656079950 shutdown_connections 2024-04-15T15:32:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.113+0000 7f465fe00640 1 -- 172.21.15.73:0/656079950 wait complete. 2024-04-15T15:32:46.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-15T15:32:46.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.265+0000 7ff945800640 1 Processor -- start 2024-04-15T15:32:46.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.265+0000 7ff945800640 1 -- start start 2024-04-15T15:32:46.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff945800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff940146110 0x7ff9400cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff945800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9400b2530 0x7ff940072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff945800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9400cd3a0 con 0x7ff9400b20b0 2024-04-15T15:32:46.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff945800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff9400b29c0 con 0x7ff9400b2530 2024-04-15T15:32:46.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff945800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff9400b5160 con 0x7ff940146110 2024-04-15T15:32:46.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff93f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9400b2530 0x7ff940072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff93f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9400b2530 0x7ff940072520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58764/0 (socket says 172.21.15.73:58764) 2024-04-15T15:32:46.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff93f400640 1 -- 172.21.15.73:0/3307713517 learned_addr learned my addr 172.21.15.73:0/3307713517 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:46.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff93ea00640 1 --2- 172.21.15.73:0/3307713517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff940146110 0x7ff9400cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff93f400640 1 -- 172.21.15.73:0/3307713517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff940146110 msgr2=0x7ff9400cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:46.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff93f400640 1 --2- 172.21.15.73:0/3307713517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff940146110 0x7ff9400cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff93f400640 1 -- 172.21.15.73:0/3307713517 >> v1:172.21.15.118:6789/0 conn(0x7ff9400b20b0 legacy=0x7ff940071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff93f400640 1 -- 172.21.15.73:0/3307713517 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9400b40c0 con 0x7ff9400b2530 2024-04-15T15:32:46.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.269+0000 7ff93f400640 1 --2- 172.21.15.73:0/3307713517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9400b2530 0x7ff940072520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff938009870 tx=0x7ff93801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a093b1987e95117c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:46.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff93d600640 1 -- 172.21.15.73:0/3307713517 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9380a95f0 con 0x7ff9400b2530 2024-04-15T15:32:46.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff93d600640 1 -- 172.21.15.73:0/3307713517 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9380a9790 con 0x7ff9400b2530 2024-04-15T15:32:46.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff93d600640 1 -- 172.21.15.73:0/3307713517 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9380a9b60 con 0x7ff9400b2530 2024-04-15T15:32:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 -- 172.21.15.73:0/3307713517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9400b2530 msgr2=0x7ff940072520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 --2- 172.21.15.73:0/3307713517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9400b2530 0x7ff940072520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff938009870 tx=0x7ff93801c530 comp rx=0 tx=0).stop 2024-04-15T15:32:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 -- 172.21.15.73:0/3307713517 shutdown_connections 2024-04-15T15:32:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 --2- 172.21.15.73:0/3307713517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9400b2530 0x7ff940072520 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 --2- 172.21.15.73:0/3307713517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff940146110 0x7ff9400cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 -- 172.21.15.73:0/3307713517 >> 172.21.15.73:0/3307713517 conn(0x7ff940067dd0 msgr2=0x7ff9400d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 -- 172.21.15.73:0/3307713517 shutdown_connections 2024-04-15T15:32:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 -- 172.21.15.73:0/3307713517 wait complete. 2024-04-15T15:32:46.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 Processor -- start 2024-04-15T15:32:46.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 -- start start 2024-04-15T15:32:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9400b20b0 0x7ff940152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9400b2530 0x7ff94013c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff940146110 0x7ff94013c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff9400b3d70 con 0x7ff940146110 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff9400b4c40 con 0x7ff9400b2530 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff945800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff9400cdcf0 con 0x7ff9400b20b0 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff93f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff940146110 0x7ff94013c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff93f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff940146110 0x7ff94013c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58774/0 (socket says 172.21.15.73:58774) 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff93f400640 1 -- 172.21.15.73:0/3119035884 learned_addr learned my addr 172.21.15.73:0/3119035884 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff93ea00640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9400b20b0 0x7ff940152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.273+0000 7ff93e000640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9400b2530 0x7ff94013c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff93f400640 1 -- 172.21.15.73:0/3119035884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9400b20b0 msgr2=0x7ff940152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff93f400640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9400b20b0 0x7ff940152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff93f400640 1 -- 172.21.15.73:0/3119035884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9400b2530 msgr2=0x7ff94013c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff93f400640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9400b2530 0x7ff94013c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff93f400640 1 -- 172.21.15.73:0/3119035884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94013dec0 con 0x7ff940146110 2024-04-15T15:32:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff93e000640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9400b2530 0x7ff94013c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff93f400640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff940146110 0x7ff94013c620 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff93801a160 tx=0x7ff93801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff936a00640 1 -- 172.21.15.73:0/3119035884 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9380b1800 con 0x7ff940146110 2024-04-15T15:32:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff936a00640 1 -- 172.21.15.73:0/3119035884 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9380b19a0 con 0x7ff940146110 2024-04-15T15:32:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff936a00640 1 -- 172.21.15.73:0/3119035884 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9380b1d90 con 0x7ff940146110 2024-04-15T15:32:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff945800640 1 -- 172.21.15.73:0/3119035884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94013cc50 con 0x7ff940146110 2024-04-15T15:32:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff945800640 1 -- 172.21.15.73:0/3119035884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94013d210 con 0x7ff940146110 2024-04-15T15:32:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff945800640 1 -- 172.21.15.73:0/3119035884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff940068ab0 con 0x7ff940146110 2024-04-15T15:32:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff936a00640 1 -- 172.21.15.73:0/3119035884 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff9380bc450 con 0x7ff940146110 2024-04-15T15:32:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff936a00640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff920068380 0x7ff92006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff936a00640 1 -- 172.21.15.73:0/3119035884 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7ff938121320 con 0x7ff940146110 2024-04-15T15:32:46.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.277+0000 7ff93ea00640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff920068380 0x7ff92006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.281+0000 7ff93ea00640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff920068380 0x7ff92006a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff930009fd0 tx=0x7ff930009800 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.281+0000 7ff936a00640 1 -- 172.21.15.73:0/3119035884 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9380ad020 con 0x7ff940146110 2024-04-15T15:32:46.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 -- 172.21.15.73:0/3119035884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff940143200 con 0x7ff940146110 2024-04-15T15:32:46.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff936a00640 1 -- 172.21.15.73:0/3119035884 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7ff938016150 con 0x7ff940146110 2024-04-15T15:32:46.446 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:46.446 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-04-15T15:32:46.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:32:46.446 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-04-15T15:32:46.446 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-04-15T15:32:46.447 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:32:46.447 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-04-15T15:32:46.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 -- 172.21.15.73:0/3119035884 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff920068380 msgr2=0x7ff92006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff920068380 0x7ff92006a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff930009fd0 tx=0x7ff930009800 comp rx=0 tx=0).stop 2024-04-15T15:32:46.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 -- 172.21.15.73:0/3119035884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff940146110 msgr2=0x7ff94013c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff940146110 0x7ff94013c620 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff93801a160 tx=0x7ff93801ad70 comp rx=0 tx=0).stop 2024-04-15T15:32:46.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 -- 172.21.15.73:0/3119035884 shutdown_connections 2024-04-15T15:32:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff940146110 0x7ff94013c620 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9400b2530 0x7ff94013c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff920068380 0x7ff92006a840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 --2- 172.21.15.73:0/3119035884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9400b20b0 0x7ff940152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 -- 172.21.15.73:0/3119035884 >> 172.21.15.73:0/3119035884 conn(0x7ff940067dd0 msgr2=0x7ff9400cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 -- 172.21.15.73:0/3119035884 shutdown_connections 2024-04-15T15:32:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.445+0000 7ff945800640 1 -- 172.21.15.73:0/3119035884 wait complete. 2024-04-15T15:32:46.466 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-15T15:32:46.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-15T15:32:46.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.605+0000 7fa931200640 1 Processor -- start 2024-04-15T15:32:46.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.605+0000 7fa931200640 1 -- start start 2024-04-15T15:32:46.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.605+0000 7fa931200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa92c06c160 0x7fa92c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.605+0000 7fa931200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa92c15be20 con 0x7fa92c159340 2024-04-15T15:32:46.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.605+0000 7fa931200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa92c159720 con 0x7fa92c15c890 2024-04-15T15:32:46.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.605+0000 7fa931200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa92c15cd20 con 0x7fa92c06c160 2024-04-15T15:32:46.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.605+0000 7fa929e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa92c159340 0x7fa92c0ceb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52720/0 (socket says 172.21.15.73:52720) 2024-04-15T15:32:46.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.605+0000 7fa929e00640 1 -- 172.21.15.73:0/2805499438 learned_addr learned my addr 172.21.15.73:0/2805499438 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:46.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa92a800640 1 --2- 172.21.15.73:0/2805499438 >> v2:172.21.15.118:3300/0 conn(0x7fa92c06c160 0x7fa92c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa929400640 1 -- 172.21.15.73:0/2805499438 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287986463 0 0) 0x7fa92c15be20 con 0x7fa92c159340 2024-04-15T15:32:46.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa929400640 1 -- 172.21.15.73:0/2805499438 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa910003530 con 0x7fa92c159340 2024-04-15T15:32:46.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa929400640 1 -- 172.21.15.73:0/2805499438 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924496358 0 0) 0x7fa92c159720 con 0x7fa92c15c890 2024-04-15T15:32:46.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa929400640 1 -- 172.21.15.73:0/2805499438 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa92c15be20 con 0x7fa92c15c890 2024-04-15T15:32:46.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa92a800640 1 -- 172.21.15.73:0/2805499438 >> v1:172.21.15.118:6789/0 conn(0x7fa92c15c890 legacy=0x7fa92c06ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa92a800640 1 -- 172.21.15.73:0/2805499438 >> v1:172.21.15.73:6789/0 conn(0x7fa92c159340 legacy=0x7fa92c0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa92a800640 1 -- 172.21.15.73:0/2805499438 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92c0cf6b0 con 0x7fa92c06c160 2024-04-15T15:32:46.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa92a800640 1 --2- 172.21.15.73:0/2805499438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c06c160 0x7fa92c0b3a70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa9240097c0 tx=0x7fa92401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39fa94cbfc9425bd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:46.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa929400640 1 -- 172.21.15.73:0/2805499438 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9240a7070 con 0x7fa92c06c160 2024-04-15T15:32:46.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa929400640 1 -- 172.21.15.73:0/2805499438 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9240b0070 con 0x7fa92c06c160 2024-04-15T15:32:46.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.609+0000 7fa929400640 1 -- 172.21.15.73:0/2805499438 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9240ab870 con 0x7fa92c06c160 2024-04-15T15:32:46.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 -- 172.21.15.73:0/2805499438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c06c160 msgr2=0x7fa92c0b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 --2- 172.21.15.73:0/2805499438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c06c160 0x7fa92c0b3a70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa9240097c0 tx=0x7fa92401c470 comp rx=0 tx=0).stop 2024-04-15T15:32:46.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 -- 172.21.15.73:0/2805499438 shutdown_connections 2024-04-15T15:32:46.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 --2- 172.21.15.73:0/2805499438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c06c160 0x7fa92c0b3a70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 -- 172.21.15.73:0/2805499438 >> 172.21.15.73:0/2805499438 conn(0x7fa92c067e30 msgr2=0x7fa92c0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:46.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 -- 172.21.15.73:0/2805499438 shutdown_connections 2024-04-15T15:32:46.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 -- 172.21.15.73:0/2805499438 wait complete. 2024-04-15T15:32:46.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 Processor -- start 2024-04-15T15:32:46.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 -- start start 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa92c06c160 0x7fa92c149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa92c159340 0x7fa92c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c15c890 0x7fa92c14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c0cf250 con 0x7fa92c06c160 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c0cf990 con 0x7fa92c15c890 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa931200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa92c0cf3d0 con 0x7fa92c159340 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa929e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa92c06c160 0x7fa92c149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa929e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa92c06c160 0x7fa92c149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58782/0 (socket says 172.21.15.73:58782) 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa929e00640 1 -- 172.21.15.73:0/503247155 learned_addr learned my addr 172.21.15.73:0/503247155 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.613+0000 7fa921400640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa92c159340 0x7fa92c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa92a800640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c15c890 0x7fa92c14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa929e00640 1 -- 172.21.15.73:0/503247155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa92c159340 msgr2=0x7fa92c14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa929e00640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa92c159340 0x7fa92c14cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa929e00640 1 -- 172.21.15.73:0/503247155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c15c890 msgr2=0x7fa92c14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa929e00640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c15c890 0x7fa92c14aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa929e00640 1 -- 172.21.15.73:0/503247155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92c151230 con 0x7fa92c06c160 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa92a800640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c15c890 0x7fa92c14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa929e00640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa92c06c160 0x7fa92c149df0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00cbf0 tx=0x7fa91c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa922a00640 1 -- 172.21.15.73:0/503247155 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c017070 con 0x7fa92c06c160 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa922a00640 1 -- 172.21.15.73:0/503247155 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91c00ad50 con 0x7fa92c06c160 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa922a00640 1 -- 172.21.15.73:0/503247155 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c012600 con 0x7fa92c06c160 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa931200640 1 -- 172.21.15.73:0/503247155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa92c151510 con 0x7fa92c06c160 2024-04-15T15:32:46.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa931200640 1 -- 172.21.15.73:0/503247155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa92c151ad0 con 0x7fa92c06c160 2024-04-15T15:32:46.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa931200640 1 -- 172.21.15.73:0/503247155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa92c068b20 con 0x7fa92c06c160 2024-04-15T15:32:46.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa922a00640 1 -- 172.21.15.73:0/503247155 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa91c01a070 con 0x7fa92c06c160 2024-04-15T15:32:46.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa922a00640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa908068380 0x7fa90806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:46.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa922a00640 1 -- 172.21.15.73:0/503247155 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fa91c0865b0 con 0x7fa92c06c160 2024-04-15T15:32:46.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.617+0000 7fa921400640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa908068380 0x7fa90806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:46.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.621+0000 7fa921400640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa908068380 0x7fa90806a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0d0c70 tx=0x7fa914009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:46.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.621+0000 7fa922a00640 1 -- 172.21.15.73:0/503247155 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa91c0566d0 con 0x7fa92c06c160 2024-04-15T15:32:46.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:46.781+0000 7fa931200640 1 -- 172.21.15.73:0/503247155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa92c06f930 con 0x7fa92c06c160 2024-04-15T15:32:47.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.709+0000 7fa922a00640 1 -- 172.21.15.73:0/503247155 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7fa91c05a9d0 con 0x7fa92c06c160 2024-04-15T15:32:47.710 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-04-15T15:32:47.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 -- 172.21.15.73:0/503247155 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa908068380 msgr2=0x7fa90806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:47.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa908068380 0x7fa90806a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0d0c70 tx=0x7fa914009040 comp rx=0 tx=0).stop 2024-04-15T15:32:47.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 -- 172.21.15.73:0/503247155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa92c06c160 msgr2=0x7fa92c149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:47.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa92c06c160 0x7fa92c149df0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00cbf0 tx=0x7fa91c00a430 comp rx=0 tx=0).stop 2024-04-15T15:32:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 -- 172.21.15.73:0/503247155 shutdown_connections 2024-04-15T15:32:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c15c890 0x7fa92c14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa908068380 0x7fa90806a840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa92c159340 0x7fa92c14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 --2- 172.21.15.73:0/503247155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa92c06c160 0x7fa92c149df0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 -- 172.21.15.73:0/503247155 >> 172.21.15.73:0/503247155 conn(0x7fa92c067e30 msgr2=0x7fa92c0cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 -- 172.21.15.73:0/503247155 shutdown_connections 2024-04-15T15:32:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.713+0000 7fa931200640 1 -- 172.21.15.73:0/503247155 wait complete. 2024-04-15T15:32:47.742 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-15T15:32:47.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.885+0000 7fbe64000640 1 Processor -- start 2024-04-15T15:32:47.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.885+0000 7fbe64000640 1 -- start start 2024-04-15T15:32:47.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.885+0000 7fbe64000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe5c146110 0x7fbe5c0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:47.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.885+0000 7fbe64000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbe5c0b20b0 0x7fbe5c0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:47.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.885+0000 7fbe64000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe5c071e10 0x7fbe5c0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:47.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.885+0000 7fbe64000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbe5c0cd3a0 con 0x7fbe5c146110 2024-04-15T15:32:47.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.885+0000 7fbe64000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fbe5c0b5160 con 0x7fbe5c0b20b0 2024-04-15T15:32:47.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.885+0000 7fbe64000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5c0b40c0 con 0x7fbe5c071e10 2024-04-15T15:32:47.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.885+0000 7fbe61600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe5c146110 0x7fbe5c0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:47.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.885+0000 7fbe61600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe5c146110 0x7fbe5c0cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42774/0 (socket says 172.21.15.73:42774) 2024-04-15T15:32:47.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe61600640 1 -- 172.21.15.73:0/73606517 learned_addr learned my addr 172.21.15.73:0/73606517 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:47.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe61600640 1 -- 172.21.15.73:0/73606517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe5c071e10 msgr2=0x7fbe5c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:47.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe61600640 1 --2- 172.21.15.73:0/73606517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe5c071e10 0x7fbe5c0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe61600640 1 -- 172.21.15.73:0/73606517 >> v2:172.21.15.118:3300/0 conn(0x7fbe5c0b20b0 msgr2=0x7fbe5c0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:47.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe60c00640 1 --2- 172.21.15.73:0/73606517 >> v2:172.21.15.118:3300/0 conn(0x7fbe5c0b20b0 0x7fbe5c0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:47.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe61600640 1 --2- 172.21.15.73:0/73606517 >> v2:172.21.15.118:3300/0 conn(0x7fbe5c0b20b0 0x7fbe5c0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe61600640 1 -- 172.21.15.73:0/73606517 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c0b43a0 con 0x7fbe5c146110 2024-04-15T15:32:47.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe60c00640 1 --2- 172.21.15.73:0/73606517 >> v2:172.21.15.118:3300/0 conn(0x7fbe5c0b20b0 0x7fbe5c0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:47.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe61600640 1 --2- 172.21.15.73:0/73606517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 0x7fbe5c0cd7b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0701c0 tx=0x7fbe5001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5069485d1e77daf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:47.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe5be00640 1 -- 172.21.15.73:0/73606517 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe500b1070 con 0x7fbe5c146110 2024-04-15T15:32:47.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe5be00640 1 -- 172.21.15.73:0/73606517 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe500ac630 con 0x7fbe5c146110 2024-04-15T15:32:47.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.889+0000 7fbe5be00640 1 -- 172.21.15.73:0/73606517 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe500a8050 con 0x7fbe5c146110 2024-04-15T15:32:47.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 -- 172.21.15.73:0/73606517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 msgr2=0x7fbe5c0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 --2- 172.21.15.73:0/73606517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 0x7fbe5c0cd7b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0701c0 tx=0x7fbe5001c520 comp rx=0 tx=0).stop 2024-04-15T15:32:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 -- 172.21.15.73:0/73606517 shutdown_connections 2024-04-15T15:32:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 --2- 172.21.15.73:0/73606517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe5c071e10 0x7fbe5c0722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 --2- 172.21.15.73:0/73606517 >> v2:172.21.15.118:3300/0 conn(0x7fbe5c0b20b0 0x7fbe5c0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 --2- 172.21.15.73:0/73606517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 0x7fbe5c0cd7b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 -- 172.21.15.73:0/73606517 >> 172.21.15.73:0/73606517 conn(0x7fbe5c067dd0 msgr2=0x7fbe5c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 -- 172.21.15.73:0/73606517 shutdown_connections 2024-04-15T15:32:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 -- 172.21.15.73:0/73606517 wait complete. 2024-04-15T15:32:47.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 Processor -- start 2024-04-15T15:32:47.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 -- start start 2024-04-15T15:32:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe5c071e10 0x7fbe5c1f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe5c0b20b0 0x7fbe5c13a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 0x7fbe5c13bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c0b3d70 con 0x7fbe5c146110 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c0b4c40 con 0x7fbe5c071e10 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe64000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5c0cdcf0 con 0x7fbe5c0b20b0 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe62000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 0x7fbe5c13bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe62000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 0x7fbe5c13bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42786/0 (socket says 172.21.15.73:42786) 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe62000640 1 -- 172.21.15.73:0/3134912217 learned_addr learned my addr 172.21.15.73:0/3134912217 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe60c00640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe5c0b20b0 0x7fbe5c13a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe61600640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe5c071e10 0x7fbe5c1f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe62000640 1 -- 172.21.15.73:0/3134912217 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe5c0b20b0 msgr2=0x7fbe5c13a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe62000640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe5c0b20b0 0x7fbe5c13a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe62000640 1 -- 172.21.15.73:0/3134912217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe5c071e10 msgr2=0x7fbe5c1f7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe62000640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe5c071e10 0x7fbe5c1f7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe62000640 1 -- 172.21.15.73:0/3134912217 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c1fbcb0 con 0x7fbe5c146110 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe61600640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe5c071e10 0x7fbe5c1f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:47.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.893+0000 7fbe60c00640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe5c0b20b0 0x7fbe5c13a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:47.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe62000640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 0x7fbe5c13bdc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400b970 tx=0x7fbe5400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:47.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe59600640 1 -- 172.21.15.73:0/3134912217 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54019070 con 0x7fbe5c146110 2024-04-15T15:32:47.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe59600640 1 -- 172.21.15.73:0/3134912217 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5400cb60 con 0x7fbe5c146110 2024-04-15T15:32:47.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe59600640 1 -- 172.21.15.73:0/3134912217 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54014440 con 0x7fbe5c146110 2024-04-15T15:32:47.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe64000640 1 -- 172.21.15.73:0/3134912217 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5c1fbf90 con 0x7fbe5c146110 2024-04-15T15:32:47.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe64000640 1 -- 172.21.15.73:0/3134912217 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe5c06e190 con 0x7fbe5c146110 2024-04-15T15:32:47.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe64000640 1 -- 172.21.15.73:0/3134912217 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5c068ab0 con 0x7fbe5c146110 2024-04-15T15:32:47.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe59600640 1 -- 172.21.15.73:0/3134912217 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe5401c070 con 0x7fbe5c146110 2024-04-15T15:32:47.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe59600640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe3c068380 0x7fbe3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:47.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe59600640 1 -- 172.21.15.73:0/3134912217 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7fbe54086730 con 0x7fbe5c146110 2024-04-15T15:32:47.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.897+0000 7fbe61600640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe3c068380 0x7fbe3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:47.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.901+0000 7fbe61600640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe3c068380 0x7fbe3c06a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbe500ae000 tx=0x7fbe50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:47.905+0000 7fbe59600640 1 -- 172.21.15.73:0/3134912217 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe54056ca0 con 0x7fbe5c146110 2024-04-15T15:32:48.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.061+0000 7fbe64000640 1 -- 172.21.15.73:0/3134912217 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbe5c0ce1f0 con 0x7fbe5c146110 2024-04-15T15:32:48.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.717+0000 7fbe59600640 1 -- 172.21.15.73:0/3134912217 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7fbe540565a0 con 0x7fbe5c146110 2024-04-15T15:32:48.718 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-04-15T15:32:48.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 -- 172.21.15.73:0/3134912217 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe3c068380 msgr2=0x7fbe3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:48.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe3c068380 0x7fbe3c06a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbe500ae000 tx=0x7fbe50008040 comp rx=0 tx=0).stop 2024-04-15T15:32:48.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 -- 172.21.15.73:0/3134912217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 msgr2=0x7fbe5c13bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:48.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 0x7fbe5c13bdc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400b970 tx=0x7fbe5400be30 comp rx=0 tx=0).stop 2024-04-15T15:32:48.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 -- 172.21.15.73:0/3134912217 shutdown_connections 2024-04-15T15:32:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c146110 0x7fbe5c13bdc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbe3c068380 0x7fbe3c06a840 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe5c0b20b0 0x7fbe5c13a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 --2- 172.21.15.73:0/3134912217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe5c071e10 0x7fbe5c1f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 -- 172.21.15.73:0/3134912217 >> 172.21.15.73:0/3134912217 conn(0x7fbe5c067dd0 msgr2=0x7fbe5c1435f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 -- 172.21.15.73:0/3134912217 shutdown_connections 2024-04-15T15:32:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.721+0000 7fbe64000640 1 -- 172.21.15.73:0/3134912217 wait complete. 2024-04-15T15:32:48.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-15T15:32:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.901+0000 7fb61e200640 1 Processor -- start 2024-04-15T15:32:48.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.901+0000 7fb61e200640 1 -- start start 2024-04-15T15:32:48.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.901+0000 7fb61e200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb618146110 0x7fb6180cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:48.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.901+0000 7fb61e200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6180b2530 0x7fb618072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:48.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.901+0000 7fb61e200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6180cd3a0 con 0x7fb6180b20b0 2024-04-15T15:32:48.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.901+0000 7fb61e200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb6180b29c0 con 0x7fb618146110 2024-04-15T15:32:48.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.901+0000 7fb61e200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb6180b5160 con 0x7fb6180b2530 2024-04-15T15:32:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.901+0000 7fb617400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb618146110 0x7fb6180cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb617400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb618146110 0x7fb6180cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42790/0 (socket says 172.21.15.73:42790) 2024-04-15T15:32:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb617400640 1 -- 172.21.15.73:0/1299973797 learned_addr learned my addr 172.21.15.73:0/1299973797 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb617e00640 1 --2- 172.21.15.73:0/1299973797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6180b2530 0x7fb618072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb617400640 1 -- 172.21.15.73:0/1299973797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6180b2530 msgr2=0x7fb618072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb617400640 1 --2- 172.21.15.73:0/1299973797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6180b2530 0x7fb618072520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb617400640 1 -- 172.21.15.73:0/1299973797 >> v1:172.21.15.118:6789/0 conn(0x7fb6180b20b0 legacy=0x7fb618071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:48.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb617400640 1 -- 172.21.15.73:0/1299973797 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6180b40c0 con 0x7fb618146110 2024-04-15T15:32:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb617400640 1 --2- 172.21.15.73:0/1299973797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb618146110 0x7fb6180cd7b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb608009870 tx=0x7fb60801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4aa2b97ad82dcfb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb616000640 1 -- 172.21.15.73:0/1299973797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6080a95f0 con 0x7fb618146110 2024-04-15T15:32:48.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb616000640 1 -- 172.21.15.73:0/1299973797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6080a9790 con 0x7fb618146110 2024-04-15T15:32:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.905+0000 7fb616000640 1 -- 172.21.15.73:0/1299973797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6080a9b60 con 0x7fb618146110 2024-04-15T15:32:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 -- 172.21.15.73:0/1299973797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb618146110 msgr2=0x7fb6180cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 --2- 172.21.15.73:0/1299973797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb618146110 0x7fb6180cd7b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb608009870 tx=0x7fb60801c530 comp rx=0 tx=0).stop 2024-04-15T15:32:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 -- 172.21.15.73:0/1299973797 shutdown_connections 2024-04-15T15:32:48.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 --2- 172.21.15.73:0/1299973797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6180b2530 0x7fb618072520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 --2- 172.21.15.73:0/1299973797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb618146110 0x7fb6180cd7b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 -- 172.21.15.73:0/1299973797 >> 172.21.15.73:0/1299973797 conn(0x7fb618067dd0 msgr2=0x7fb6180d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 -- 172.21.15.73:0/1299973797 shutdown_connections 2024-04-15T15:32:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 -- 172.21.15.73:0/1299973797 wait complete. 2024-04-15T15:32:48.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 Processor -- start 2024-04-15T15:32:48.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 -- start start 2024-04-15T15:32:48.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6180b20b0 0x7fb618142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:48.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6180b2530 0x7fb6181364e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:48.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb618146110 0x7fb618136a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:48.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb6180b3d70 con 0x7fb6180b20b0 2024-04-15T15:32:48.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb6180b4c40 con 0x7fb618146110 2024-04-15T15:32:48.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb61e200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb6180cdcf0 con 0x7fb6180b2530 2024-04-15T15:32:48.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb617400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6180b20b0 0x7fb618142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb617400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6180b20b0 0x7fb618142290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42806/0 (socket says 172.21.15.73:42806) 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb617400640 1 -- 172.21.15.73:0/988851277 learned_addr learned my addr 172.21.15.73:0/988851277 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb617400640 1 -- 172.21.15.73:0/988851277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6180b2530 msgr2=0x7fb6181364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb617400640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6180b2530 0x7fb6181364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb617400640 1 -- 172.21.15.73:0/988851277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb618146110 msgr2=0x7fb618136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb617400640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb618146110 0x7fb618136a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb617400640 1 -- 172.21.15.73:0/988851277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb618143520 con 0x7fb6180b20b0 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.909+0000 7fb617400640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6180b20b0 0x7fb618142290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb60801abe0 tx=0x7fb6080192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.913+0000 7fb60f400640 1 -- 172.21.15.73:0/988851277 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6080a95f0 con 0x7fb6180b20b0 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.913+0000 7fb60f400640 1 -- 172.21.15.73:0/988851277 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6080b1800 con 0x7fb6180b20b0 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.913+0000 7fb60f400640 1 -- 172.21.15.73:0/988851277 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6080b1bf0 con 0x7fb6180b20b0 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.913+0000 7fb61e200640 1 -- 172.21.15.73:0/988851277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb618142f70 con 0x7fb6180b20b0 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.913+0000 7fb61e200640 1 -- 172.21.15.73:0/988851277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb61806df20 con 0x7fb6180b20b0 2024-04-15T15:32:48.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.913+0000 7fb61e200640 1 -- 172.21.15.73:0/988851277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb618068ab0 con 0x7fb6180b20b0 2024-04-15T15:32:48.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.913+0000 7fb60f400640 1 -- 172.21.15.73:0/988851277 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6080c43f0 con 0x7fb6180b20b0 2024-04-15T15:32:48.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.913+0000 7fb60f400640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb5f8068380 0x7fb5f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:48.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.913+0000 7fb60f400640 1 -- 172.21.15.73:0/988851277 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7fb6081216e0 con 0x7fb6180b20b0 2024-04-15T15:32:48.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.913+0000 7fb616a00640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb5f8068380 0x7fb5f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:48.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.917+0000 7fb616a00640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb5f8068380 0x7fb5f806a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb604000f70 tx=0x7fb6040079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:48.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:48.917+0000 7fb60f400640 1 -- 172.21.15.73:0/988851277 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6080ca080 con 0x7fb6180b20b0 2024-04-15T15:32:49.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.109+0000 7fb61e200640 1 -- 172.21.15.73:0/988851277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb618154b40 con 0x7fb6180b20b0 2024-04-15T15:32:49.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.733+0000 7fb60f400640 1 -- 172.21.15.73:0/988851277 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7fb6080ad020 con 0x7fb6180b20b0 2024-04-15T15:32:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 5 and data pool 6 2024-04-15T15:32:49.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 -- 172.21.15.73:0/988851277 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb5f8068380 msgr2=0x7fb5f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:49.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb5f8068380 0x7fb5f806a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb604000f70 tx=0x7fb6040079e0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 -- 172.21.15.73:0/988851277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6180b20b0 msgr2=0x7fb618142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6180b20b0 0x7fb618142290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb60801abe0 tx=0x7fb6080192d0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 -- 172.21.15.73:0/988851277 shutdown_connections 2024-04-15T15:32:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb618146110 0x7fb618136a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb5f8068380 0x7fb5f806a840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6180b2530 0x7fb6181364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 --2- 172.21.15.73:0/988851277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6180b20b0 0x7fb618142290 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 -- 172.21.15.73:0/988851277 >> 172.21.15.73:0/988851277 conn(0x7fb618067dd0 msgr2=0x7fb6181449c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 -- 172.21.15.73:0/988851277 shutdown_connections 2024-04-15T15:32:49.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.749+0000 7fb61e200640 1 -- 172.21.15.73:0/988851277 wait complete. 2024-04-15T15:32:49.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:49.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f932a400640 1 Processor -- start 2024-04-15T15:32:49.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f932a400640 1 -- start start 2024-04-15T15:32:49.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f932a400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f93240b38d0 0x7f932409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:49.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f932a400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f932409b140 con 0x7f93240d16c0 2024-04-15T15:32:49.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f932a400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f932409b420 con 0x7f9324162cf0 2024-04-15T15:32:49.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f932a400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f932409b700 con 0x7f93240b38d0 2024-04-15T15:32:49.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f93240d16c0 0x7f93241625e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58590/0 (socket says 172.21.15.73:58590) 2024-04-15T15:32:49.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322a00640 1 -- 172.21.15.73:0/3988993397 learned_addr learned my addr 172.21.15.73:0/3988993397 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9323400640 1 --2- 172.21.15.73:0/3988993397 >> v2:172.21.15.118:3300/0 conn(0x7f93240b38d0 0x7f932409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 981495262 0 0) 0x7f932409b140 con 0x7f93240d16c0 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9308003530 con 0x7f93240d16c0 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966068056 0 0) 0x7f932409b420 con 0x7f9324162cf0 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f932409b140 con 0x7f9324162cf0 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2022758929 0 0) 0x7f9308003530 con 0x7f93240d16c0 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 >> v2:172.21.15.118:3300/0 conn(0x7f93240b38d0 msgr2=0x7f932409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 --2- 172.21.15.73:0/3988993397 >> v2:172.21.15.118:3300/0 conn(0x7f93240b38d0 0x7f932409aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 >> v1:172.21.15.118:6789/0 conn(0x7f9324162cf0 legacy=0x7f932415e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932409b9e0 con 0x7f93240d16c0 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f9310001680 con 0x7f93240d16c0 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 >> v1:172.21.15.73:6789/0 conn(0x7f93240d16c0 legacy=0x7f93241625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9308003ba0 0x7f9308003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:49.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9308004810 0x7f9308004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:49.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93080051d0 0x7f930800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:49.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f932409b700 con 0x7f93080051d0 2024-04-15T15:32:49.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f930800c0a0 con 0x7f9308003ba0 2024-04-15T15:32:49.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f930800c2a0 con 0x7f9308004810 2024-04-15T15:32:49.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9323400640 1 --2- 172.21.15.73:0/3988993397 >> v2:172.21.15.118:3300/0 conn(0x7f93240b38d0 0x7f932409aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:49.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9323e00640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93080051d0 0x7f930800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:49.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9322a00640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9308004810 0x7f9308004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:49.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.917+0000 7f9323400640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9308003ba0 0x7f9308003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:49.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9323e00640 1 -- 172.21.15.73:0/3988993397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9308004810 msgr2=0x7f9308004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:49.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9323e00640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9308004810 0x7f9308004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9323e00640 1 -- 172.21.15.73:0/3988993397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9308003ba0 msgr2=0x7f9308003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:49.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9323e00640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9308003ba0 0x7f9308003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9323e00640 1 -- 172.21.15.73:0/3988993397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9308003530 con 0x7f93080051d0 2024-04-15T15:32:49.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9323400640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9308003ba0 0x7f9308003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:49.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9322a00640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9308004810 0x7f9308004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:49.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9323e00640 1 -- 172.21.15.73:0/3988993397 reap_dead start 2024-04-15T15:32:49.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9323e00640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93080051d0 0x7f930800b9d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f932406f730 tx=0x7f931c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc3e1f48341355f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:49.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c001520 con 0x7f93080051d0 2024-04-15T15:32:49.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931c0052d0 con 0x7f93080051d0 2024-04-15T15:32:49.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f9322000640 1 -- 172.21.15.73:0/3988993397 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c003840 con 0x7f93080051d0 2024-04-15T15:32:49.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f932a400640 1 -- 172.21.15.73:0/3988993397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93080051d0 msgr2=0x7f930800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:49.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f932a400640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93080051d0 0x7f930800b9d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f932406f730 tx=0x7f931c01c560 comp rx=0 tx=0).stop 2024-04-15T15:32:49.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f932a400640 1 -- 172.21.15.73:0/3988993397 shutdown_connections 2024-04-15T15:32:49.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f932a400640 1 --2- 172.21.15.73:0/3988993397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93080051d0 0x7f930800b9d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f932a400640 1 -- 172.21.15.73:0/3988993397 >> 172.21.15.73:0/3988993397 conn(0x7f93240b4080 msgr2=0x7f93240b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f932a400640 1 -- 172.21.15.73:0/3988993397 shutdown_connections 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.921+0000 7f932a400640 1 -- 172.21.15.73:0/3988993397 wait complete. 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f932a400640 1 Processor -- start 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f932a400640 1 -- start start 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f932a400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93080051d0 0x7f93241f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f932a400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93240b7f90 0x7f93241f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f932a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93241f83d0 0x7f932415c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f932a400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f93240b3e30 con 0x7f93240b7f90 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f932a400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f93240b3cb0 con 0x7f93241f83d0 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f932a400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f932409aa60 con 0x7f93080051d0 2024-04-15T15:32:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9322a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93240b7f90 0x7f93241f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9322a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93240b7f90 0x7f93241f7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42824/0 (socket says 172.21.15.73:42824) 2024-04-15T15:32:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9322a00640 1 -- 172.21.15.73:0/1518762978 learned_addr learned my addr 172.21.15.73:0/1518762978 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9323e00640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93241f83d0 0x7f932415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9323400640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93080051d0 0x7f93241f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9322a00640 1 -- 172.21.15.73:0/1518762978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93080051d0 msgr2=0x7f93241f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9322a00640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93080051d0 0x7f93241f7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9322a00640 1 -- 172.21.15.73:0/1518762978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93241f83d0 msgr2=0x7f932415c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9322a00640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93241f83d0 0x7f932415c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9322a00640 1 -- 172.21.15.73:0/1518762978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93241f8860 con 0x7f93240b7f90 2024-04-15T15:32:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f9322a00640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93240b7f90 0x7f93241f7e90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9310011820 tx=0x7f9310011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f931b400640 1 -- 172.21.15.73:0/1518762978 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310010040 con 0x7f93240b7f90 2024-04-15T15:32:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f931b400640 1 -- 172.21.15.73:0/1518762978 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931001a070 con 0x7f93240b7f90 2024-04-15T15:32:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f932a400640 1 -- 172.21.15.73:0/1518762978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932415a9d0 con 0x7f93240b7f90 2024-04-15T15:32:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f931b400640 1 -- 172.21.15.73:0/1518762978 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931000fd00 con 0x7f93240b7f90 2024-04-15T15:32:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.925+0000 7f932a400640 1 -- 172.21.15.73:0/1518762978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93240b6780 con 0x7f93240b7f90 2024-04-15T15:32:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.929+0000 7f932a400640 1 -- 172.21.15.73:0/1518762978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9324068ab0 con 0x7f93240b7f90 2024-04-15T15:32:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.929+0000 7f931b400640 1 -- 172.21.15.73:0/1518762978 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f931001f460 con 0x7f93240b7f90 2024-04-15T15:32:49.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.929+0000 7f931b400640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f93040683b0 0x7f930406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:49.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.929+0000 7f931b400640 1 -- 172.21.15.73:0/1518762978 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f9310089c40 con 0x7f93240b7f90 2024-04-15T15:32:49.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.929+0000 7f9323400640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f93040683b0 0x7f930406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:49.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.929+0000 7f9323400640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f93040683b0 0x7f930406a870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f93140095c0 tx=0x7f931400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:49.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:49.933+0000 7f931b400640 1 -- 172.21.15.73:0/1518762978 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9310059a10 con 0x7f93240b7f90 2024-04-15T15:32:50.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.089+0000 7f932a400640 1 -- 172.21.15.73:0/1518762978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93240b4ce0 con 0x7f93240b7f90 2024-04-15T15:32:50.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f931b400640 1 -- 172.21.15.73:0/1518762978 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16931 (secure 0 0 0) 0x7f931005dd10 con 0x7f93240b7f90 2024-04-15T15:32:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:50.093 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:49.112167+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:50.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 -- 172.21.15.73:0/1518762978 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f93040683b0 msgr2=0x7f930406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f93040683b0 0x7f930406a870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f93140095c0 tx=0x7f931400b040 comp rx=0 tx=0).stop 2024-04-15T15:32:50.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 -- 172.21.15.73:0/1518762978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93240b7f90 msgr2=0x7f93241f7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93240b7f90 0x7f93241f7e90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9310011820 tx=0x7f9310011ce0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 -- 172.21.15.73:0/1518762978 shutdown_connections 2024-04-15T15:32:50.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93241f83d0 0x7f932415c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93240b7f90 0x7f93241f7e90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f93040683b0 0x7f930406a870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 --2- 172.21.15.73:0/1518762978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93080051d0 0x7f93241f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 -- 172.21.15.73:0/1518762978 >> 172.21.15.73:0/1518762978 conn(0x7f93240b4080 msgr2=0x7f93240c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:50.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 -- 172.21.15.73:0/1518762978 shutdown_connections 2024-04-15T15:32:50.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.093+0000 7f932a400640 1 -- 172.21.15.73:0/1518762978 wait complete. 2024-04-15T15:32:50.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:50.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.249+0000 7f5adc600640 1 Processor -- start 2024-04-15T15:32:50.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.249+0000 7f5adc600640 1 -- start start 2024-04-15T15:32:50.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5adc600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ad40b20b0 0x7f5ad40b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5adc600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ad415cbd0 0x7f5ad415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5adc600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad40cd3a0 con 0x7f5ad4146110 2024-04-15T15:32:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5adc600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad40b5160 con 0x7f5ad40b20b0 2024-04-15T15:32:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5adc600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad40b40c0 con 0x7f5ad415cbd0 2024-04-15T15:32:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5ad9200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ad40b20b0 0x7f5ad40b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5ad9200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ad40b20b0 0x7f5ad40b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42830/0 (socket says 172.21.15.73:42830) 2024-04-15T15:32:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5ad9200640 1 -- 172.21.15.73:0/1462546919 learned_addr learned my addr 172.21.15.73:0/1462546919 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5ada600640 1 --2- 172.21.15.73:0/1462546919 >> v2:172.21.15.118:3300/0 conn(0x7f5ad415cbd0 0x7f5ad415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5ad9200640 1 -- 172.21.15.73:0/1462546919 >> v2:172.21.15.118:3300/0 conn(0x7f5ad415cbd0 msgr2=0x7f5ad415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5ad9200640 1 --2- 172.21.15.73:0/1462546919 >> v2:172.21.15.118:3300/0 conn(0x7f5ad415cbd0 0x7f5ad415d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5ad9200640 1 -- 172.21.15.73:0/1462546919 >> v1:172.21.15.118:6789/0 conn(0x7f5ad4146110 legacy=0x7f5ad40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.253+0000 7f5ad9200640 1 -- 172.21.15.73:0/1462546919 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad40b43a0 con 0x7f5ad40b20b0 2024-04-15T15:32:50.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5ad9200640 1 --2- 172.21.15.73:0/1462546919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40b20b0 0x7f5ad40b2530 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40cd570 tx=0x7f5ac001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a76cf86328f2d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:50.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5ad3e00640 1 -- 172.21.15.73:0/1462546919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00ab610 con 0x7f5ad40b20b0 2024-04-15T15:32:50.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5ad3e00640 1 -- 172.21.15.73:0/1462546919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac00b0070 con 0x7f5ad40b20b0 2024-04-15T15:32:50.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5ad3e00640 1 -- 172.21.15.73:0/1462546919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00ab9d0 con 0x7f5ad40b20b0 2024-04-15T15:32:50.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 -- 172.21.15.73:0/1462546919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40b20b0 msgr2=0x7f5ad40b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 --2- 172.21.15.73:0/1462546919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40b20b0 0x7f5ad40b2530 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40cd570 tx=0x7f5ac001c520 comp rx=0 tx=0).stop 2024-04-15T15:32:50.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 -- 172.21.15.73:0/1462546919 shutdown_connections 2024-04-15T15:32:50.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 --2- 172.21.15.73:0/1462546919 >> v2:172.21.15.118:3300/0 conn(0x7f5ad415cbd0 0x7f5ad415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 --2- 172.21.15.73:0/1462546919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40b20b0 0x7f5ad40b2530 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 -- 172.21.15.73:0/1462546919 >> 172.21.15.73:0/1462546919 conn(0x7f5ad4067dd0 msgr2=0x7f5ad40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:50.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 -- 172.21.15.73:0/1462546919 shutdown_connections 2024-04-15T15:32:50.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 -- 172.21.15.73:0/1462546919 wait complete. 2024-04-15T15:32:50.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 Processor -- start 2024-04-15T15:32:50.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 -- start start 2024-04-15T15:32:50.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40b20b0 0x7f5ad4155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad4146110 0x7f5ad413b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad415cbd0 0x7f5ad413bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad4169210 con 0x7f5ad4146110 2024-04-15T15:32:50.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad40b3d70 con 0x7f5ad415cbd0 2024-04-15T15:32:50.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.257+0000 7f5adc600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad4169390 con 0x7f5ad40b20b0 2024-04-15T15:32:50.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad4146110 0x7f5ad413b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad4146110 0x7f5ad413b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42840/0 (socket says 172.21.15.73:42840) 2024-04-15T15:32:50.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad9200640 1 -- 172.21.15.73:0/2482276917 learned_addr learned my addr 172.21.15.73:0/2482276917 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:50.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad9c00640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40b20b0 0x7f5ad4155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ada600640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad415cbd0 0x7f5ad413bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad9200640 1 -- 172.21.15.73:0/2482276917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40b20b0 msgr2=0x7f5ad4155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad9200640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40b20b0 0x7f5ad4155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad9200640 1 -- 172.21.15.73:0/2482276917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad415cbd0 msgr2=0x7f5ad413bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad9200640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad415cbd0 0x7f5ad413bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad9200640 1 -- 172.21.15.73:0/2482276917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad413c110 con 0x7f5ad4146110 2024-04-15T15:32:50.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ada600640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad415cbd0 0x7f5ad413bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:50.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad9200640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad4146110 0x7f5ad413b690 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0019130 tx=0x7f5ac001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:50.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad1600640 1 -- 172.21.15.73:0/2482276917 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00be5f0 con 0x7f5ad4146110 2024-04-15T15:32:50.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad1600640 1 -- 172.21.15.73:0/2482276917 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac00be790 con 0x7f5ad4146110 2024-04-15T15:32:50.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad1600640 1 -- 172.21.15.73:0/2482276917 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00beb40 con 0x7f5ad4146110 2024-04-15T15:32:50.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5adc600640 1 -- 172.21.15.73:0/2482276917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad413c3a0 con 0x7f5ad4146110 2024-04-15T15:32:50.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5adc600640 1 -- 172.21.15.73:0/2482276917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad413c960 con 0x7f5ad4146110 2024-04-15T15:32:50.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5adc600640 1 -- 172.21.15.73:0/2482276917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad4068ab0 con 0x7f5ad4146110 2024-04-15T15:32:50.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad1600640 1 -- 172.21.15.73:0/2482276917 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ac00b43f0 con 0x7f5ad4146110 2024-04-15T15:32:50.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.261+0000 7f5ad1600640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5ab4068380 0x7f5ab406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.265+0000 7f5ad1600640 1 -- 172.21.15.73:0/2482276917 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f5ac0120df0 con 0x7f5ad4146110 2024-04-15T15:32:50.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.265+0000 7f5ad9c00640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5ab4068380 0x7f5ab406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.265+0000 7f5ad9c00640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5ab4068380 0x7f5ab406a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8001810 tx=0x7f5ac8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:50.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.269+0000 7f5ad1600640 1 -- 172.21.15.73:0/2482276917 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ac00a8050 con 0x7f5ad4146110 2024-04-15T15:32:50.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.425+0000 7f5adc600640 1 -- 172.21.15.73:0/2482276917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ad41599c0 con 0x7f5ad4146110 2024-04-15T15:32:50.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.425+0000 7f5ad1600640 1 -- 172.21.15.73:0/2482276917 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16931 (secure 0 0 0) 0x7f5ac0016110 con 0x7f5ad4146110 2024-04-15T15:32:50.427 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:50.428 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:49.112167+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 -- 172.21.15.73:0/2482276917 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5ab4068380 msgr2=0x7f5ab406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5ab4068380 0x7f5ab406a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8001810 tx=0x7f5ac8009040 comp rx=0 tx=0).stop 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 -- 172.21.15.73:0/2482276917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad4146110 msgr2=0x7f5ad413b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad4146110 0x7f5ad413b690 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0019130 tx=0x7f5ac001ad60 comp rx=0 tx=0).stop 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 -- 172.21.15.73:0/2482276917 shutdown_connections 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad415cbd0 0x7f5ad413bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad4146110 0x7f5ad413b690 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5ab4068380 0x7f5ab406a840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 --2- 172.21.15.73:0/2482276917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40b20b0 0x7f5ad4155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 -- 172.21.15.73:0/2482276917 >> 172.21.15.73:0/2482276917 conn(0x7f5ad4067dd0 msgr2=0x7f5ad40cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 -- 172.21.15.73:0/2482276917 shutdown_connections 2024-04-15T15:32:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.429+0000 7f5adc600640 1 -- 172.21.15.73:0/2482276917 wait complete. 2024-04-15T15:32:50.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-15T15:32:50.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe500200640 1 Processor -- start 2024-04-15T15:32:50.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe500200640 1 -- start start 2024-04-15T15:32:50.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe500200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4f815b5d0 0x7fe4f815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe500200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f80b3e30 0x7fe4f80b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe500200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f8070160 con 0x7fe4f80b25f0 2024-04-15T15:32:50.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe500200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f815b9b0 con 0x7fe4f815b5d0 2024-04-15T15:32:50.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe500200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f815f1f0 con 0x7fe4f80b3e30 2024-04-15T15:32:50.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe4fd800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4f815b5d0 0x7fe4f815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe4fd800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4f815b5d0 0x7fe4f815fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42844/0 (socket says 172.21.15.73:42844) 2024-04-15T15:32:50.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe4fd800640 1 -- 172.21.15.73:0/2601372799 learned_addr learned my addr 172.21.15.73:0/2601372799 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:50.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.585+0000 7fe4fce00640 1 --2- 172.21.15.73:0/2601372799 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f80b3e30 0x7fe4f80b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe4fd800640 1 -- 172.21.15.73:0/2601372799 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f80b3e30 msgr2=0x7fe4f80b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:50.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe4fd800640 1 --2- 172.21.15.73:0/2601372799 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f80b3e30 0x7fe4f80b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe4fd800640 1 -- 172.21.15.73:0/2601372799 >> v1:172.21.15.118:6789/0 conn(0x7fe4f80b25f0 legacy=0x7fe4f80b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe4fd800640 1 -- 172.21.15.73:0/2601372799 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f806fe80 con 0x7fe4f815b5d0 2024-04-15T15:32:50.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe4fd800640 1 --2- 172.21.15.73:0/2601372799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f815b5d0 0x7fe4f815fc90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00bb10 tx=0x7fe4ec01eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bf491ff3ba4527 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe4f7e00640 1 -- 172.21.15.73:0/2601372799 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0b4070 con 0x7fe4f815b5d0 2024-04-15T15:32:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe4f7e00640 1 -- 172.21.15.73:0/2601372799 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0a7aa0 con 0x7fe4f815b5d0 2024-04-15T15:32:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe4f7e00640 1 -- 172.21.15.73:0/2601372799 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0af440 con 0x7fe4f815b5d0 2024-04-15T15:32:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe500200640 1 -- 172.21.15.73:0/2601372799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f815b5d0 msgr2=0x7fe4f815fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe500200640 1 --2- 172.21.15.73:0/2601372799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f815b5d0 0x7fe4f815fc90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00bb10 tx=0x7fe4ec01eae0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe500200640 1 -- 172.21.15.73:0/2601372799 shutdown_connections 2024-04-15T15:32:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe500200640 1 --2- 172.21.15.73:0/2601372799 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f80b3e30 0x7fe4f80b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe500200640 1 --2- 172.21.15.73:0/2601372799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f815b5d0 0x7fe4f815fc90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.589+0000 7fe500200640 1 -- 172.21.15.73:0/2601372799 >> 172.21.15.73:0/2601372799 conn(0x7fe4f8067dd0 msgr2=0x7fe4f80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 -- 172.21.15.73:0/2601372799 shutdown_connections 2024-04-15T15:32:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 -- 172.21.15.73:0/2601372799 wait complete. 2024-04-15T15:32:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 Processor -- start 2024-04-15T15:32:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 -- start start 2024-04-15T15:32:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f80b25f0 0x7fe4f8152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4f80b3e30 0x7fe4f8165c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f815b5d0 0x7fe4f814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f80b4390 con 0x7fe4f80b25f0 2024-04-15T15:32:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f80b4210 con 0x7fe4f80b3e30 2024-04-15T15:32:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f806faa0 con 0x7fe4f815b5d0 2024-04-15T15:32:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fd800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f80b25f0 0x7fe4f8152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fd800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f80b25f0 0x7fe4f8152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42846/0 (socket says 172.21.15.73:42846) 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fd800640 1 -- 172.21.15.73:0/1874799410 learned_addr learned my addr 172.21.15.73:0/1874799410 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fce00640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4f80b3e30 0x7fe4f8165c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fe200640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f815b5d0 0x7fe4f814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fd800640 1 -- 172.21.15.73:0/1874799410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f815b5d0 msgr2=0x7fe4f814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fd800640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f815b5d0 0x7fe4f814b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fd800640 1 -- 172.21.15.73:0/1874799410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4f80b3e30 msgr2=0x7fe4f8165c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fd800640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4f80b3e30 0x7fe4f8165c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fd800640 1 -- 172.21.15.73:0/1874799410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f8166180 con 0x7fe4f80b25f0 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fe200640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f815b5d0 0x7fe4f814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4fd800640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f80b25f0 0x7fe4f8152620 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00b2c0 tx=0x7fe4ec01b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4f5600640 1 -- 172.21.15.73:0/1874799410 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0be020 con 0x7fe4f80b25f0 2024-04-15T15:32:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4f5600640 1 -- 172.21.15.73:0/1874799410 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0af7a0 con 0x7fe4f80b25f0 2024-04-15T15:32:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe4f5600640 1 -- 172.21.15.73:0/1874799410 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0b4040 con 0x7fe4f80b25f0 2024-04-15T15:32:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.593+0000 7fe500200640 1 -- 172.21.15.73:0/1874799410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f814b9a0 con 0x7fe4f80b25f0 2024-04-15T15:32:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.597+0000 7fe500200640 1 -- 172.21.15.73:0/1874799410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f815c8d0 con 0x7fe4f80b25f0 2024-04-15T15:32:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.597+0000 7fe500200640 1 -- 172.21.15.73:0/1874799410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f8068ab0 con 0x7fe4f80b25f0 2024-04-15T15:32:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.597+0000 7fe4f5600640 1 -- 172.21.15.73:0/1874799410 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4ec0c1020 con 0x7fe4f80b25f0 2024-04-15T15:32:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.597+0000 7fe4f5600640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe4d8068380 0x7fe4d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.597+0000 7fe4f5600640 1 -- 172.21.15.73:0/1874799410 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe4ec123770 con 0x7fe4f80b25f0 2024-04-15T15:32:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.597+0000 7fe4fce00640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe4d8068380 0x7fe4d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.597+0000 7fe4fce00640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe4d8068380 0x7fe4d806a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80afad0 tx=0x7fe4e4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.601+0000 7fe4f5600640 1 -- 172.21.15.73:0/1874799410 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4ec0c8030 con 0x7fe4f80b25f0 2024-04-15T15:32:50.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:50.797+0000 7fe500200640 1 -- 172.21.15.73:0/1874799410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe4f80b4870 con 0x7fe4f80b25f0 2024-04-15T15:32:51.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe4f5600640 1 -- 172.21.15.73:0/1874799410 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fe4ec018820 con 0x7fe4f80b25f0 2024-04-15T15:32:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe500200640 1 -- 172.21.15.73:0/1874799410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe4d8068380 msgr2=0x7fe4d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe500200640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe4d8068380 0x7fe4d806a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80afad0 tx=0x7fe4e4009190 comp rx=0 tx=0).stop 2024-04-15T15:32:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe500200640 1 -- 172.21.15.73:0/1874799410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f80b25f0 msgr2=0x7fe4f8152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe500200640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f80b25f0 0x7fe4f8152620 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00b2c0 tx=0x7fe4ec01b880 comp rx=0 tx=0).stop 2024-04-15T15:32:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe500200640 1 -- 172.21.15.73:0/1874799410 shutdown_connections 2024-04-15T15:32:51.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe500200640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe4d8068380 0x7fe4d806a840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe500200640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4f815b5d0 0x7fe4f814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe500200640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4f80b3e30 0x7fe4f8165c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe500200640 1 --2- 172.21.15.73:0/1874799410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4f80b25f0 0x7fe4f8152620 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.745+0000 7fe500200640 1 -- 172.21.15.73:0/1874799410 >> 172.21.15.73:0/1874799410 conn(0x7fe4f8067dd0 msgr2=0x7fe4f80cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.749+0000 7fe500200640 1 -- 172.21.15.73:0/1874799410 shutdown_connections 2024-04-15T15:32:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.749+0000 7fe500200640 1 -- 172.21.15.73:0/1874799410 wait complete. 2024-04-15T15:32:51.771 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-15T15:32:51.771 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-15T15:32:51.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90ea800640 1 Processor -- start 2024-04-15T15:32:51.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90ea800640 1 -- start start 2024-04-15T15:32:51.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90ea800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90e40b0930 0x7f90e40aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:51.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90ea800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90e40af060 0x7f90e40b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:51.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90ea800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e40b4300 con 0x7f90e415b5d0 2024-04-15T15:32:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90ea800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f90e40af4f0 con 0x7f90e40af060 2024-04-15T15:32:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90ea800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f90e40af750 con 0x7f90e40b0930 2024-04-15T15:32:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90e3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90e40af060 0x7f90e40b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90e3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90e40af060 0x7f90e40b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42856/0 (socket says 172.21.15.73:42856) 2024-04-15T15:32:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90e3e00640 1 -- 172.21.15.73:0/2774098507 learned_addr learned my addr 172.21.15.73:0/2774098507 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90dbe00640 1 --2- 172.21.15.73:0/2774098507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90e40b0930 0x7f90e40aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90e3e00640 1 -- 172.21.15.73:0/2774098507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90e40b0930 msgr2=0x7f90e40aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90e3e00640 1 --2- 172.21.15.73:0/2774098507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90e40b0930 0x7f90e40aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90e3e00640 1 -- 172.21.15.73:0/2774098507 >> v1:172.21.15.118:6789/0 conn(0x7f90e415b5d0 legacy=0x7f90e40b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.913+0000 7f90e3e00640 1 -- 172.21.15.73:0/2774098507 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e40afa30 con 0x7f90e40af060 2024-04-15T15:32:51.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90e3e00640 1 --2- 172.21.15.73:0/2774098507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e40af060 0x7f90e40b4ae0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009e50 tx=0x7f90dc01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e79c7dae0979a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:51.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90e2a00640 1 -- 172.21.15.73:0/2774098507 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0b4070 con 0x7f90e40af060 2024-04-15T15:32:51.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90e2a00640 1 -- 172.21.15.73:0/2774098507 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc0af400 con 0x7f90e40af060 2024-04-15T15:32:51.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90e2a00640 1 -- 172.21.15.73:0/2774098507 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0af7d0 con 0x7f90e40af060 2024-04-15T15:32:51.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90ea800640 1 -- 172.21.15.73:0/2774098507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e40af060 msgr2=0x7f90e40b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:51.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90ea800640 1 --2- 172.21.15.73:0/2774098507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e40af060 0x7f90e40b4ae0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009e50 tx=0x7f90dc01f210 comp rx=0 tx=0).stop 2024-04-15T15:32:51.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90ea800640 1 -- 172.21.15.73:0/2774098507 shutdown_connections 2024-04-15T15:32:51.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90ea800640 1 --2- 172.21.15.73:0/2774098507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e40af060 0x7f90e40b4ae0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:51.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90ea800640 1 --2- 172.21.15.73:0/2774098507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90e40b0930 0x7f90e40aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:51.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90ea800640 1 -- 172.21.15.73:0/2774098507 >> 172.21.15.73:0/2774098507 conn(0x7f90e40b6820 msgr2=0x7f90e40b6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90ea800640 1 -- 172.21.15.73:0/2774098507 shutdown_connections 2024-04-15T15:32:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.917+0000 7f90ea800640 1 -- 172.21.15.73:0/2774098507 wait complete. 2024-04-15T15:32:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 Processor -- start 2024-04-15T15:32:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 -- start start 2024-04-15T15:32:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90e40af060 0x7f90e409c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90e40b0930 0x7f90e4155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e415b5d0 0x7f90e4147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f90e415b9b0 con 0x7f90e415b5d0 2024-04-15T15:32:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f90e40b45c0 con 0x7f90e40b0930 2024-04-15T15:32:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f90e415bb30 con 0x7f90e40af060 2024-04-15T15:32:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90e3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e415b5d0 0x7f90e4147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90e3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e415b5d0 0x7f90e4147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42864/0 (socket says 172.21.15.73:42864) 2024-04-15T15:32:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90e3e00640 1 -- 172.21.15.73:0/4017592074 learned_addr learned my addr 172.21.15.73:0/4017592074 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90e3e00640 1 -- 172.21.15.73:0/4017592074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90e40af060 msgr2=0x7f90e409c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90e3e00640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90e40af060 0x7f90e409c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90e3e00640 1 -- 172.21.15.73:0/4017592074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90e40b0930 msgr2=0x7f90e4155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90e3e00640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90e40b0930 0x7f90e4155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90e3e00640 1 -- 172.21.15.73:0/4017592074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e409b590 con 0x7f90e415b5d0 2024-04-15T15:32:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90e3e00640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e415b5d0 0x7f90e4147ac0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f90dc01ce40 tx=0x7f90dc01bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90db400640 1 -- 172.21.15.73:0/4017592074 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0be030 con 0x7f90e415b5d0 2024-04-15T15:32:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90db400640 1 -- 172.21.15.73:0/4017592074 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc0afdb0 con 0x7f90e415b5d0 2024-04-15T15:32:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 -- 172.21.15.73:0/4017592074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e409b870 con 0x7f90e415b5d0 2024-04-15T15:32:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90db400640 1 -- 172.21.15.73:0/4017592074 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0b4040 con 0x7f90e415b5d0 2024-04-15T15:32:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 -- 172.21.15.73:0/4017592074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e4155fc0 con 0x7f90e415b5d0 2024-04-15T15:32:51.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.921+0000 7f90ea800640 1 -- 172.21.15.73:0/4017592074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e4068ab0 con 0x7f90e415b5d0 2024-04-15T15:32:51.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.925+0000 7f90db400640 1 -- 172.21.15.73:0/4017592074 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f90dc0c1070 con 0x7f90e415b5d0 2024-04-15T15:32:51.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.925+0000 7f90db400640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f90c0068380 0x7f90c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:51.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.925+0000 7f90db400640 1 -- 172.21.15.73:0/4017592074 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f90dc124510 con 0x7f90e415b5d0 2024-04-15T15:32:51.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.925+0000 7f90e3400640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f90c0068380 0x7f90c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:51.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.925+0000 7f90e3400640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f90c0068380 0x7f90c006a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f90d4000f70 tx=0x7f90d40079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:51.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:51.929+0000 7f90db400640 1 -- 172.21.15.73:0/4017592074 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f90dc0c9020 con 0x7f90e415b5d0 2024-04-15T15:32:52.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.121+0000 7f90ea800640 1 -- 172.21.15.73:0/4017592074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f90e406c740 con 0x7f90e415b5d0 2024-04-15T15:32:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.745+0000 7f90db400640 1 -- 172.21.15.73:0/4017592074 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f90dc018d70 con 0x7f90e415b5d0 2024-04-15T15:32:52.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 -- 172.21.15.73:0/4017592074 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f90c0068380 msgr2=0x7f90c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f90c0068380 0x7f90c006a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f90d4000f70 tx=0x7f90d40079e0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 -- 172.21.15.73:0/4017592074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e415b5d0 msgr2=0x7f90e4147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e415b5d0 0x7f90e4147ac0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f90dc01ce40 tx=0x7f90dc01bfb0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 -- 172.21.15.73:0/4017592074 shutdown_connections 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90e415b5d0 0x7f90e4147ac0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90e40b0930 0x7f90e4155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f90c0068380 0x7f90c006a840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 --2- 172.21.15.73:0/4017592074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90e40af060 0x7f90e409c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 -- 172.21.15.73:0/4017592074 >> 172.21.15.73:0/4017592074 conn(0x7f90e40b6820 msgr2=0x7f90e406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 -- 172.21.15.73:0/4017592074 shutdown_connections 2024-04-15T15:32:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.749+0000 7f90ea800640 1 -- 172.21.15.73:0/4017592074 wait complete. 2024-04-15T15:32:52.772 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-15T15:32:52.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:32:52.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.909+0000 7f6a45a00640 1 Processor -- start 2024-04-15T15:32:52.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.909+0000 7f6a45a00640 1 -- start start 2024-04-15T15:32:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a45a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6a400b20b0 0x7f6a400b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a45a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a4015cbd0 0x7f6a4015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a45a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a400cd3a0 con 0x7f6a40146110 2024-04-15T15:32:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a45a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6a400b5160 con 0x7f6a4015cbd0 2024-04-15T15:32:52.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a45a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f6a400b40c0 con 0x7f6a400b20b0 2024-04-15T15:32:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a3f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a4015cbd0 0x7f6a4015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a3ea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6a40146110 0x7f6a400cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58606/0 (socket says 172.21.15.73:58606) 2024-04-15T15:32:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a3ea00640 1 -- 172.21.15.73:0/1090688354 learned_addr learned my addr 172.21.15.73:0/1090688354 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a36000640 1 --2- 172.21.15.73:0/1090688354 >> v2:172.21.15.118:3300/0 conn(0x7f6a400b20b0 0x7f6a400b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a3f400640 1 -- 172.21.15.73:0/1090688354 >> v2:172.21.15.118:3300/0 conn(0x7f6a400b20b0 msgr2=0x7f6a400b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a3f400640 1 --2- 172.21.15.73:0/1090688354 >> v2:172.21.15.118:3300/0 conn(0x7f6a400b20b0 0x7f6a400b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a3f400640 1 -- 172.21.15.73:0/1090688354 >> v1:172.21.15.73:6789/0 conn(0x7f6a40146110 legacy=0x7f6a400cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a3f400640 1 -- 172.21.15.73:0/1090688354 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a400b43a0 con 0x7f6a4015cbd0 2024-04-15T15:32:52.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a3e000640 1 -- 172.21.15.73:0/1090688354 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134693118 0 0) 0x7f6a400cd3a0 con 0x7f6a40146110 2024-04-15T15:32:52.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a36000640 1 --2- 172.21.15.73:0/1090688354 >> v2:172.21.15.118:3300/0 conn(0x7f6a400b20b0 0x7f6a400b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:52.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.913+0000 7f6a3f400640 1 --2- 172.21.15.73:0/1090688354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4015cbd0 0x7f6a4015d020 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6a400cd570 tx=0x7f6a3801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce479cf0c605d319 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:52.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a3e000640 1 -- 172.21.15.73:0/1090688354 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a380b0070 con 0x7f6a4015cbd0 2024-04-15T15:32:52.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a3e000640 1 -- 172.21.15.73:0/1090688354 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a38004230 con 0x7f6a4015cbd0 2024-04-15T15:32:52.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a3e000640 1 -- 172.21.15.73:0/1090688354 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38003620 con 0x7f6a4015cbd0 2024-04-15T15:32:52.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 -- 172.21.15.73:0/1090688354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4015cbd0 msgr2=0x7f6a4015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:52.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 --2- 172.21.15.73:0/1090688354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4015cbd0 0x7f6a4015d020 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6a400cd570 tx=0x7f6a3801c460 comp rx=0 tx=0).stop 2024-04-15T15:32:52.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 -- 172.21.15.73:0/1090688354 shutdown_connections 2024-04-15T15:32:52.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 --2- 172.21.15.73:0/1090688354 >> v2:172.21.15.118:3300/0 conn(0x7f6a400b20b0 0x7f6a400b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 --2- 172.21.15.73:0/1090688354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4015cbd0 0x7f6a4015d020 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 -- 172.21.15.73:0/1090688354 >> 172.21.15.73:0/1090688354 conn(0x7f6a40067dd0 msgr2=0x7f6a400d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:52.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 -- 172.21.15.73:0/1090688354 shutdown_connections 2024-04-15T15:32:52.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 -- 172.21.15.73:0/1090688354 wait complete. 2024-04-15T15:32:52.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 Processor -- start 2024-04-15T15:32:52.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 -- start start 2024-04-15T15:32:52.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a400b20b0 0x7f6a4013f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:52.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a40146110 0x7f6a400a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:52.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a4015cbd0 0x7f6a400a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:52.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40169210 con 0x7f6a400b20b0 2024-04-15T15:32:52.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6a400b3d70 con 0x7f6a40146110 2024-04-15T15:32:52.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a45a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6a40169390 con 0x7f6a4015cbd0 2024-04-15T15:32:52.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a3ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a400b20b0 0x7f6a4013f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:52.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a3ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a400b20b0 0x7f6a4013f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42876/0 (socket says 172.21.15.73:42876) 2024-04-15T15:32:52.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a3ea00640 1 -- 172.21.15.73:0/677898889 learned_addr learned my addr 172.21.15.73:0/677898889 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:52.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a36000640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a40146110 0x7f6a400a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.917+0000 7f6a3f400640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a4015cbd0 0x7f6a400a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a3ea00640 1 -- 172.21.15.73:0/677898889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a4015cbd0 msgr2=0x7f6a400a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a3ea00640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a4015cbd0 0x7f6a400a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a3ea00640 1 -- 172.21.15.73:0/677898889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a40146110 msgr2=0x7f6a400a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a3ea00640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a40146110 0x7f6a400a94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a3ea00640 1 -- 172.21.15.73:0/677898889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a40158eb0 con 0x7f6a400b20b0 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a3f400640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a4015cbd0 0x7f6a400a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a3ea00640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a400b20b0 0x7f6a4013f240 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6a30001570 tx=0x7f6a3000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a37400640 1 -- 172.21.15.73:0/677898889 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a30018070 con 0x7f6a400b20b0 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a37400640 1 -- 172.21.15.73:0/677898889 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3000a640 con 0x7f6a400b20b0 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a45a00640 1 -- 172.21.15.73:0/677898889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4013e760 con 0x7f6a400b20b0 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a37400640 1 -- 172.21.15.73:0/677898889 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000aa30 con 0x7f6a400b20b0 2024-04-15T15:32:52.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a45a00640 1 -- 172.21.15.73:0/677898889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4013ed20 con 0x7f6a400b20b0 2024-04-15T15:32:52.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a45a00640 1 -- 172.21.15.73:0/677898889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a40068ab0 con 0x7f6a400b20b0 2024-04-15T15:32:52.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a37400640 1 -- 172.21.15.73:0/677898889 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a3001b070 con 0x7f6a400b20b0 2024-04-15T15:32:52.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a37400640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6a1c068380 0x7f6a1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:52.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a37400640 1 -- 172.21.15.73:0/677898889 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6a300861a0 con 0x7f6a400b20b0 2024-04-15T15:32:52.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.921+0000 7f6a36000640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6a1c068380 0x7f6a1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:52.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.925+0000 7f6a36000640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6a1c068380 0x7f6a1c06a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6a401437f0 tx=0x7f6a28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:52.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:52.925+0000 7f6a37400640 1 -- 172.21.15.73:0/677898889 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a30055f70 con 0x7f6a400b20b0 2024-04-15T15:32:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.113+0000 7f6a45a00640 1 -- 172.21.15.73:0/677898889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a400691c0 con 0x7f6a400b20b0 2024-04-15T15:32:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a37400640 1 -- 172.21.15.73:0/677898889 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5187 (secure 0 0 0) 0x7f6a3005a270 con 0x7f6a400b20b0 2024-04-15T15:32:53.116 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:53.117 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5322,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1374015509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1374015509},{"type":"v1","addr":"172.21.15.73:6836","nonce":1374015509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:32:49.112134+0000","modified":"2024-04-15T15:32:52.124603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/2635966606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2635966606},{"type":"v1","addr":"172.21.15.118:6834","nonce":2635966606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":2}]} 2024-04-15T15:32:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 18 2024-04-15T15:32:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 -- 172.21.15.73:0/677898889 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6a1c068380 msgr2=0x7f6a1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6a1c068380 0x7f6a1c06a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6a401437f0 tx=0x7f6a28008040 comp rx=0 tx=0).stop 2024-04-15T15:32:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 -- 172.21.15.73:0/677898889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a400b20b0 msgr2=0x7f6a4013f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a400b20b0 0x7f6a4013f240 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6a30001570 tx=0x7f6a3000cd20 comp rx=0 tx=0).stop 2024-04-15T15:32:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 -- 172.21.15.73:0/677898889 shutdown_connections 2024-04-15T15:32:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6a1c068380 0x7f6a1c06a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a4015cbd0 0x7f6a400a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a40146110 0x7f6a400a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 --2- 172.21.15.73:0/677898889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a400b20b0 0x7f6a4013f240 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 -- 172.21.15.73:0/677898889 >> 172.21.15.73:0/677898889 conn(0x7f6a40067dd0 msgr2=0x7f6a40071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 -- 172.21.15.73:0/677898889 shutdown_connections 2024-04-15T15:32:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.117+0000 7f6a45a00640 1 -- 172.21.15.73:0/677898889 wait complete. 2024-04-15T15:32:53.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b28400640 1 Processor -- start 2024-04-15T15:32:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b28400640 1 -- start start 2024-04-15T15:32:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b28400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6b200d0dd0 0x7f6b200cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b28400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b201676e0 0x7f6b200c4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b28400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b200ce6a0 con 0x7f6b200ce220 2024-04-15T15:32:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b28400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f6b20163390 con 0x7f6b200d0dd0 2024-04-15T15:32:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b28400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6b200b16d0 con 0x7f6b201676e0 2024-04-15T15:32:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b25a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6b200d0dd0 0x7f6b200cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b26400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b201676e0 0x7f6b200c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b25a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6b200d0dd0 0x7f6b200cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:56140/0 (socket says 172.21.15.73:56140) 2024-04-15T15:32:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b25a00640 1 -- 172.21.15.73:0/3294452649 learned_addr learned my addr 172.21.15.73:0/3294452649 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b25a00640 1 -- 172.21.15.73:0/3294452649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b201676e0 msgr2=0x7f6b200c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b25a00640 1 --2- 172.21.15.73:0/3294452649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b201676e0 0x7f6b200c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b25a00640 1 -- 172.21.15.73:0/3294452649 >> v1:172.21.15.118:6789/0 conn(0x7f6b200ce220 legacy=0x7f6b200cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.273+0000 7f6b25a00640 1 -- 172.21.15.73:0/3294452649 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b200ce980 con 0x7f6b200d0dd0 2024-04-15T15:32:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b25a00640 1 --2- 172.21.15.73:0/3294452649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b200d0dd0 0x7f6b200cdce0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6b14009e50 tx=0x7f6b1401ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e99ce9c8d300ef38 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b1fe00640 1 -- 172.21.15.73:0/3294452649 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b140a5810 con 0x7f6b200d0dd0 2024-04-15T15:32:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b1fe00640 1 -- 172.21.15.73:0/3294452649 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b140a59b0 con 0x7f6b200d0dd0 2024-04-15T15:32:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b1fe00640 1 -- 172.21.15.73:0/3294452649 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b140a5d80 con 0x7f6b200d0dd0 2024-04-15T15:32:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b28400640 1 -- 172.21.15.73:0/3294452649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b200d0dd0 msgr2=0x7f6b200cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b28400640 1 --2- 172.21.15.73:0/3294452649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b200d0dd0 0x7f6b200cdce0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6b14009e50 tx=0x7f6b1401ca30 comp rx=0 tx=0).stop 2024-04-15T15:32:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b28400640 1 -- 172.21.15.73:0/3294452649 shutdown_connections 2024-04-15T15:32:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b28400640 1 --2- 172.21.15.73:0/3294452649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b201676e0 0x7f6b200c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b28400640 1 --2- 172.21.15.73:0/3294452649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b200d0dd0 0x7f6b200cdce0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b28400640 1 -- 172.21.15.73:0/3294452649 >> 172.21.15.73:0/3294452649 conn(0x7f6b2009aa60 msgr2=0x7f6b200d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b28400640 1 -- 172.21.15.73:0/3294452649 shutdown_connections 2024-04-15T15:32:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.277+0000 7f6b28400640 1 -- 172.21.15.73:0/3294452649 wait complete. 2024-04-15T15:32:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b28400640 1 Processor -- start 2024-04-15T15:32:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b28400640 1 -- start start 2024-04-15T15:32:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b28400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b200ce220 0x7f6b2014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b28400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b200d0dd0 0x7f6b2015de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b28400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b201676e0 0x7f6b2015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b28400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6b200b2580 con 0x7f6b201676e0 2024-04-15T15:32:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b28400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2016fdb0 con 0x7f6b200d0dd0 2024-04-15T15:32:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b28400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2015ae00 con 0x7f6b200ce220 2024-04-15T15:32:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b26400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b201676e0 0x7f6b2015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b26400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b201676e0 0x7f6b2015a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42892/0 (socket says 172.21.15.73:42892) 2024-04-15T15:32:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b26400640 1 -- 172.21.15.73:0/3705378249 learned_addr learned my addr 172.21.15.73:0/3705378249 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b25000640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b200d0dd0 0x7f6b2015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b25a00640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b200ce220 0x7f6b2014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b26400640 1 -- 172.21.15.73:0/3705378249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b200ce220 msgr2=0x7f6b2014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b26400640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b200ce220 0x7f6b2014a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b26400640 1 -- 172.21.15.73:0/3705378249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b200d0dd0 msgr2=0x7f6b2015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b26400640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b200d0dd0 0x7f6b2015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b26400640 1 -- 172.21.15.73:0/3705378249 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2015b0e0 con 0x7f6b201676e0 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b26400640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b201676e0 0x7f6b2015a340 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800e880 tx=0x7f6b1800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b1d600640 1 -- 172.21.15.73:0/3705378249 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b18017070 con 0x7f6b201676e0 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b1d600640 1 -- 172.21.15.73:0/3705378249 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b1800c940 con 0x7f6b201676e0 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b1d600640 1 -- 172.21.15.73:0/3705378249 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1800cd10 con 0x7f6b201676e0 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b28400640 1 -- 172.21.15.73:0/3705378249 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b20158a10 con 0x7f6b201676e0 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.281+0000 7f6b28400640 1 -- 172.21.15.73:0/3705378249 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b2015e390 con 0x7f6b201676e0 2024-04-15T15:32:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.285+0000 7f6b28400640 1 -- 172.21.15.73:0/3705378249 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b20068ab0 con 0x7f6b201676e0 2024-04-15T15:32:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.285+0000 7f6b1d600640 1 -- 172.21.15.73:0/3705378249 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b1801a070 con 0x7f6b201676e0 2024-04-15T15:32:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.285+0000 7f6b1d600640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6b00068380 0x7f6b0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.285+0000 7f6b1d600640 1 -- 172.21.15.73:0/3705378249 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6b18086eb0 con 0x7f6b201676e0 2024-04-15T15:32:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.285+0000 7f6b25a00640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6b00068380 0x7f6b0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.285+0000 7f6b25a00640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6b00068380 0x7f6b0006a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b140ae000 tx=0x7f6b140a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:53.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.289+0000 7f6b1d600640 1 -- 172.21.15.73:0/3705378249 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b180572d0 con 0x7f6b201676e0 2024-04-15T15:32:53.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.449+0000 7f6b28400640 1 -- 172.21.15.73:0/3705378249 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b2015b2b0 con 0x7f6b201676e0 2024-04-15T15:32:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.449+0000 7f6b1d600640 1 -- 172.21.15.73:0/3705378249 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16918 (secure 0 0 0) 0x7f6b18056bd0 con 0x7f6b201676e0 2024-04-15T15:32:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:53.451 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":39,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:50.731602+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 -- 172.21.15.73:0/3705378249 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6b00068380 msgr2=0x7f6b0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6b00068380 0x7f6b0006a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b140ae000 tx=0x7f6b140a7070 comp rx=0 tx=0).stop 2024-04-15T15:32:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 -- 172.21.15.73:0/3705378249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b201676e0 msgr2=0x7f6b2015a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b201676e0 0x7f6b2015a340 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800e880 tx=0x7f6b1800ed40 comp rx=0 tx=0).stop 2024-04-15T15:32:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 -- 172.21.15.73:0/3705378249 shutdown_connections 2024-04-15T15:32:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b201676e0 0x7f6b2015a340 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b200d0dd0 0x7f6b2015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6b00068380 0x7f6b0006a840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 --2- 172.21.15.73:0/3705378249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b200ce220 0x7f6b2014a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 -- 172.21.15.73:0/3705378249 >> 172.21.15.73:0/3705378249 conn(0x7f6b2009aa60 msgr2=0x7f6b200b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 -- 172.21.15.73:0/3705378249 shutdown_connections 2024-04-15T15:32:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.453+0000 7f6b28400640 1 -- 172.21.15.73:0/3705378249 wait complete. 2024-04-15T15:32:53.473 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-15T15:32:53.473 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:32:53.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc10aa00640 1 Processor -- start 2024-04-15T15:32:53.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc10aa00640 1 -- start start 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc10aa00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc10415b5d0 0x7fc10415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc10aa00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc104070160 con 0x7fc1040b27c0 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc10aa00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10415f1f0 con 0x7fc1040b3e30 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc10aa00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc10415b9b0 con 0x7fc10415b5d0 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc108a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc1040b27c0 0x7fc1040b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58612/0 (socket says 172.21.15.73:58612) 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc103e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc10415b5d0 0x7fc10415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc108a00640 1 -- 172.21.15.73:0/2725012334 learned_addr learned my addr 172.21.15.73:0/2725012334 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc102a00640 1 -- 172.21.15.73:0/2725012334 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3206820964 0 0) 0x7fc104070160 con 0x7fc1040b27c0 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc103e00640 1 -- 172.21.15.73:0/2725012334 >> v1:172.21.15.118:6789/0 conn(0x7fc1040b3e30 legacy=0x7fc1040b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc103e00640 1 -- 172.21.15.73:0/2725012334 >> v1:172.21.15.73:6789/0 conn(0x7fc1040b27c0 legacy=0x7fc1040b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.609+0000 7fc103e00640 1 -- 172.21.15.73:0/2725012334 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10406fe80 con 0x7fc10415b5d0 2024-04-15T15:32:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc103e00640 1 --2- 172.21.15.73:0/2725012334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 0x7fc10415fc90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40097f0 tx=0x7fc0f401c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7839a0f83e3d41f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:53.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc102a00640 1 -- 172.21.15.73:0/2725012334 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40b0070 con 0x7fc10415b5d0 2024-04-15T15:32:53.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc102a00640 1 -- 172.21.15.73:0/2725012334 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f40ab600 con 0x7fc10415b5d0 2024-04-15T15:32:53.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc102a00640 1 -- 172.21.15.73:0/2725012334 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40ab9d0 con 0x7fc10415b5d0 2024-04-15T15:32:53.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc10aa00640 1 -- 172.21.15.73:0/2725012334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 msgr2=0x7fc10415fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc10aa00640 1 --2- 172.21.15.73:0/2725012334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 0x7fc10415fc90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40097f0 tx=0x7fc0f401c320 comp rx=0 tx=0).stop 2024-04-15T15:32:53.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc10aa00640 1 -- 172.21.15.73:0/2725012334 shutdown_connections 2024-04-15T15:32:53.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc10aa00640 1 --2- 172.21.15.73:0/2725012334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 0x7fc10415fc90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc10aa00640 1 -- 172.21.15.73:0/2725012334 >> 172.21.15.73:0/2725012334 conn(0x7fc104067dd0 msgr2=0x7fc1040d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:53.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc10aa00640 1 -- 172.21.15.73:0/2725012334 shutdown_connections 2024-04-15T15:32:53.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc10aa00640 1 -- 172.21.15.73:0/2725012334 wait complete. 2024-04-15T15:32:53.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc10aa00640 1 Processor -- start 2024-04-15T15:32:53.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.613+0000 7fc10aa00640 1 -- start start 2024-04-15T15:32:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc10aa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1040b27c0 0x7fc10414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc10aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1040b3e30 0x7fc104156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc10aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 0x7fc10415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc10aa00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc10406faa0 con 0x7fc10415b5d0 2024-04-15T15:32:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc10aa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc1040b4240 con 0x7fc1040b3e30 2024-04-15T15:32:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc10aa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc10406fc20 con 0x7fc1040b27c0 2024-04-15T15:32:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc108a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 0x7fc10415d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc108a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 0x7fc10415d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42902/0 (socket says 172.21.15.73:42902) 2024-04-15T15:32:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc108a00640 1 -- 172.21.15.73:0/2327609360 learned_addr learned my addr 172.21.15.73:0/2327609360 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc103e00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1040b27c0 0x7fc10414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc103400640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1040b3e30 0x7fc104156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc108a00640 1 -- 172.21.15.73:0/2327609360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1040b27c0 msgr2=0x7fc10414f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc108a00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1040b27c0 0x7fc10414f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc108a00640 1 -- 172.21.15.73:0/2327609360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1040b3e30 msgr2=0x7fc104156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc108a00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1040b3e30 0x7fc104156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc108a00640 1 -- 172.21.15.73:0/2327609360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10415c6f0 con 0x7fc10415b5d0 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc103400640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1040b3e30 0x7fc104156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc108a00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 0x7fc10415d4b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c700 tx=0x7fc0fc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc0fbe00640 1 -- 172.21.15.73:0/2327609360 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc018070 con 0x7fc10415b5d0 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc0fbe00640 1 -- 172.21.15.73:0/2327609360 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0fc00ce10 con 0x7fc10415b5d0 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc10aa00640 1 -- 172.21.15.73:0/2327609360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10415c9d0 con 0x7fc10415b5d0 2024-04-15T15:32:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc0fbe00640 1 -- 172.21.15.73:0/2327609360 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc00a880 con 0x7fc10415b5d0 2024-04-15T15:32:53.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc10aa00640 1 -- 172.21.15.73:0/2327609360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc104150040 con 0x7fc10415b5d0 2024-04-15T15:32:53.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.617+0000 7fc10aa00640 1 -- 172.21.15.73:0/2327609360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc104068ab0 con 0x7fc10415b5d0 2024-04-15T15:32:53.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.621+0000 7fc0fbe00640 1 -- 172.21.15.73:0/2327609360 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0fc01b070 con 0x7fc10415b5d0 2024-04-15T15:32:53.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.621+0000 7fc0fbe00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e4068380 0x7fc0e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.621+0000 7fc0fbe00640 1 -- 172.21.15.73:0/2327609360 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc0fc085f60 con 0x7fc10415b5d0 2024-04-15T15:32:53.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.621+0000 7fc103e00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e4068380 0x7fc0e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.621+0000 7fc103e00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e4068380 0x7fc0e406a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40ad000 tx=0x7fc0f40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:53.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.625+0000 7fc0fbe00640 1 -- 172.21.15.73:0/2327609360 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0fc055dd0 con 0x7fc10415b5d0 2024-04-15T15:32:53.706 INFO:tasks.ceph.mds.d.smithi118.stderr:2024-04-15T15:32:53.704+0000 7ffac5400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-15T15:32:53.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.781+0000 7fc10aa00640 1 -- 172.21.15.73:0/2327609360 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1040b4a80 con 0x7fc0e4068380 2024-04-15T15:32:53.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.785+0000 7fc0fbe00640 1 -- 172.21.15.73:0/2327609360 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251887 (secure 0 0 0) 0x7fc1040b4a80 con 0x7fc0e4068380 2024-04-15T15:32:53.789 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:53.791 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:32:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 -- 172.21.15.73:0/2327609360 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e4068380 msgr2=0x7fc0e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e4068380 0x7fc0e406a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40ad000 tx=0x7fc0f40a6000 comp rx=0 tx=0).stop 2024-04-15T15:32:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 -- 172.21.15.73:0/2327609360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 msgr2=0x7fc10415d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 0x7fc10415d4b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c700 tx=0x7fc0fc00cbc0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 -- 172.21.15.73:0/2327609360 shutdown_connections 2024-04-15T15:32:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc10415b5d0 0x7fc10415d4b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1040b3e30 0x7fc104156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc0e4068380 0x7fc0e406a840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 --2- 172.21.15.73:0/2327609360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1040b27c0 0x7fc10414f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 -- 172.21.15.73:0/2327609360 >> 172.21.15.73:0/2327609360 conn(0x7fc104067dd0 msgr2=0x7fc104153590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 -- 172.21.15.73:0/2327609360 shutdown_connections 2024-04-15T15:32:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.789+0000 7fc10aa00640 1 -- 172.21.15.73:0/2327609360 wait complete. 2024-04-15T15:32:53.813 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-04-15T15:32:53.372489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237424,"kb_used_data":4620,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737296,"statfs":{"total":773094113280,"available":772850991104,"internally_reserved":0,"allocated":4730880,"data_stored":2681119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.658825"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.747908+0000","last_change":"2024-04-15T15:32:49.745412+0000","last_active":"2024-04-15T15:32:49.747908+0000","last_peered":"2024-04-15T15:32:49.747908+0000","last_clean":"2024-04-15T15:32:49.747908+0000","last_became_active":"2024-04-15T15:32:49.742809+0000","last_became_peered":"2024-04-15T15:32:49.742809+0000","last_unstale":"2024-04-15T15:32:49.747908+0000","last_undegraded":"2024-04-15T15:32:49.747908+0000","last_fullsized":"2024-04-15T15:32:49.747908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:41:46.543038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.741909+0000","last_change":"2024-04-15T15:32:49.737205+0000","last_active":"2024-04-15T15:32:49.741909+0000","last_peered":"2024-04-15T15:32:49.741909+0000","last_clean":"2024-04-15T15:32:49.741909+0000","last_became_active":"2024-04-15T15:32:49.736995+0000","last_became_peered":"2024-04-15T15:32:49.736995+0000","last_unstale":"2024-04-15T15:32:49.741909+0000","last_undegraded":"2024-04-15T15:32:49.741909+0000","last_fullsized":"2024-04-15T15:32:49.741909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:59:06.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758162+0000","last_change":"2024-04-15T15:32:49.756109+0000","last_active":"2024-04-15T15:32:49.758162+0000","last_peered":"2024-04-15T15:32:49.758162+0000","last_clean":"2024-04-15T15:32:49.758162+0000","last_became_active":"2024-04-15T15:32:49.755810+0000","last_became_peered":"2024-04-15T15:32:49.755810+0000","last_unstale":"2024-04-15T15:32:49.758162+0000","last_undegraded":"2024-04-15T15:32:49.758162+0000","last_fullsized":"2024-04-15T15:32:49.758162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:05.677330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758650+0000","last_change":"2024-04-15T15:32:49.754128+0000","last_active":"2024-04-15T15:32:49.758650+0000","last_peered":"2024-04-15T15:32:49.758650+0000","last_clean":"2024-04-15T15:32:49.758650+0000","last_became_active":"2024-04-15T15:32:49.753870+0000","last_became_peered":"2024-04-15T15:32:49.753870+0000","last_unstale":"2024-04-15T15:32:49.758650+0000","last_undegraded":"2024-04-15T15:32:49.758650+0000","last_fullsized":"2024-04-15T15:32:49.758650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:26:50.592924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.757384+0000","last_change":"2024-04-15T15:32:49.749776+0000","last_active":"2024-04-15T15:32:49.757384+0000","last_peered":"2024-04-15T15:32:49.757384+0000","last_clean":"2024-04-15T15:32:49.757384+0000","last_became_active":"2024-04-15T15:32:49.749522+0000","last_became_peered":"2024-04-15T15:32:49.749522+0000","last_unstale":"2024-04-15T15:32:49.757384+0000","last_undegraded":"2024-04-15T15:32:49.757384+0000","last_fullsized":"2024-04-15T15:32:49.757384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:49:50.215422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.747690+0000","last_change":"2024-04-15T15:32:49.744856+0000","last_active":"2024-04-15T15:32:49.747690+0000","last_peered":"2024-04-15T15:32:49.747690+0000","last_clean":"2024-04-15T15:32:49.747690+0000","last_became_active":"2024-04-15T15:32:49.744560+0000","last_became_peered":"2024-04-15T15:32:49.744560+0000","last_unstale":"2024-04-15T15:32:49.747690+0000","last_undegraded":"2024-04-15T15:32:49.747690+0000","last_fullsized":"2024-04-15T15:32:49.747690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:16:40.846261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.746025+0000","last_change":"2024-04-15T15:32:49.737242+0000","last_active":"2024-04-15T15:32:49.746025+0000","last_peered":"2024-04-15T15:32:49.746025+0000","last_clean":"2024-04-15T15:32:49.746025+0000","last_became_active":"2024-04-15T15:32:49.736975+0000","last_became_peered":"2024-04-15T15:32:49.736975+0000","last_unstale":"2024-04-15T15:32:49.746025+0000","last_undegraded":"2024-04-15T15:32:49.746025+0000","last_fullsized":"2024-04-15T15:32:49.746025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:47:24.421149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.739142+0000","last_change":"2024-04-15T15:32:49.733346+0000","last_active":"2024-04-15T15:32:49.739142+0000","last_peered":"2024-04-15T15:32:49.739142+0000","last_clean":"2024-04-15T15:32:49.739142+0000","last_became_active":"2024-04-15T15:32:49.733013+0000","last_became_peered":"2024-04-15T15:32:49.733013+0000","last_unstale":"2024-04-15T15:32:49.739142+0000","last_undegraded":"2024-04-15T15:32:49.739142+0000","last_fullsized":"2024-04-15T15:32:49.739142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:54:37.380883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.748725+0000","last_change":"2024-04-15T15:32:49.738011+0000","last_active":"2024-04-15T15:32:49.748725+0000","last_peered":"2024-04-15T15:32:49.748725+0000","last_clean":"2024-04-15T15:32:49.748725+0000","last_became_active":"2024-04-15T15:32:49.737740+0000","last_became_peered":"2024-04-15T15:32:49.737740+0000","last_unstale":"2024-04-15T15:32:49.748725+0000","last_undegraded":"2024-04-15T15:32:49.748725+0000","last_fullsized":"2024-04-15T15:32:49.748725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:29:47.031910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.759248+0000","last_change":"2024-04-15T15:32:49.742136+0000","last_active":"2024-04-15T15:32:49.759248+0000","last_peered":"2024-04-15T15:32:49.759248+0000","last_clean":"2024-04-15T15:32:49.759248+0000","last_became_active":"2024-04-15T15:32:49.741810+0000","last_became_peered":"2024-04-15T15:32:49.741810+0000","last_unstale":"2024-04-15T15:32:49.759248+0000","last_undegraded":"2024-04-15T15:32:49.759248+0000","last_fullsized":"2024-04-15T15:32:49.759248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:18:06.850353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761426+0000","last_change":"2024-04-15T15:32:49.752830+0000","last_active":"2024-04-15T15:32:49.761426+0000","last_peered":"2024-04-15T15:32:49.761426+0000","last_clean":"2024-04-15T15:32:49.761426+0000","last_became_active":"2024-04-15T15:32:49.752524+0000","last_became_peered":"2024-04-15T15:32:49.752524+0000","last_unstale":"2024-04-15T15:32:49.761426+0000","last_undegraded":"2024-04-15T15:32:49.761426+0000","last_fullsized":"2024-04-15T15:32:49.761426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:51.200164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.745242+0000","last_change":"2024-04-15T15:32:49.741006+0000","last_active":"2024-04-15T15:32:49.745242+0000","last_peered":"2024-04-15T15:32:49.745242+0000","last_clean":"2024-04-15T15:32:49.745242+0000","last_became_active":"2024-04-15T15:32:49.740783+0000","last_became_peered":"2024-04-15T15:32:49.740783+0000","last_unstale":"2024-04-15T15:32:49.745242+0000","last_undegraded":"2024-04-15T15:32:49.745242+0000","last_fullsized":"2024-04-15T15:32:49.745242+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:55.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761425+0000","last_change":"2024-04-15T15:32:49.751807+0000","last_active":"2024-04-15T15:32:49.761425+0000","last_peered":"2024-04-15T15:32:49.761425+0000","last_clean":"2024-04-15T15:32:49.761425+0000","last_became_active":"2024-04-15T15:32:49.751535+0000","last_became_peered":"2024-04-15T15:32:49.751535+0000","last_unstale":"2024-04-15T15:32:49.761425+0000","last_undegraded":"2024-04-15T15:32:49.761425+0000","last_fullsized":"2024-04-15T15:32:49.761425+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:41:46.543038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.749047+0000","last_change":"2024-04-15T15:32:49.744743+0000","last_active":"2024-04-15T15:32:49.749047+0000","last_peered":"2024-04-15T15:32:49.749047+0000","last_clean":"2024-04-15T15:32:49.749047+0000","last_became_active":"2024-04-15T15:32:49.744433+0000","last_became_peered":"2024-04-15T15:32:49.744433+0000","last_unstale":"2024-04-15T15:32:49.749047+0000","last_undegraded":"2024-04-15T15:32:49.749047+0000","last_fullsized":"2024-04-15T15:32:49.749047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:55.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761011+0000","last_change":"2024-04-15T15:32:49.745690+0000","last_active":"2024-04-15T15:32:49.761011+0000","last_peered":"2024-04-15T15:32:49.761011+0000","last_clean":"2024-04-15T15:32:49.761011+0000","last_became_active":"2024-04-15T15:32:49.745391+0000","last_became_peered":"2024-04-15T15:32:49.745391+0000","last_unstale":"2024-04-15T15:32:49.761011+0000","last_undegraded":"2024-04-15T15:32:49.761011+0000","last_fullsized":"2024-04-15T15:32:49.761011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:56:56.655030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754621+0000","last_change":"2024-04-15T15:32:49.749409+0000","last_active":"2024-04-15T15:32:49.754621+0000","last_peered":"2024-04-15T15:32:49.754621+0000","last_clean":"2024-04-15T15:32:49.754621+0000","last_became_active":"2024-04-15T15:32:49.749144+0000","last_became_peered":"2024-04-15T15:32:49.749144+0000","last_unstale":"2024-04-15T15:32:49.754621+0000","last_undegraded":"2024-04-15T15:32:49.754621+0000","last_fullsized":"2024-04-15T15:32:49.754621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:59:06.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.753855+0000","last_change":"2024-04-15T15:32:49.747682+0000","last_active":"2024-04-15T15:32:49.753855+0000","last_peered":"2024-04-15T15:32:49.753855+0000","last_clean":"2024-04-15T15:32:49.753855+0000","last_became_active":"2024-04-15T15:32:49.747407+0000","last_became_peered":"2024-04-15T15:32:49.747407+0000","last_unstale":"2024-04-15T15:32:49.753855+0000","last_undegraded":"2024-04-15T15:32:49.753855+0000","last_fullsized":"2024-04-15T15:32:49.753855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:05.677330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.756554+0000","last_change":"2024-04-15T15:32:49.752644+0000","last_active":"2024-04-15T15:32:49.756554+0000","last_peered":"2024-04-15T15:32:49.756554+0000","last_clean":"2024-04-15T15:32:49.756554+0000","last_became_active":"2024-04-15T15:32:49.752378+0000","last_became_peered":"2024-04-15T15:32:49.752378+0000","last_unstale":"2024-04-15T15:32:49.756554+0000","last_undegraded":"2024-04-15T15:32:49.756554+0000","last_fullsized":"2024-04-15T15:32:49.756554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:29:47.031910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.757407+0000","last_change":"2024-04-15T15:32:49.749456+0000","last_active":"2024-04-15T15:32:49.757407+0000","last_peered":"2024-04-15T15:32:49.757407+0000","last_clean":"2024-04-15T15:32:49.757407+0000","last_became_active":"2024-04-15T15:32:49.749113+0000","last_became_peered":"2024-04-15T15:32:49.749113+0000","last_unstale":"2024-04-15T15:32:49.757407+0000","last_undegraded":"2024-04-15T15:32:49.757407+0000","last_fullsized":"2024-04-15T15:32:49.757407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:55:34.910231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758617+0000","last_change":"2024-04-15T15:32:49.757153+0000","last_active":"2024-04-15T15:32:49.758617+0000","last_peered":"2024-04-15T15:32:49.758617+0000","last_clean":"2024-04-15T15:32:49.758617+0000","last_became_active":"2024-04-15T15:32:49.756930+0000","last_became_peered":"2024-04-15T15:32:49.756930+0000","last_unstale":"2024-04-15T15:32:49.758617+0000","last_undegraded":"2024-04-15T15:32:49.758617+0000","last_fullsized":"2024-04-15T15:32:49.758617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:55.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761834+0000","last_change":"2024-04-15T15:32:49.754949+0000","last_active":"2024-04-15T15:32:49.761834+0000","last_peered":"2024-04-15T15:32:49.761834+0000","last_clean":"2024-04-15T15:32:49.761834+0000","last_became_active":"2024-04-15T15:32:49.754731+0000","last_became_peered":"2024-04-15T15:32:49.754731+0000","last_unstale":"2024-04-15T15:32:49.761834+0000","last_undegraded":"2024-04-15T15:32:49.761834+0000","last_fullsized":"2024-04-15T15:32:49.761834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:36:16.378875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.749719+0000","last_change":"2024-04-15T15:32:49.745651+0000","last_active":"2024-04-15T15:32:49.749719+0000","last_peered":"2024-04-15T15:32:49.749719+0000","last_clean":"2024-04-15T15:32:49.749719+0000","last_became_active":"2024-04-15T15:32:49.745373+0000","last_became_peered":"2024-04-15T15:32:49.745373+0000","last_unstale":"2024-04-15T15:32:49.749719+0000","last_undegraded":"2024-04-15T15:32:49.749719+0000","last_fullsized":"2024-04-15T15:32:49.749719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:56:42.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755751+0000","last_change":"2024-04-15T15:32:49.747377+0000","last_active":"2024-04-15T15:32:49.755751+0000","last_peered":"2024-04-15T15:32:49.755751+0000","last_clean":"2024-04-15T15:32:49.755751+0000","last_became_active":"2024-04-15T15:32:49.746858+0000","last_became_peered":"2024-04-15T15:32:49.746858+0000","last_unstale":"2024-04-15T15:32:49.755751+0000","last_undegraded":"2024-04-15T15:32:49.755751+0000","last_fullsized":"2024-04-15T15:32:49.755751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:56:42.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758370+0000","last_change":"2024-04-15T15:32:49.750912+0000","last_active":"2024-04-15T15:32:49.758370+0000","last_peered":"2024-04-15T15:32:49.758370+0000","last_clean":"2024-04-15T15:32:49.758370+0000","last_became_active":"2024-04-15T15:32:49.750511+0000","last_became_peered":"2024-04-15T15:32:49.750511+0000","last_unstale":"2024-04-15T15:32:49.758370+0000","last_undegraded":"2024-04-15T15:32:49.758370+0000","last_fullsized":"2024-04-15T15:32:49.758370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:06:33.425710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.752078+0000","last_change":"2024-04-15T15:32:49.749145+0000","last_active":"2024-04-15T15:32:49.752078+0000","last_peered":"2024-04-15T15:32:49.752078+0000","last_clean":"2024-04-15T15:32:49.752078+0000","last_became_active":"2024-04-15T15:32:49.748851+0000","last_became_peered":"2024-04-15T15:32:49.748851+0000","last_unstale":"2024-04-15T15:32:49.752078+0000","last_undegraded":"2024-04-15T15:32:49.752078+0000","last_fullsized":"2024-04-15T15:32:49.752078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:24.581061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758343+0000","last_change":"2024-04-15T15:32:49.756140+0000","last_active":"2024-04-15T15:32:49.758343+0000","last_peered":"2024-04-15T15:32:49.758343+0000","last_clean":"2024-04-15T15:32:49.758343+0000","last_became_active":"2024-04-15T15:32:49.755885+0000","last_became_peered":"2024-04-15T15:32:49.755885+0000","last_unstale":"2024-04-15T15:32:49.758343+0000","last_undegraded":"2024-04-15T15:32:49.758343+0000","last_fullsized":"2024-04-15T15:32:49.758343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:56:42.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.757786+0000","last_change":"2024-04-15T15:32:49.750125+0000","last_active":"2024-04-15T15:32:49.757786+0000","last_peered":"2024-04-15T15:32:49.757786+0000","last_clean":"2024-04-15T15:32:49.757786+0000","last_became_active":"2024-04-15T15:32:49.749842+0000","last_became_peered":"2024-04-15T15:32:49.749842+0000","last_unstale":"2024-04-15T15:32:49.757786+0000","last_undegraded":"2024-04-15T15:32:49.757786+0000","last_fullsized":"2024-04-15T15:32:49.757786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:41.943999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.749177+0000","last_change":"2024-04-15T15:32:49.738967+0000","last_active":"2024-04-15T15:32:49.749177+0000","last_peered":"2024-04-15T15:32:49.749177+0000","last_clean":"2024-04-15T15:32:49.749177+0000","last_became_active":"2024-04-15T15:32:49.736938+0000","last_became_peered":"2024-04-15T15:32:49.736938+0000","last_unstale":"2024-04-15T15:32:49.749177+0000","last_undegraded":"2024-04-15T15:32:49.749177+0000","last_fullsized":"2024-04-15T15:32:49.749177+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:54:37.380883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755237+0000","last_change":"2024-04-15T15:32:49.746848+0000","last_active":"2024-04-15T15:32:49.755237+0000","last_peered":"2024-04-15T15:32:49.755237+0000","last_clean":"2024-04-15T15:32:49.755237+0000","last_became_active":"2024-04-15T15:32:49.746569+0000","last_became_peered":"2024-04-15T15:32:49.746569+0000","last_unstale":"2024-04-15T15:32:49.755237+0000","last_undegraded":"2024-04-15T15:32:49.755237+0000","last_fullsized":"2024-04-15T15:32:49.755237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:19.235494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.756018+0000","last_change":"2024-04-15T15:32:49.752018+0000","last_active":"2024-04-15T15:32:49.756018+0000","last_peered":"2024-04-15T15:32:49.756018+0000","last_clean":"2024-04-15T15:32:49.756018+0000","last_became_active":"2024-04-15T15:32:49.751833+0000","last_became_peered":"2024-04-15T15:32:49.751833+0000","last_unstale":"2024-04-15T15:32:49.756018+0000","last_undegraded":"2024-04-15T15:32:49.756018+0000","last_fullsized":"2024-04-15T15:32:49.756018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:16:40.846261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755771+0000","last_change":"2024-04-15T15:32:49.749799+0000","last_active":"2024-04-15T15:32:49.755771+0000","last_peered":"2024-04-15T15:32:49.755771+0000","last_clean":"2024-04-15T15:32:49.755771+0000","last_became_active":"2024-04-15T15:32:49.747125+0000","last_became_peered":"2024-04-15T15:32:49.747125+0000","last_unstale":"2024-04-15T15:32:49.755771+0000","last_undegraded":"2024-04-15T15:32:49.755771+0000","last_fullsized":"2024-04-15T15:32:49.755771+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:47:24.421149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755142+0000","last_change":"2024-04-15T15:32:49.750005+0000","last_active":"2024-04-15T15:32:49.755142+0000","last_peered":"2024-04-15T15:32:49.755142+0000","last_clean":"2024-04-15T15:32:49.755142+0000","last_became_active":"2024-04-15T15:32:49.748946+0000","last_became_peered":"2024-04-15T15:32:49.748946+0000","last_unstale":"2024-04-15T15:32:49.755142+0000","last_undegraded":"2024-04-15T15:32:49.755142+0000","last_fullsized":"2024-04-15T15:32:49.755142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:55.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755071+0000","last_change":"2024-04-15T15:32:49.749853+0000","last_active":"2024-04-15T15:32:49.755071+0000","last_peered":"2024-04-15T15:32:49.755071+0000","last_clean":"2024-04-15T15:32:49.755071+0000","last_became_active":"2024-04-15T15:32:49.747924+0000","last_became_peered":"2024-04-15T15:32:49.747924+0000","last_unstale":"2024-04-15T15:32:49.755071+0000","last_undegraded":"2024-04-15T15:32:49.755071+0000","last_fullsized":"2024-04-15T15:32:49.755071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:54:37.380883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771966+0000","last_change":"2024-04-15T15:32:48.743575+0000","last_active":"2024-04-15T15:32:49.771966+0000","last_peered":"2024-04-15T15:32:49.771966+0000","last_clean":"2024-04-15T15:32:49.771966+0000","last_became_active":"2024-04-15T15:32:48.741400+0000","last_became_peered":"2024-04-15T15:32:48.741400+0000","last_unstale":"2024-04-15T15:32:49.771966+0000","last_undegraded":"2024-04-15T15:32:49.771966+0000","last_fullsized":"2024-04-15T15:32:49.771966+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:58:02.671290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758341+0000","last_change":"2024-04-15T15:32:49.757393+0000","last_active":"2024-04-15T15:32:49.758341+0000","last_peered":"2024-04-15T15:32:49.758341+0000","last_clean":"2024-04-15T15:32:49.758341+0000","last_became_active":"2024-04-15T15:32:49.757064+0000","last_became_peered":"2024-04-15T15:32:49.757064+0000","last_unstale":"2024-04-15T15:32:49.758341+0000","last_undegraded":"2024-04-15T15:32:49.758341+0000","last_fullsized":"2024-04-15T15:32:49.758341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:05.677330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.766095+0000","last_change":"2024-04-15T15:32:48.739565+0000","last_active":"2024-04-15T15:32:49.766095+0000","last_peered":"2024-04-15T15:32:49.766095+0000","last_clean":"2024-04-15T15:32:49.766095+0000","last_became_active":"2024-04-15T15:32:48.739243+0000","last_became_peered":"2024-04-15T15:32:48.739243+0000","last_unstale":"2024-04-15T15:32:49.766095+0000","last_undegraded":"2024-04-15T15:32:49.766095+0000","last_fullsized":"2024-04-15T15:32:49.766095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:40.937337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.749195+0000","last_change":"2024-04-15T15:32:49.745326+0000","last_active":"2024-04-15T15:32:49.749195+0000","last_peered":"2024-04-15T15:32:49.749195+0000","last_clean":"2024-04-15T15:32:49.749195+0000","last_became_active":"2024-04-15T15:32:49.745043+0000","last_became_peered":"2024-04-15T15:32:49.745043+0000","last_unstale":"2024-04-15T15:32:49.749195+0000","last_undegraded":"2024-04-15T15:32:49.749195+0000","last_fullsized":"2024-04-15T15:32:49.749195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:23.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.769327+0000","last_change":"2024-04-15T15:32:48.745776+0000","last_active":"2024-04-15T15:32:49.769327+0000","last_peered":"2024-04-15T15:32:49.769327+0000","last_clean":"2024-04-15T15:32:49.769327+0000","last_became_active":"2024-04-15T15:32:48.745340+0000","last_became_peered":"2024-04-15T15:32:48.745340+0000","last_unstale":"2024-04-15T15:32:49.769327+0000","last_undegraded":"2024-04-15T15:32:49.769327+0000","last_fullsized":"2024-04-15T15:32:49.769327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:40.937337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.751030+0000","last_change":"2024-04-15T15:32:49.747358+0000","last_active":"2024-04-15T15:32:49.751030+0000","last_peered":"2024-04-15T15:32:49.751030+0000","last_clean":"2024-04-15T15:32:49.751030+0000","last_became_active":"2024-04-15T15:32:49.747091+0000","last_became_peered":"2024-04-15T15:32:49.747091+0000","last_unstale":"2024-04-15T15:32:49.751030+0000","last_undegraded":"2024-04-15T15:32:49.751030+0000","last_fullsized":"2024-04-15T15:32:49.751030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:51.200164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771344+0000","last_change":"2024-04-15T15:32:48.749468+0000","last_active":"2024-04-15T15:32:49.771344+0000","last_peered":"2024-04-15T15:32:49.771344+0000","last_clean":"2024-04-15T15:32:49.771344+0000","last_became_active":"2024-04-15T15:32:48.749153+0000","last_became_peered":"2024-04-15T15:32:48.749153+0000","last_unstale":"2024-04-15T15:32:49.771344+0000","last_undegraded":"2024-04-15T15:32:49.771344+0000","last_fullsized":"2024-04-15T15:32:49.771344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:29:46.025248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.747385+0000","last_change":"2024-04-15T15:32:49.742855+0000","last_active":"2024-04-15T15:32:49.747385+0000","last_peered":"2024-04-15T15:32:49.747385+0000","last_clean":"2024-04-15T15:32:49.747385+0000","last_became_active":"2024-04-15T15:32:49.742560+0000","last_became_peered":"2024-04-15T15:32:49.742560+0000","last_unstale":"2024-04-15T15:32:49.747385+0000","last_undegraded":"2024-04-15T15:32:49.747385+0000","last_fullsized":"2024-04-15T15:32:49.747385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:23.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771259+0000","last_change":"2024-04-15T15:32:48.734359+0000","last_active":"2024-04-15T15:32:49.771259+0000","last_peered":"2024-04-15T15:32:49.771259+0000","last_clean":"2024-04-15T15:32:49.771259+0000","last_became_active":"2024-04-15T15:32:48.734044+0000","last_became_peered":"2024-04-15T15:32:48.734044+0000","last_unstale":"2024-04-15T15:32:49.771259+0000","last_undegraded":"2024-04-15T15:32:49.771259+0000","last_fullsized":"2024-04-15T15:32:49.771259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:54.639667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.753995+0000","last_change":"2024-04-15T15:32:49.739768+0000","last_active":"2024-04-15T15:32:49.753995+0000","last_peered":"2024-04-15T15:32:49.753995+0000","last_clean":"2024-04-15T15:32:49.753995+0000","last_became_active":"2024-04-15T15:32:49.739491+0000","last_became_peered":"2024-04-15T15:32:49.739491+0000","last_unstale":"2024-04-15T15:32:49.753995+0000","last_undegraded":"2024-04-15T15:32:49.753995+0000","last_fullsized":"2024-04-15T15:32:49.753995+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:26:27.851809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.763672+0000","last_change":"2024-04-15T15:32:48.742058+0000","last_active":"2024-04-15T15:32:49.763672+0000","last_peered":"2024-04-15T15:32:49.763672+0000","last_clean":"2024-04-15T15:32:49.763672+0000","last_became_active":"2024-04-15T15:32:48.741674+0000","last_became_peered":"2024-04-15T15:32:48.741674+0000","last_unstale":"2024-04-15T15:32:49.763672+0000","last_undegraded":"2024-04-15T15:32:49.763672+0000","last_fullsized":"2024-04-15T15:32:49.763672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.574398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.742900+0000","last_change":"2024-04-15T15:32:49.735996+0000","last_active":"2024-04-15T15:32:49.742900+0000","last_peered":"2024-04-15T15:32:49.742900+0000","last_clean":"2024-04-15T15:32:49.742900+0000","last_became_active":"2024-04-15T15:32:49.735432+0000","last_became_peered":"2024-04-15T15:32:49.735432+0000","last_unstale":"2024-04-15T15:32:49.742900+0000","last_undegraded":"2024-04-15T15:32:49.742900+0000","last_fullsized":"2024-04-15T15:32:49.742900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:19.235494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.737334+0000","last_change":"2024-04-15T15:32:48.746610+0000","last_active":"2024-04-15T15:32:49.737334+0000","last_peered":"2024-04-15T15:32:49.737334+0000","last_clean":"2024-04-15T15:32:49.737334+0000","last_became_active":"2024-04-15T15:32:48.746347+0000","last_became_peered":"2024-04-15T15:32:48.746347+0000","last_unstale":"2024-04-15T15:32:49.737334+0000","last_undegraded":"2024-04-15T15:32:49.737334+0000","last_fullsized":"2024-04-15T15:32:49.737334+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:18.228832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754460+0000","last_change":"2024-04-15T15:32:49.752678+0000","last_active":"2024-04-15T15:32:49.754460+0000","last_peered":"2024-04-15T15:32:49.754460+0000","last_clean":"2024-04-15T15:32:49.754460+0000","last_became_active":"2024-04-15T15:32:49.751993+0000","last_became_peered":"2024-04-15T15:32:49.751993+0000","last_unstale":"2024-04-15T15:32:49.754460+0000","last_undegraded":"2024-04-15T15:32:49.754460+0000","last_fullsized":"2024-04-15T15:32:49.754460+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:36:16.378875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.731329+0000","last_change":"2024-04-15T15:32:48.739465+0000","last_active":"2024-04-15T15:32:49.731329+0000","last_peered":"2024-04-15T15:32:49.731329+0000","last_clean":"2024-04-15T15:32:49.731329+0000","last_became_active":"2024-04-15T15:32:48.739148+0000","last_became_peered":"2024-04-15T15:32:48.739148+0000","last_unstale":"2024-04-15T15:32:49.731329+0000","last_undegraded":"2024-04-15T15:32:49.731329+0000","last_fullsized":"2024-04-15T15:32:49.731329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:02.383398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758326+0000","last_change":"2024-04-15T15:32:49.750695+0000","last_active":"2024-04-15T15:32:49.758326+0000","last_peered":"2024-04-15T15:32:49.758326+0000","last_clean":"2024-04-15T15:32:49.758326+0000","last_became_active":"2024-04-15T15:32:49.749350+0000","last_became_peered":"2024-04-15T15:32:49.749350+0000","last_unstale":"2024-04-15T15:32:49.758326+0000","last_undegraded":"2024-04-15T15:32:49.758326+0000","last_fullsized":"2024-04-15T15:32:49.758326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:35:12.830046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.733640+0000","last_change":"2024-04-15T15:32:48.753473+0000","last_active":"2024-04-15T15:32:49.733640+0000","last_peered":"2024-04-15T15:32:49.733640+0000","last_clean":"2024-04-15T15:32:49.733640+0000","last_became_active":"2024-04-15T15:32:48.753231+0000","last_became_peered":"2024-04-15T15:32:48.753231+0000","last_unstale":"2024-04-15T15:32:49.733640+0000","last_undegraded":"2024-04-15T15:32:49.733640+0000","last_fullsized":"2024-04-15T15:32:49.733640+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:26:26.845147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754635+0000","last_change":"2024-04-15T15:32:49.749879+0000","last_active":"2024-04-15T15:32:49.754635+0000","last_peered":"2024-04-15T15:32:49.754635+0000","last_clean":"2024-04-15T15:32:49.754635+0000","last_became_active":"2024-04-15T15:32:49.749641+0000","last_became_peered":"2024-04-15T15:32:49.749641+0000","last_unstale":"2024-04-15T15:32:49.754635+0000","last_undegraded":"2024-04-15T15:32:49.754635+0000","last_fullsized":"2024-04-15T15:32:49.754635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:26:27.851809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.726363+0000","last_change":"2024-04-15T15:32:48.749804+0000","last_active":"2024-04-15T15:32:49.726363+0000","last_peered":"2024-04-15T15:32:49.726363+0000","last_clean":"2024-04-15T15:32:49.726363+0000","last_became_active":"2024-04-15T15:32:48.749494+0000","last_became_peered":"2024-04-15T15:32:48.749494+0000","last_unstale":"2024-04-15T15:32:49.726363+0000","last_undegraded":"2024-04-15T15:32:49.726363+0000","last_fullsized":"2024-04-15T15:32:49.726363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:32:59.564976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761328+0000","last_change":"2024-04-15T15:32:49.759926+0000","last_active":"2024-04-15T15:32:49.761328+0000","last_peered":"2024-04-15T15:32:49.761328+0000","last_clean":"2024-04-15T15:32:49.761328+0000","last_became_active":"2024-04-15T15:32:49.759651+0000","last_became_peered":"2024-04-15T15:32:49.759651+0000","last_unstale":"2024-04-15T15:32:49.761328+0000","last_undegraded":"2024-04-15T15:32:49.761328+0000","last_fullsized":"2024-04-15T15:32:49.761328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:33:00.571639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771161+0000","last_change":"2024-04-15T15:32:48.744992+0000","last_active":"2024-04-15T15:32:49.771161+0000","last_peered":"2024-04-15T15:32:49.771161+0000","last_clean":"2024-04-15T15:32:49.771161+0000","last_became_active":"2024-04-15T15:32:48.744672+0000","last_became_peered":"2024-04-15T15:32:48.744672+0000","last_unstale":"2024-04-15T15:32:49.771161+0000","last_undegraded":"2024-04-15T15:32:49.771161+0000","last_fullsized":"2024-04-15T15:32:49.771161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:22.801586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754245+0000","last_change":"2024-04-15T15:32:49.750852+0000","last_active":"2024-04-15T15:32:49.754245+0000","last_peered":"2024-04-15T15:32:49.754245+0000","last_clean":"2024-04-15T15:32:49.754245+0000","last_became_active":"2024-04-15T15:32:49.750597+0000","last_became_peered":"2024-04-15T15:32:49.750597+0000","last_unstale":"2024-04-15T15:32:49.754245+0000","last_undegraded":"2024-04-15T15:32:49.754245+0000","last_fullsized":"2024-04-15T15:32:49.754245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:05.677330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.775286+0000","last_change":"2024-04-15T15:32:48.751602+0000","last_active":"2024-04-15T15:32:49.775286+0000","last_peered":"2024-04-15T15:32:49.775286+0000","last_clean":"2024-04-15T15:32:49.775286+0000","last_became_active":"2024-04-15T15:32:48.751318+0000","last_became_peered":"2024-04-15T15:32:48.751318+0000","last_unstale":"2024-04-15T15:32:49.775286+0000","last_undegraded":"2024-04-15T15:32:49.775286+0000","last_fullsized":"2024-04-15T15:32:49.775286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:04.670668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.752504+0000","last_change":"2024-04-15T15:32:49.747351+0000","last_active":"2024-04-15T15:32:49.752504+0000","last_peered":"2024-04-15T15:32:49.752504+0000","last_clean":"2024-04-15T15:32:49.752504+0000","last_became_active":"2024-04-15T15:32:49.747083+0000","last_became_peered":"2024-04-15T15:32:49.747083+0000","last_unstale":"2024-04-15T15:32:49.752504+0000","last_undegraded":"2024-04-15T15:32:49.752504+0000","last_fullsized":"2024-04-15T15:32:49.752504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:56:42.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.765230+0000","last_change":"2024-04-15T15:32:48.752305+0000","last_active":"2024-04-15T15:32:49.765230+0000","last_peered":"2024-04-15T15:32:49.765230+0000","last_clean":"2024-04-15T15:32:49.765230+0000","last_became_active":"2024-04-15T15:32:48.752034+0000","last_became_peered":"2024-04-15T15:32:48.752034+0000","last_unstale":"2024-04-15T15:32:49.765230+0000","last_undegraded":"2024-04-15T15:32:49.765230+0000","last_fullsized":"2024-04-15T15:32:49.765230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:47:23.414487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.746656+0000","last_change":"2024-04-15T15:32:49.740285+0000","last_active":"2024-04-15T15:32:49.746656+0000","last_peered":"2024-04-15T15:32:49.746656+0000","last_clean":"2024-04-15T15:32:49.746656+0000","last_became_active":"2024-04-15T15:32:49.740003+0000","last_became_peered":"2024-04-15T15:32:49.740003+0000","last_unstale":"2024-04-15T15:32:49.746656+0000","last_undegraded":"2024-04-15T15:32:49.746656+0000","last_fullsized":"2024-04-15T15:32:49.746656+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:18:06.850353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.737094+0000","last_change":"2024-04-15T15:32:48.747245+0000","last_active":"2024-04-15T15:32:49.737094+0000","last_peered":"2024-04-15T15:32:49.737094+0000","last_clean":"2024-04-15T15:32:49.737094+0000","last_became_active":"2024-04-15T15:32:48.746952+0000","last_became_peered":"2024-04-15T15:32:48.746952+0000","last_unstale":"2024-04-15T15:32:49.737094+0000","last_undegraded":"2024-04-15T15:32:49.737094+0000","last_fullsized":"2024-04-15T15:32:49.737094+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:02.383398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755350+0000","last_change":"2024-04-15T15:32:49.737161+0000","last_active":"2024-04-15T15:32:49.755350+0000","last_peered":"2024-04-15T15:32:49.755350+0000","last_clean":"2024-04-15T15:32:49.755350+0000","last_became_active":"2024-04-15T15:32:49.736885+0000","last_became_peered":"2024-04-15T15:32:49.736885+0000","last_unstale":"2024-04-15T15:32:49.755350+0000","last_undegraded":"2024-04-15T15:32:49.755350+0000","last_fullsized":"2024-04-15T15:32:49.755350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:55.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.733888+0000","last_change":"2024-04-15T15:32:48.740735+0000","last_active":"2024-04-15T15:32:49.733888+0000","last_peered":"2024-04-15T15:32:49.733888+0000","last_clean":"2024-04-15T15:32:49.733888+0000","last_became_active":"2024-04-15T15:32:48.740512+0000","last_became_peered":"2024-04-15T15:32:48.740512+0000","last_unstale":"2024-04-15T15:32:49.733888+0000","last_undegraded":"2024-04-15T15:32:49.733888+0000","last_fullsized":"2024-04-15T15:32:49.733888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:53.405485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.747826+0000","last_change":"2024-04-15T15:32:49.743344+0000","last_active":"2024-04-15T15:32:49.747826+0000","last_peered":"2024-04-15T15:32:49.747826+0000","last_clean":"2024-04-15T15:32:49.747826+0000","last_became_active":"2024-04-15T15:32:49.742921+0000","last_became_peered":"2024-04-15T15:32:49.742921+0000","last_unstale":"2024-04-15T15:32:49.747826+0000","last_undegraded":"2024-04-15T15:32:49.747826+0000","last_fullsized":"2024-04-15T15:32:49.747826+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:56:56.655030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.766883+0000","last_change":"2024-04-15T15:32:48.747162+0000","last_active":"2024-04-15T15:32:49.766883+0000","last_peered":"2024-04-15T15:32:49.766883+0000","last_clean":"2024-04-15T15:32:49.766883+0000","last_became_active":"2024-04-15T15:32:48.746877+0000","last_became_peered":"2024-04-15T15:32:48.746877+0000","last_unstale":"2024-04-15T15:32:49.766883+0000","last_undegraded":"2024-04-15T15:32:49.766883+0000","last_fullsized":"2024-04-15T15:32:49.766883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:16:39.839599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.752505+0000","last_change":"2024-04-15T15:32:49.748081+0000","last_active":"2024-04-15T15:32:49.752505+0000","last_peered":"2024-04-15T15:32:49.752505+0000","last_clean":"2024-04-15T15:32:49.752505+0000","last_became_active":"2024-04-15T15:32:49.747915+0000","last_became_peered":"2024-04-15T15:32:49.747915+0000","last_unstale":"2024-04-15T15:32:49.752505+0000","last_undegraded":"2024-04-15T15:32:49.752505+0000","last_fullsized":"2024-04-15T15:32:49.752505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:03:48.949919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771492+0000","last_change":"2024-04-15T15:32:48.739587+0000","last_active":"2024-04-15T15:32:49.771492+0000","last_peered":"2024-04-15T15:32:49.771492+0000","last_clean":"2024-04-15T15:32:49.771492+0000","last_became_active":"2024-04-15T15:32:48.739302+0000","last_became_peered":"2024-04-15T15:32:48.739302+0000","last_unstale":"2024-04-15T15:32:49.771492+0000","last_undegraded":"2024-04-15T15:32:49.771492+0000","last_fullsized":"2024-04-15T15:32:49.771492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:56:41.169728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761303+0000","last_change":"2024-04-15T15:32:49.749733+0000","last_active":"2024-04-15T15:32:49.761303+0000","last_peered":"2024-04-15T15:32:49.761303+0000","last_clean":"2024-04-15T15:32:49.761303+0000","last_became_active":"2024-04-15T15:32:49.749444+0000","last_became_peered":"2024-04-15T15:32:49.749444+0000","last_unstale":"2024-04-15T15:32:49.761303+0000","last_undegraded":"2024-04-15T15:32:49.761303+0000","last_fullsized":"2024-04-15T15:32:49.761303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:01:47.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771936+0000","last_change":"2024-04-15T15:32:48.744465+0000","last_active":"2024-04-15T15:32:49.771936+0000","last_peered":"2024-04-15T15:32:49.771936+0000","last_clean":"2024-04-15T15:32:49.771936+0000","last_became_active":"2024-04-15T15:32:48.743671+0000","last_became_peered":"2024-04-15T15:32:48.743671+0000","last_unstale":"2024-04-15T15:32:49.771936+0000","last_undegraded":"2024-04-15T15:32:49.771936+0000","last_fullsized":"2024-04-15T15:32:49.771936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.574398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.743859+0000","last_change":"2024-04-15T15:32:49.742424+0000","last_active":"2024-04-15T15:32:49.743859+0000","last_peered":"2024-04-15T15:32:49.743859+0000","last_clean":"2024-04-15T15:32:49.743859+0000","last_became_active":"2024-04-15T15:32:49.742155+0000","last_became_peered":"2024-04-15T15:32:49.742155+0000","last_unstale":"2024-04-15T15:32:49.743859+0000","last_undegraded":"2024-04-15T15:32:49.743859+0000","last_fullsized":"2024-04-15T15:32:49.743859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:16:40.846261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.767488+0000","last_change":"2024-04-15T15:32:48.740895+0000","last_active":"2024-04-15T15:32:49.767488+0000","last_peered":"2024-04-15T15:32:49.767488+0000","last_clean":"2024-04-15T15:32:49.767488+0000","last_became_active":"2024-04-15T15:32:48.740520+0000","last_became_peered":"2024-04-15T15:32:48.740520+0000","last_unstale":"2024-04-15T15:32:49.767488+0000","last_undegraded":"2024-04-15T15:32:49.767488+0000","last_fullsized":"2024-04-15T15:32:49.767488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:27:42.252059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.744884+0000","last_change":"2024-04-15T15:32:49.739989+0000","last_active":"2024-04-15T15:32:49.744884+0000","last_peered":"2024-04-15T15:32:49.744884+0000","last_clean":"2024-04-15T15:32:49.744884+0000","last_became_active":"2024-04-15T15:32:49.739760+0000","last_became_peered":"2024-04-15T15:32:49.739760+0000","last_unstale":"2024-04-15T15:32:49.744884+0000","last_undegraded":"2024-04-15T15:32:49.744884+0000","last_fullsized":"2024-04-15T15:32:49.744884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:27:18.549424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.737471+0000","last_change":"2024-04-15T15:32:48.747992+0000","last_active":"2024-04-15T15:32:49.737471+0000","last_peered":"2024-04-15T15:32:49.737471+0000","last_clean":"2024-04-15T15:32:49.737471+0000","last_became_active":"2024-04-15T15:32:48.747762+0000","last_became_peered":"2024-04-15T15:32:48.747762+0000","last_unstale":"2024-04-15T15:32:49.737471+0000","last_undegraded":"2024-04-15T15:32:49.737471+0000","last_fullsized":"2024-04-15T15:32:49.737471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.574398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754601+0000","last_change":"2024-04-15T15:32:49.746848+0000","last_active":"2024-04-15T15:32:49.754601+0000","last_peered":"2024-04-15T15:32:49.754601+0000","last_clean":"2024-04-15T15:32:49.754601+0000","last_became_active":"2024-04-15T15:32:49.746533+0000","last_became_peered":"2024-04-15T15:32:49.746533+0000","last_unstale":"2024-04-15T15:32:49.754601+0000","last_undegraded":"2024-04-15T15:32:49.754601+0000","last_fullsized":"2024-04-15T15:32:49.754601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:23.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.763643+0000","last_change":"2024-04-15T15:32:48.735485+0000","last_active":"2024-04-15T15:32:49.763643+0000","last_peered":"2024-04-15T15:32:49.763643+0000","last_clean":"2024-04-15T15:32:49.763643+0000","last_became_active":"2024-04-15T15:32:48.734595+0000","last_became_peered":"2024-04-15T15:32:48.734595+0000","last_unstale":"2024-04-15T15:32:49.763643+0000","last_undegraded":"2024-04-15T15:32:49.763643+0000","last_fullsized":"2024-04-15T15:32:49.763643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:34:48.743687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.764660+0000","last_change":"2024-04-15T15:32:49.762453+0000","last_active":"2024-04-15T15:32:49.764660+0000","last_peered":"2024-04-15T15:32:49.764660+0000","last_clean":"2024-04-15T15:32:49.764660+0000","last_became_active":"2024-04-15T15:32:49.762211+0000","last_became_peered":"2024-04-15T15:32:49.762211+0000","last_unstale":"2024-04-15T15:32:49.764660+0000","last_undegraded":"2024-04-15T15:32:49.764660+0000","last_fullsized":"2024-04-15T15:32:49.764660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:47:24.421149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.725098+0000","last_change":"2024-04-15T15:32:48.744347+0000","last_active":"2024-04-15T15:32:49.725098+0000","last_peered":"2024-04-15T15:32:49.725098+0000","last_clean":"2024-04-15T15:32:49.725098+0000","last_became_active":"2024-04-15T15:32:48.743780+0000","last_became_peered":"2024-04-15T15:32:48.743780+0000","last_unstale":"2024-04-15T15:32:49.725098+0000","last_undegraded":"2024-04-15T15:32:49.725098+0000","last_fullsized":"2024-04-15T15:32:49.725098+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:03:16.510166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761468+0000","last_change":"2024-04-15T15:32:49.754647+0000","last_active":"2024-04-15T15:32:49.761468+0000","last_peered":"2024-04-15T15:32:49.761468+0000","last_clean":"2024-04-15T15:32:49.761468+0000","last_became_active":"2024-04-15T15:32:49.754368+0000","last_became_peered":"2024-04-15T15:32:49.754368+0000","last_unstale":"2024-04-15T15:32:49.761468+0000","last_undegraded":"2024-04-15T15:32:49.761468+0000","last_fullsized":"2024-04-15T15:32:49.761468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:03:48.949919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.727660+0000","last_change":"2024-04-15T15:32:48.743784+0000","last_active":"2024-04-15T15:32:49.727660+0000","last_peered":"2024-04-15T15:32:49.727660+0000","last_clean":"2024-04-15T15:32:49.727660+0000","last_became_active":"2024-04-15T15:32:48.743488+0000","last_became_peered":"2024-04-15T15:32:48.743488+0000","last_unstale":"2024-04-15T15:32:49.727660+0000","last_undegraded":"2024-04-15T15:32:49.727660+0000","last_fullsized":"2024-04-15T15:32:49.727660+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:40.937337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754477+0000","last_change":"2024-04-15T15:32:49.752691+0000","last_active":"2024-04-15T15:32:49.754477+0000","last_peered":"2024-04-15T15:32:49.754477+0000","last_clean":"2024-04-15T15:32:49.754477+0000","last_became_active":"2024-04-15T15:32:49.751951+0000","last_became_peered":"2024-04-15T15:32:49.751951+0000","last_unstale":"2024-04-15T15:32:49.754477+0000","last_undegraded":"2024-04-15T15:32:49.754477+0000","last_fullsized":"2024-04-15T15:32:49.754477+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:14:37.396788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.725115+0000","last_change":"2024-04-15T15:32:48.733046+0000","last_active":"2024-04-15T15:32:49.725115+0000","last_peered":"2024-04-15T15:32:49.725115+0000","last_clean":"2024-04-15T15:32:49.725115+0000","last_became_active":"2024-04-15T15:32:48.732672+0000","last_became_peered":"2024-04-15T15:32:48.732672+0000","last_unstale":"2024-04-15T15:32:49.725115+0000","last_undegraded":"2024-04-15T15:32:49.725115+0000","last_fullsized":"2024-04-15T15:32:49.725115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:28.851099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.757863+0000","last_change":"2024-04-15T15:32:49.755674+0000","last_active":"2024-04-15T15:32:49.757863+0000","last_peered":"2024-04-15T15:32:49.757863+0000","last_clean":"2024-04-15T15:32:49.757863+0000","last_became_active":"2024-04-15T15:32:49.755398+0000","last_became_peered":"2024-04-15T15:32:49.755398+0000","last_unstale":"2024-04-15T15:32:49.757863+0000","last_undegraded":"2024-04-15T15:32:49.757863+0000","last_fullsized":"2024-04-15T15:32:49.757863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:23.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771622+0000","last_change":"2024-04-15T15:32:48.746475+0000","last_active":"2024-04-15T15:32:49.771622+0000","last_peered":"2024-04-15T15:32:49.771622+0000","last_clean":"2024-04-15T15:32:49.771622+0000","last_became_active":"2024-04-15T15:32:48.746220+0000","last_became_peered":"2024-04-15T15:32:48.746220+0000","last_unstale":"2024-04-15T15:32:49.771622+0000","last_undegraded":"2024-04-15T15:32:49.771622+0000","last_fullsized":"2024-04-15T15:32:49.771622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:04.670668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.757947+0000","last_change":"2024-04-15T15:32:49.754576+0000","last_active":"2024-04-15T15:32:49.757947+0000","last_peered":"2024-04-15T15:32:49.757947+0000","last_clean":"2024-04-15T15:32:49.757947+0000","last_became_active":"2024-04-15T15:32:49.748031+0000","last_became_peered":"2024-04-15T15:32:49.748031+0000","last_unstale":"2024-04-15T15:32:49.757947+0000","last_undegraded":"2024-04-15T15:32:49.757947+0000","last_fullsized":"2024-04-15T15:32:49.757947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:18:06.850353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.725197+0000","last_change":"2024-04-15T15:32:48.738088+0000","last_active":"2024-04-15T15:32:49.725197+0000","last_peered":"2024-04-15T15:32:49.725197+0000","last_clean":"2024-04-15T15:32:49.725197+0000","last_became_active":"2024-04-15T15:32:48.737785+0000","last_became_peered":"2024-04-15T15:32:48.737785+0000","last_unstale":"2024-04-15T15:32:49.725197+0000","last_undegraded":"2024-04-15T15:32:49.725197+0000","last_fullsized":"2024-04-15T15:32:49.725197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:56:27.399631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.747860+0000","last_change":"2024-04-15T15:32:49.743999+0000","last_active":"2024-04-15T15:32:49.747860+0000","last_peered":"2024-04-15T15:32:49.747860+0000","last_clean":"2024-04-15T15:32:49.747860+0000","last_became_active":"2024-04-15T15:32:49.743572+0000","last_became_peered":"2024-04-15T15:32:49.743572+0000","last_unstale":"2024-04-15T15:32:49.747860+0000","last_undegraded":"2024-04-15T15:32:49.747860+0000","last_fullsized":"2024-04-15T15:32:49.747860+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:01:47.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.732766+0000","last_change":"2024-04-15T15:32:48.748274+0000","last_active":"2024-04-15T15:32:49.732766+0000","last_peered":"2024-04-15T15:32:49.732766+0000","last_clean":"2024-04-15T15:32:49.732766+0000","last_became_active":"2024-04-15T15:32:48.747940+0000","last_became_peered":"2024-04-15T15:32:48.747940+0000","last_unstale":"2024-04-15T15:32:49.732766+0000","last_undegraded":"2024-04-15T15:32:49.732766+0000","last_fullsized":"2024-04-15T15:32:49.732766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.574398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.742368+0000","last_change":"2024-04-15T15:32:49.737736+0000","last_active":"2024-04-15T15:32:49.742368+0000","last_peered":"2024-04-15T15:32:49.742368+0000","last_clean":"2024-04-15T15:32:49.742368+0000","last_became_active":"2024-04-15T15:32:49.737454+0000","last_became_peered":"2024-04-15T15:32:49.737454+0000","last_unstale":"2024-04-15T15:32:49.742368+0000","last_undegraded":"2024-04-15T15:32:49.742368+0000","last_fullsized":"2024-04-15T15:32:49.742368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:16:40.846261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.731865+0000","last_change":"2024-04-15T15:32:48.736503+0000","last_active":"2024-04-15T15:32:49.731865+0000","last_peered":"2024-04-15T15:32:49.731865+0000","last_clean":"2024-04-15T15:32:49.731865+0000","last_became_active":"2024-04-15T15:32:48.736210+0000","last_became_peered":"2024-04-15T15:32:48.736210+0000","last_unstale":"2024-04-15T15:32:49.731865+0000","last_undegraded":"2024-04-15T15:32:49.731865+0000","last_fullsized":"2024-04-15T15:32:49.731865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:18.228832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.750254+0000","last_change":"2024-04-15T15:32:49.746329+0000","last_active":"2024-04-15T15:32:49.750254+0000","last_peered":"2024-04-15T15:32:49.750254+0000","last_clean":"2024-04-15T15:32:49.750254+0000","last_became_active":"2024-04-15T15:32:49.746037+0000","last_became_peered":"2024-04-15T15:32:49.746037+0000","last_unstale":"2024-04-15T15:32:49.750254+0000","last_undegraded":"2024-04-15T15:32:49.750254+0000","last_fullsized":"2024-04-15T15:32:49.750254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:29:47.031910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.738951+0000","last_change":"2024-04-15T15:32:48.732043+0000","last_active":"2024-04-15T15:32:49.738951+0000","last_peered":"2024-04-15T15:32:49.738951+0000","last_clean":"2024-04-15T15:32:49.738951+0000","last_became_active":"2024-04-15T15:32:48.731703+0000","last_became_peered":"2024-04-15T15:32:48.731703+0000","last_unstale":"2024-04-15T15:32:49.738951+0000","last_undegraded":"2024-04-15T15:32:49.738951+0000","last_fullsized":"2024-04-15T15:32:49.738951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:02.383398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.743802+0000","last_change":"2024-04-15T15:32:49.741653+0000","last_active":"2024-04-15T15:32:49.743802+0000","last_peered":"2024-04-15T15:32:49.743802+0000","last_clean":"2024-04-15T15:32:49.743802+0000","last_became_active":"2024-04-15T15:32:49.741361+0000","last_became_peered":"2024-04-15T15:32:49.741361+0000","last_unstale":"2024-04-15T15:32:49.743802+0000","last_undegraded":"2024-04-15T15:32:49.743802+0000","last_fullsized":"2024-04-15T15:32:49.743802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:41.943999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.730723+0000","last_change":"2024-04-15T15:32:48.748049+0000","last_active":"2024-04-15T15:32:49.730723+0000","last_peered":"2024-04-15T15:32:49.730723+0000","last_clean":"2024-04-15T15:32:49.730723+0000","last_became_active":"2024-04-15T15:32:48.747719+0000","last_became_peered":"2024-04-15T15:32:48.747719+0000","last_unstale":"2024-04-15T15:32:49.730723+0000","last_undegraded":"2024-04-15T15:32:49.730723+0000","last_fullsized":"2024-04-15T15:32:49.730723+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:58:02.671290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754695+0000","last_change":"2024-04-15T15:32:49.747968+0000","last_active":"2024-04-15T15:32:49.754695+0000","last_peered":"2024-04-15T15:32:49.754695+0000","last_clean":"2024-04-15T15:32:49.754695+0000","last_became_active":"2024-04-15T15:32:49.747678+0000","last_became_peered":"2024-04-15T15:32:49.747678+0000","last_unstale":"2024-04-15T15:32:49.754695+0000","last_undegraded":"2024-04-15T15:32:49.754695+0000","last_fullsized":"2024-04-15T15:32:49.754695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:33:00.571639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.730744+0000","last_change":"2024-04-15T15:32:48.749736+0000","last_active":"2024-04-15T15:32:49.730744+0000","last_peered":"2024-04-15T15:32:49.730744+0000","last_clean":"2024-04-15T15:32:49.730744+0000","last_became_active":"2024-04-15T15:32:48.749327+0000","last_became_peered":"2024-04-15T15:32:48.749327+0000","last_unstale":"2024-04-15T15:32:49.730744+0000","last_undegraded":"2024-04-15T15:32:49.730744+0000","last_fullsized":"2024-04-15T15:32:49.730744+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:32:59.564976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.759331+0000","last_change":"2024-04-15T15:32:49.740222+0000","last_active":"2024-04-15T15:32:49.759331+0000","last_peered":"2024-04-15T15:32:49.759331+0000","last_clean":"2024-04-15T15:32:49.759331+0000","last_became_active":"2024-04-15T15:32:49.739832+0000","last_became_peered":"2024-04-15T15:32:49.739832+0000","last_unstale":"2024-04-15T15:32:49.759331+0000","last_undegraded":"2024-04-15T15:32:49.759331+0000","last_fullsized":"2024-04-15T15:32:49.759331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:59:06.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.728707+0000","last_change":"2024-04-15T15:32:48.743536+0000","last_active":"2024-04-15T15:32:49.728707+0000","last_peered":"2024-04-15T15:32:49.728707+0000","last_clean":"2024-04-15T15:32:49.728707+0000","last_became_active":"2024-04-15T15:32:48.743234+0000","last_became_peered":"2024-04-15T15:32:48.743234+0000","last_unstale":"2024-04-15T15:32:49.728707+0000","last_undegraded":"2024-04-15T15:32:49.728707+0000","last_fullsized":"2024-04-15T15:32:49.728707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:29:46.025248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.727848+0000","last_change":"2024-04-15T15:31:23.443687+0000","last_active":"2024-04-15T15:32:49.727848+0000","last_peered":"2024-04-15T15:32:49.727848+0000","last_clean":"2024-04-15T15:32:49.727848+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:32:49.727848+0000","last_undegraded":"2024-04-15T15:32:49.727848+0000","last_fullsized":"2024-04-15T15:32:49.727848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_clean_scrub_stamp":"2024-04-15T15:31:22.092427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:28:43.096549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":780097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":188629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":188159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":446464,"data_stored":188651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":188117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":188137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":778449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:32:53.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:32:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.985+0000 7f34fda00640 1 Processor -- start 2024-04-15T15:32:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.985+0000 7f34fda00640 1 -- start start 2024-04-15T15:32:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34fda00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f806fc90 0x7f34f815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34fda00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34f8072520 0x7f34f815ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34fda00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34f806f5a0 con 0x7f34f815e910 2024-04-15T15:32:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34fda00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f34f815b9e0 con 0x7f34f8072520 2024-04-15T15:32:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34fda00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f34f815f480 con 0x7f34f806fc90 2024-04-15T15:32:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f7400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34f8072520 0x7f34f815ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f6000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f34f815e910 0x7f34f8071e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58618/0 (socket says 172.21.15.73:58618) 2024-04-15T15:32:53.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f6000640 1 -- 172.21.15.73:0/3325139912 learned_addr learned my addr 172.21.15.73:0/3325139912 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:53.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f6a00640 1 --2- 172.21.15.73:0/3325139912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f806fc90 0x7f34f815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f7400640 1 -- 172.21.15.73:0/3325139912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f806fc90 msgr2=0x7f34f815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:53.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f7400640 1 --2- 172.21.15.73:0/3325139912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f806fc90 0x7f34f815be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f7400640 1 -- 172.21.15.73:0/3325139912 >> v1:172.21.15.73:6789/0 conn(0x7f34f815e910 legacy=0x7f34f8071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f7400640 1 -- 172.21.15.73:0/3325139912 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f815f760 con 0x7f34f8072520 2024-04-15T15:32:53.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f5600640 1 -- 172.21.15.73:0/3325139912 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2616669049 0 0) 0x7f34e4001120 con 0x7f34f815e910 2024-04-15T15:32:53.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f7400640 1 --2- 172.21.15.73:0/3325139912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 0x7f34f815ed90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f34f00097c0 tx=0x7f34f001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f65d8d5f167b93 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:53.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.989+0000 7f34f5600640 1 -- 172.21.15.73:0/3325139912 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f00b0070 con 0x7f34f8072520 2024-04-15T15:32:53.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34f5600640 1 -- 172.21.15.73:0/3325139912 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f00ab600 con 0x7f34f8072520 2024-04-15T15:32:53.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34f5600640 1 -- 172.21.15.73:0/3325139912 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f00ab9d0 con 0x7f34f8072520 2024-04-15T15:32:53.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 -- 172.21.15.73:0/3325139912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 msgr2=0x7f34f815ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 --2- 172.21.15.73:0/3325139912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 0x7f34f815ed90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f34f00097c0 tx=0x7f34f001c4a0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 -- 172.21.15.73:0/3325139912 shutdown_connections 2024-04-15T15:32:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 --2- 172.21.15.73:0/3325139912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 0x7f34f815ed90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 --2- 172.21.15.73:0/3325139912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f806fc90 0x7f34f815be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 -- 172.21.15.73:0/3325139912 >> 172.21.15.73:0/3325139912 conn(0x7f34f8067dd0 msgr2=0x7f34f80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 -- 172.21.15.73:0/3325139912 shutdown_connections 2024-04-15T15:32:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 -- 172.21.15.73:0/3325139912 wait complete. 2024-04-15T15:32:53.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 Processor -- start 2024-04-15T15:32:53.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 -- start start 2024-04-15T15:32:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f806fc90 0x7f34f80cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 0x7f34f806e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f815e910 0x7f34f81f9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f34f80b3f90 con 0x7f34f8072520 2024-04-15T15:32:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f34f80b3e10 con 0x7f34f815e910 2024-04-15T15:32:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34fda00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f34f80b4110 con 0x7f34f806fc90 2024-04-15T15:32:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34f6000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 0x7f34f806e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34f6000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 0x7f34f806e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42924/0 (socket says 172.21.15.73:42924) 2024-04-15T15:32:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34f6000640 1 -- 172.21.15.73:0/2660014752 learned_addr learned my addr 172.21.15.73:0/2660014752 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34f7400640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f815e910 0x7f34f81f9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.993+0000 7f34f6a00640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f806fc90 0x7f34f80cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34f6000640 1 -- 172.21.15.73:0/2660014752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f806fc90 msgr2=0x7f34f80cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34f6000640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f806fc90 0x7f34f80cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34f6000640 1 -- 172.21.15.73:0/2660014752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f815e910 msgr2=0x7f34f81f9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34f6000640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f815e910 0x7f34f81f9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34f6000640 1 -- 172.21.15.73:0/2660014752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f81fac40 con 0x7f34f8072520 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34f6000640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 0x7f34f806e070 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c4b0 tx=0x7f34e400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34eea00640 1 -- 172.21.15.73:0/2660014752 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e4018070 con 0x7f34f8072520 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34eea00640 1 -- 172.21.15.73:0/2660014752 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e4007500 con 0x7f34f8072520 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34fda00640 1 -- 172.21.15.73:0/2660014752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f81faf20 con 0x7f34f8072520 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34eea00640 1 -- 172.21.15.73:0/2660014752 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e4004a30 con 0x7f34f8072520 2024-04-15T15:32:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34fda00640 1 -- 172.21.15.73:0/2660014752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f81fb4e0 con 0x7f34f8072520 2024-04-15T15:32:53.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34fda00640 1 -- 172.21.15.73:0/2660014752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f8068ab0 con 0x7f34f8072520 2024-04-15T15:32:53.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34eea00640 1 -- 172.21.15.73:0/2660014752 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f34e401b070 con 0x7f34f8072520 2024-04-15T15:32:53.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34eea00640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34d8068380 0x7f34d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:53.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34eea00640 1 -- 172.21.15.73:0/2660014752 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f34e4085e40 con 0x7f34f8072520 2024-04-15T15:32:53.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:53.997+0000 7f34f6a00640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34d8068380 0x7f34d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.001+0000 7f34f6a00640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34d8068380 0x7f34d806a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f34e80074a0 tx=0x7f34e800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:54.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.001+0000 7f34eea00640 1 -- 172.21.15.73:0/2660014752 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f34f806f5a0 con 0x7f34f8072520 2024-04-15T15:32:54.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.157+0000 7f34fda00640 1 -- 172.21.15.73:0/2660014752 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34f80cca10 con 0x7f34d8068380 2024-04-15T15:32:54.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.165+0000 7f34eea00640 1 -- 172.21.15.73:0/2660014752 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251887 (secure 0 0 0) 0x7f34f80cca10 con 0x7f34d8068380 2024-04-15T15:32:54.167 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:54.168 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:32:54.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 -- 172.21.15.73:0/2660014752 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34d8068380 msgr2=0x7f34d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34d8068380 0x7f34d806a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f34e80074a0 tx=0x7f34e800b040 comp rx=0 tx=0).stop 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 -- 172.21.15.73:0/2660014752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 msgr2=0x7f34f806e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 0x7f34f806e070 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c4b0 tx=0x7f34e400c970 comp rx=0 tx=0).stop 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 -- 172.21.15.73:0/2660014752 shutdown_connections 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f815e910 0x7f34f81f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34f8072520 0x7f34f806e070 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f34d8068380 0x7f34d806a840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 --2- 172.21.15.73:0/2660014752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f806fc90 0x7f34f80cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 -- 172.21.15.73:0/2660014752 >> 172.21.15.73:0/2660014752 conn(0x7f34f8067dd0 msgr2=0x7f34f815be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 -- 172.21.15.73:0/2660014752 shutdown_connections 2024-04-15T15:32:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.169+0000 7f34fda00640 1 -- 172.21.15.73:0/2660014752 wait complete. 2024-04-15T15:32:54.188 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-04-15T15:32:53.372489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237424,"kb_used_data":4620,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737296,"statfs":{"total":773094113280,"available":772850991104,"internally_reserved":0,"allocated":4730880,"data_stored":2681119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.658825"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.747908+0000","last_change":"2024-04-15T15:32:49.745412+0000","last_active":"2024-04-15T15:32:49.747908+0000","last_peered":"2024-04-15T15:32:49.747908+0000","last_clean":"2024-04-15T15:32:49.747908+0000","last_became_active":"2024-04-15T15:32:49.742809+0000","last_became_peered":"2024-04-15T15:32:49.742809+0000","last_unstale":"2024-04-15T15:32:49.747908+0000","last_undegraded":"2024-04-15T15:32:49.747908+0000","last_fullsized":"2024-04-15T15:32:49.747908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:41:46.543038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.741909+0000","last_change":"2024-04-15T15:32:49.737205+0000","last_active":"2024-04-15T15:32:49.741909+0000","last_peered":"2024-04-15T15:32:49.741909+0000","last_clean":"2024-04-15T15:32:49.741909+0000","last_became_active":"2024-04-15T15:32:49.736995+0000","last_became_peered":"2024-04-15T15:32:49.736995+0000","last_unstale":"2024-04-15T15:32:49.741909+0000","last_undegraded":"2024-04-15T15:32:49.741909+0000","last_fullsized":"2024-04-15T15:32:49.741909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:59:06.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758162+0000","last_change":"2024-04-15T15:32:49.756109+0000","last_active":"2024-04-15T15:32:49.758162+0000","last_peered":"2024-04-15T15:32:49.758162+0000","last_clean":"2024-04-15T15:32:49.758162+0000","last_became_active":"2024-04-15T15:32:49.755810+0000","last_became_peered":"2024-04-15T15:32:49.755810+0000","last_unstale":"2024-04-15T15:32:49.758162+0000","last_undegraded":"2024-04-15T15:32:49.758162+0000","last_fullsized":"2024-04-15T15:32:49.758162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:05.677330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758650+0000","last_change":"2024-04-15T15:32:49.754128+0000","last_active":"2024-04-15T15:32:49.758650+0000","last_peered":"2024-04-15T15:32:49.758650+0000","last_clean":"2024-04-15T15:32:49.758650+0000","last_became_active":"2024-04-15T15:32:49.753870+0000","last_became_peered":"2024-04-15T15:32:49.753870+0000","last_unstale":"2024-04-15T15:32:49.758650+0000","last_undegraded":"2024-04-15T15:32:49.758650+0000","last_fullsized":"2024-04-15T15:32:49.758650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:26:50.592924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.757384+0000","last_change":"2024-04-15T15:32:49.749776+0000","last_active":"2024-04-15T15:32:49.757384+0000","last_peered":"2024-04-15T15:32:49.757384+0000","last_clean":"2024-04-15T15:32:49.757384+0000","last_became_active":"2024-04-15T15:32:49.749522+0000","last_became_peered":"2024-04-15T15:32:49.749522+0000","last_unstale":"2024-04-15T15:32:49.757384+0000","last_undegraded":"2024-04-15T15:32:49.757384+0000","last_fullsized":"2024-04-15T15:32:49.757384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:49:50.215422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.747690+0000","last_change":"2024-04-15T15:32:49.744856+0000","last_active":"2024-04-15T15:32:49.747690+0000","last_peered":"2024-04-15T15:32:49.747690+0000","last_clean":"2024-04-15T15:32:49.747690+0000","last_became_active":"2024-04-15T15:32:49.744560+0000","last_became_peered":"2024-04-15T15:32:49.744560+0000","last_unstale":"2024-04-15T15:32:49.747690+0000","last_undegraded":"2024-04-15T15:32:49.747690+0000","last_fullsized":"2024-04-15T15:32:49.747690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:16:40.846261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.746025+0000","last_change":"2024-04-15T15:32:49.737242+0000","last_active":"2024-04-15T15:32:49.746025+0000","last_peered":"2024-04-15T15:32:49.746025+0000","last_clean":"2024-04-15T15:32:49.746025+0000","last_became_active":"2024-04-15T15:32:49.736975+0000","last_became_peered":"2024-04-15T15:32:49.736975+0000","last_unstale":"2024-04-15T15:32:49.746025+0000","last_undegraded":"2024-04-15T15:32:49.746025+0000","last_fullsized":"2024-04-15T15:32:49.746025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:47:24.421149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.739142+0000","last_change":"2024-04-15T15:32:49.733346+0000","last_active":"2024-04-15T15:32:49.739142+0000","last_peered":"2024-04-15T15:32:49.739142+0000","last_clean":"2024-04-15T15:32:49.739142+0000","last_became_active":"2024-04-15T15:32:49.733013+0000","last_became_peered":"2024-04-15T15:32:49.733013+0000","last_unstale":"2024-04-15T15:32:49.739142+0000","last_undegraded":"2024-04-15T15:32:49.739142+0000","last_fullsized":"2024-04-15T15:32:49.739142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:54:37.380883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.748725+0000","last_change":"2024-04-15T15:32:49.738011+0000","last_active":"2024-04-15T15:32:49.748725+0000","last_peered":"2024-04-15T15:32:49.748725+0000","last_clean":"2024-04-15T15:32:49.748725+0000","last_became_active":"2024-04-15T15:32:49.737740+0000","last_became_peered":"2024-04-15T15:32:49.737740+0000","last_unstale":"2024-04-15T15:32:49.748725+0000","last_undegraded":"2024-04-15T15:32:49.748725+0000","last_fullsized":"2024-04-15T15:32:49.748725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:29:47.031910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.759248+0000","last_change":"2024-04-15T15:32:49.742136+0000","last_active":"2024-04-15T15:32:49.759248+0000","last_peered":"2024-04-15T15:32:49.759248+0000","last_clean":"2024-04-15T15:32:49.759248+0000","last_became_active":"2024-04-15T15:32:49.741810+0000","last_became_peered":"2024-04-15T15:32:49.741810+0000","last_unstale":"2024-04-15T15:32:49.759248+0000","last_undegraded":"2024-04-15T15:32:49.759248+0000","last_fullsized":"2024-04-15T15:32:49.759248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:18:06.850353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761426+0000","last_change":"2024-04-15T15:32:49.752830+0000","last_active":"2024-04-15T15:32:49.761426+0000","last_peered":"2024-04-15T15:32:49.761426+0000","last_clean":"2024-04-15T15:32:49.761426+0000","last_became_active":"2024-04-15T15:32:49.752524+0000","last_became_peered":"2024-04-15T15:32:49.752524+0000","last_unstale":"2024-04-15T15:32:49.761426+0000","last_undegraded":"2024-04-15T15:32:49.761426+0000","last_fullsized":"2024-04-15T15:32:49.761426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:51.200164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.745242+0000","last_change":"2024-04-15T15:32:49.741006+0000","last_active":"2024-04-15T15:32:49.745242+0000","last_peered":"2024-04-15T15:32:49.745242+0000","last_clean":"2024-04-15T15:32:49.745242+0000","last_became_active":"2024-04-15T15:32:49.740783+0000","last_became_peered":"2024-04-15T15:32:49.740783+0000","last_unstale":"2024-04-15T15:32:49.745242+0000","last_undegraded":"2024-04-15T15:32:49.745242+0000","last_fullsized":"2024-04-15T15:32:49.745242+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:55.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761425+0000","last_change":"2024-04-15T15:32:49.751807+0000","last_active":"2024-04-15T15:32:49.761425+0000","last_peered":"2024-04-15T15:32:49.761425+0000","last_clean":"2024-04-15T15:32:49.761425+0000","last_became_active":"2024-04-15T15:32:49.751535+0000","last_became_peered":"2024-04-15T15:32:49.751535+0000","last_unstale":"2024-04-15T15:32:49.761425+0000","last_undegraded":"2024-04-15T15:32:49.761425+0000","last_fullsized":"2024-04-15T15:32:49.761425+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:41:46.543038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.749047+0000","last_change":"2024-04-15T15:32:49.744743+0000","last_active":"2024-04-15T15:32:49.749047+0000","last_peered":"2024-04-15T15:32:49.749047+0000","last_clean":"2024-04-15T15:32:49.749047+0000","last_became_active":"2024-04-15T15:32:49.744433+0000","last_became_peered":"2024-04-15T15:32:49.744433+0000","last_unstale":"2024-04-15T15:32:49.749047+0000","last_undegraded":"2024-04-15T15:32:49.749047+0000","last_fullsized":"2024-04-15T15:32:49.749047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:55.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761011+0000","last_change":"2024-04-15T15:32:49.745690+0000","last_active":"2024-04-15T15:32:49.761011+0000","last_peered":"2024-04-15T15:32:49.761011+0000","last_clean":"2024-04-15T15:32:49.761011+0000","last_became_active":"2024-04-15T15:32:49.745391+0000","last_became_peered":"2024-04-15T15:32:49.745391+0000","last_unstale":"2024-04-15T15:32:49.761011+0000","last_undegraded":"2024-04-15T15:32:49.761011+0000","last_fullsized":"2024-04-15T15:32:49.761011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:56:56.655030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754621+0000","last_change":"2024-04-15T15:32:49.749409+0000","last_active":"2024-04-15T15:32:49.754621+0000","last_peered":"2024-04-15T15:32:49.754621+0000","last_clean":"2024-04-15T15:32:49.754621+0000","last_became_active":"2024-04-15T15:32:49.749144+0000","last_became_peered":"2024-04-15T15:32:49.749144+0000","last_unstale":"2024-04-15T15:32:49.754621+0000","last_undegraded":"2024-04-15T15:32:49.754621+0000","last_fullsized":"2024-04-15T15:32:49.754621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:59:06.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.753855+0000","last_change":"2024-04-15T15:32:49.747682+0000","last_active":"2024-04-15T15:32:49.753855+0000","last_peered":"2024-04-15T15:32:49.753855+0000","last_clean":"2024-04-15T15:32:49.753855+0000","last_became_active":"2024-04-15T15:32:49.747407+0000","last_became_peered":"2024-04-15T15:32:49.747407+0000","last_unstale":"2024-04-15T15:32:49.753855+0000","last_undegraded":"2024-04-15T15:32:49.753855+0000","last_fullsized":"2024-04-15T15:32:49.753855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:05.677330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.756554+0000","last_change":"2024-04-15T15:32:49.752644+0000","last_active":"2024-04-15T15:32:49.756554+0000","last_peered":"2024-04-15T15:32:49.756554+0000","last_clean":"2024-04-15T15:32:49.756554+0000","last_became_active":"2024-04-15T15:32:49.752378+0000","last_became_peered":"2024-04-15T15:32:49.752378+0000","last_unstale":"2024-04-15T15:32:49.756554+0000","last_undegraded":"2024-04-15T15:32:49.756554+0000","last_fullsized":"2024-04-15T15:32:49.756554+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:29:47.031910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.757407+0000","last_change":"2024-04-15T15:32:49.749456+0000","last_active":"2024-04-15T15:32:49.757407+0000","last_peered":"2024-04-15T15:32:49.757407+0000","last_clean":"2024-04-15T15:32:49.757407+0000","last_became_active":"2024-04-15T15:32:49.749113+0000","last_became_peered":"2024-04-15T15:32:49.749113+0000","last_unstale":"2024-04-15T15:32:49.757407+0000","last_undegraded":"2024-04-15T15:32:49.757407+0000","last_fullsized":"2024-04-15T15:32:49.757407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:55:34.910231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758617+0000","last_change":"2024-04-15T15:32:49.757153+0000","last_active":"2024-04-15T15:32:49.758617+0000","last_peered":"2024-04-15T15:32:49.758617+0000","last_clean":"2024-04-15T15:32:49.758617+0000","last_became_active":"2024-04-15T15:32:49.756930+0000","last_became_peered":"2024-04-15T15:32:49.756930+0000","last_unstale":"2024-04-15T15:32:49.758617+0000","last_undegraded":"2024-04-15T15:32:49.758617+0000","last_fullsized":"2024-04-15T15:32:49.758617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:55.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761834+0000","last_change":"2024-04-15T15:32:49.754949+0000","last_active":"2024-04-15T15:32:49.761834+0000","last_peered":"2024-04-15T15:32:49.761834+0000","last_clean":"2024-04-15T15:32:49.761834+0000","last_became_active":"2024-04-15T15:32:49.754731+0000","last_became_peered":"2024-04-15T15:32:49.754731+0000","last_unstale":"2024-04-15T15:32:49.761834+0000","last_undegraded":"2024-04-15T15:32:49.761834+0000","last_fullsized":"2024-04-15T15:32:49.761834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:36:16.378875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.749719+0000","last_change":"2024-04-15T15:32:49.745651+0000","last_active":"2024-04-15T15:32:49.749719+0000","last_peered":"2024-04-15T15:32:49.749719+0000","last_clean":"2024-04-15T15:32:49.749719+0000","last_became_active":"2024-04-15T15:32:49.745373+0000","last_became_peered":"2024-04-15T15:32:49.745373+0000","last_unstale":"2024-04-15T15:32:49.749719+0000","last_undegraded":"2024-04-15T15:32:49.749719+0000","last_fullsized":"2024-04-15T15:32:49.749719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:56:42.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755751+0000","last_change":"2024-04-15T15:32:49.747377+0000","last_active":"2024-04-15T15:32:49.755751+0000","last_peered":"2024-04-15T15:32:49.755751+0000","last_clean":"2024-04-15T15:32:49.755751+0000","last_became_active":"2024-04-15T15:32:49.746858+0000","last_became_peered":"2024-04-15T15:32:49.746858+0000","last_unstale":"2024-04-15T15:32:49.755751+0000","last_undegraded":"2024-04-15T15:32:49.755751+0000","last_fullsized":"2024-04-15T15:32:49.755751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:56:42.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758370+0000","last_change":"2024-04-15T15:32:49.750912+0000","last_active":"2024-04-15T15:32:49.758370+0000","last_peered":"2024-04-15T15:32:49.758370+0000","last_clean":"2024-04-15T15:32:49.758370+0000","last_became_active":"2024-04-15T15:32:49.750511+0000","last_became_peered":"2024-04-15T15:32:49.750511+0000","last_unstale":"2024-04-15T15:32:49.758370+0000","last_undegraded":"2024-04-15T15:32:49.758370+0000","last_fullsized":"2024-04-15T15:32:49.758370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:06:33.425710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.752078+0000","last_change":"2024-04-15T15:32:49.749145+0000","last_active":"2024-04-15T15:32:49.752078+0000","last_peered":"2024-04-15T15:32:49.752078+0000","last_clean":"2024-04-15T15:32:49.752078+0000","last_became_active":"2024-04-15T15:32:49.748851+0000","last_became_peered":"2024-04-15T15:32:49.748851+0000","last_unstale":"2024-04-15T15:32:49.752078+0000","last_undegraded":"2024-04-15T15:32:49.752078+0000","last_fullsized":"2024-04-15T15:32:49.752078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:24.581061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758343+0000","last_change":"2024-04-15T15:32:49.756140+0000","last_active":"2024-04-15T15:32:49.758343+0000","last_peered":"2024-04-15T15:32:49.758343+0000","last_clean":"2024-04-15T15:32:49.758343+0000","last_became_active":"2024-04-15T15:32:49.755885+0000","last_became_peered":"2024-04-15T15:32:49.755885+0000","last_unstale":"2024-04-15T15:32:49.758343+0000","last_undegraded":"2024-04-15T15:32:49.758343+0000","last_fullsized":"2024-04-15T15:32:49.758343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:56:42.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.757786+0000","last_change":"2024-04-15T15:32:49.750125+0000","last_active":"2024-04-15T15:32:49.757786+0000","last_peered":"2024-04-15T15:32:49.757786+0000","last_clean":"2024-04-15T15:32:49.757786+0000","last_became_active":"2024-04-15T15:32:49.749842+0000","last_became_peered":"2024-04-15T15:32:49.749842+0000","last_unstale":"2024-04-15T15:32:49.757786+0000","last_undegraded":"2024-04-15T15:32:49.757786+0000","last_fullsized":"2024-04-15T15:32:49.757786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:41.943999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.749177+0000","last_change":"2024-04-15T15:32:49.738967+0000","last_active":"2024-04-15T15:32:49.749177+0000","last_peered":"2024-04-15T15:32:49.749177+0000","last_clean":"2024-04-15T15:32:49.749177+0000","last_became_active":"2024-04-15T15:32:49.736938+0000","last_became_peered":"2024-04-15T15:32:49.736938+0000","last_unstale":"2024-04-15T15:32:49.749177+0000","last_undegraded":"2024-04-15T15:32:49.749177+0000","last_fullsized":"2024-04-15T15:32:49.749177+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:54:37.380883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755237+0000","last_change":"2024-04-15T15:32:49.746848+0000","last_active":"2024-04-15T15:32:49.755237+0000","last_peered":"2024-04-15T15:32:49.755237+0000","last_clean":"2024-04-15T15:32:49.755237+0000","last_became_active":"2024-04-15T15:32:49.746569+0000","last_became_peered":"2024-04-15T15:32:49.746569+0000","last_unstale":"2024-04-15T15:32:49.755237+0000","last_undegraded":"2024-04-15T15:32:49.755237+0000","last_fullsized":"2024-04-15T15:32:49.755237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:19.235494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.756018+0000","last_change":"2024-04-15T15:32:49.752018+0000","last_active":"2024-04-15T15:32:49.756018+0000","last_peered":"2024-04-15T15:32:49.756018+0000","last_clean":"2024-04-15T15:32:49.756018+0000","last_became_active":"2024-04-15T15:32:49.751833+0000","last_became_peered":"2024-04-15T15:32:49.751833+0000","last_unstale":"2024-04-15T15:32:49.756018+0000","last_undegraded":"2024-04-15T15:32:49.756018+0000","last_fullsized":"2024-04-15T15:32:49.756018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:16:40.846261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755771+0000","last_change":"2024-04-15T15:32:49.749799+0000","last_active":"2024-04-15T15:32:49.755771+0000","last_peered":"2024-04-15T15:32:49.755771+0000","last_clean":"2024-04-15T15:32:49.755771+0000","last_became_active":"2024-04-15T15:32:49.747125+0000","last_became_peered":"2024-04-15T15:32:49.747125+0000","last_unstale":"2024-04-15T15:32:49.755771+0000","last_undegraded":"2024-04-15T15:32:49.755771+0000","last_fullsized":"2024-04-15T15:32:49.755771+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:47:24.421149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755142+0000","last_change":"2024-04-15T15:32:49.750005+0000","last_active":"2024-04-15T15:32:49.755142+0000","last_peered":"2024-04-15T15:32:49.755142+0000","last_clean":"2024-04-15T15:32:49.755142+0000","last_became_active":"2024-04-15T15:32:49.748946+0000","last_became_peered":"2024-04-15T15:32:49.748946+0000","last_unstale":"2024-04-15T15:32:49.755142+0000","last_undegraded":"2024-04-15T15:32:49.755142+0000","last_fullsized":"2024-04-15T15:32:49.755142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:55.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755071+0000","last_change":"2024-04-15T15:32:49.749853+0000","last_active":"2024-04-15T15:32:49.755071+0000","last_peered":"2024-04-15T15:32:49.755071+0000","last_clean":"2024-04-15T15:32:49.755071+0000","last_became_active":"2024-04-15T15:32:49.747924+0000","last_became_peered":"2024-04-15T15:32:49.747924+0000","last_unstale":"2024-04-15T15:32:49.755071+0000","last_undegraded":"2024-04-15T15:32:49.755071+0000","last_fullsized":"2024-04-15T15:32:49.755071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:54:37.380883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771966+0000","last_change":"2024-04-15T15:32:48.743575+0000","last_active":"2024-04-15T15:32:49.771966+0000","last_peered":"2024-04-15T15:32:49.771966+0000","last_clean":"2024-04-15T15:32:49.771966+0000","last_became_active":"2024-04-15T15:32:48.741400+0000","last_became_peered":"2024-04-15T15:32:48.741400+0000","last_unstale":"2024-04-15T15:32:49.771966+0000","last_undegraded":"2024-04-15T15:32:49.771966+0000","last_fullsized":"2024-04-15T15:32:49.771966+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:58:02.671290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758341+0000","last_change":"2024-04-15T15:32:49.757393+0000","last_active":"2024-04-15T15:32:49.758341+0000","last_peered":"2024-04-15T15:32:49.758341+0000","last_clean":"2024-04-15T15:32:49.758341+0000","last_became_active":"2024-04-15T15:32:49.757064+0000","last_became_peered":"2024-04-15T15:32:49.757064+0000","last_unstale":"2024-04-15T15:32:49.758341+0000","last_undegraded":"2024-04-15T15:32:49.758341+0000","last_fullsized":"2024-04-15T15:32:49.758341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:05.677330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.766095+0000","last_change":"2024-04-15T15:32:48.739565+0000","last_active":"2024-04-15T15:32:49.766095+0000","last_peered":"2024-04-15T15:32:49.766095+0000","last_clean":"2024-04-15T15:32:49.766095+0000","last_became_active":"2024-04-15T15:32:48.739243+0000","last_became_peered":"2024-04-15T15:32:48.739243+0000","last_unstale":"2024-04-15T15:32:49.766095+0000","last_undegraded":"2024-04-15T15:32:49.766095+0000","last_fullsized":"2024-04-15T15:32:49.766095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:40.937337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.749195+0000","last_change":"2024-04-15T15:32:49.745326+0000","last_active":"2024-04-15T15:32:49.749195+0000","last_peered":"2024-04-15T15:32:49.749195+0000","last_clean":"2024-04-15T15:32:49.749195+0000","last_became_active":"2024-04-15T15:32:49.745043+0000","last_became_peered":"2024-04-15T15:32:49.745043+0000","last_unstale":"2024-04-15T15:32:49.749195+0000","last_undegraded":"2024-04-15T15:32:49.749195+0000","last_fullsized":"2024-04-15T15:32:49.749195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:23.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.769327+0000","last_change":"2024-04-15T15:32:48.745776+0000","last_active":"2024-04-15T15:32:49.769327+0000","last_peered":"2024-04-15T15:32:49.769327+0000","last_clean":"2024-04-15T15:32:49.769327+0000","last_became_active":"2024-04-15T15:32:48.745340+0000","last_became_peered":"2024-04-15T15:32:48.745340+0000","last_unstale":"2024-04-15T15:32:49.769327+0000","last_undegraded":"2024-04-15T15:32:49.769327+0000","last_fullsized":"2024-04-15T15:32:49.769327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:40.937337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.751030+0000","last_change":"2024-04-15T15:32:49.747358+0000","last_active":"2024-04-15T15:32:49.751030+0000","last_peered":"2024-04-15T15:32:49.751030+0000","last_clean":"2024-04-15T15:32:49.751030+0000","last_became_active":"2024-04-15T15:32:49.747091+0000","last_became_peered":"2024-04-15T15:32:49.747091+0000","last_unstale":"2024-04-15T15:32:49.751030+0000","last_undegraded":"2024-04-15T15:32:49.751030+0000","last_fullsized":"2024-04-15T15:32:49.751030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:51.200164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771344+0000","last_change":"2024-04-15T15:32:48.749468+0000","last_active":"2024-04-15T15:32:49.771344+0000","last_peered":"2024-04-15T15:32:49.771344+0000","last_clean":"2024-04-15T15:32:49.771344+0000","last_became_active":"2024-04-15T15:32:48.749153+0000","last_became_peered":"2024-04-15T15:32:48.749153+0000","last_unstale":"2024-04-15T15:32:49.771344+0000","last_undegraded":"2024-04-15T15:32:49.771344+0000","last_fullsized":"2024-04-15T15:32:49.771344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:29:46.025248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.747385+0000","last_change":"2024-04-15T15:32:49.742855+0000","last_active":"2024-04-15T15:32:49.747385+0000","last_peered":"2024-04-15T15:32:49.747385+0000","last_clean":"2024-04-15T15:32:49.747385+0000","last_became_active":"2024-04-15T15:32:49.742560+0000","last_became_peered":"2024-04-15T15:32:49.742560+0000","last_unstale":"2024-04-15T15:32:49.747385+0000","last_undegraded":"2024-04-15T15:32:49.747385+0000","last_fullsized":"2024-04-15T15:32:49.747385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:23.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771259+0000","last_change":"2024-04-15T15:32:48.734359+0000","last_active":"2024-04-15T15:32:49.771259+0000","last_peered":"2024-04-15T15:32:49.771259+0000","last_clean":"2024-04-15T15:32:49.771259+0000","last_became_active":"2024-04-15T15:32:48.734044+0000","last_became_peered":"2024-04-15T15:32:48.734044+0000","last_unstale":"2024-04-15T15:32:49.771259+0000","last_undegraded":"2024-04-15T15:32:49.771259+0000","last_fullsized":"2024-04-15T15:32:49.771259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:54.639667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.753995+0000","last_change":"2024-04-15T15:32:49.739768+0000","last_active":"2024-04-15T15:32:49.753995+0000","last_peered":"2024-04-15T15:32:49.753995+0000","last_clean":"2024-04-15T15:32:49.753995+0000","last_became_active":"2024-04-15T15:32:49.739491+0000","last_became_peered":"2024-04-15T15:32:49.739491+0000","last_unstale":"2024-04-15T15:32:49.753995+0000","last_undegraded":"2024-04-15T15:32:49.753995+0000","last_fullsized":"2024-04-15T15:32:49.753995+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:26:27.851809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.763672+0000","last_change":"2024-04-15T15:32:48.742058+0000","last_active":"2024-04-15T15:32:49.763672+0000","last_peered":"2024-04-15T15:32:49.763672+0000","last_clean":"2024-04-15T15:32:49.763672+0000","last_became_active":"2024-04-15T15:32:48.741674+0000","last_became_peered":"2024-04-15T15:32:48.741674+0000","last_unstale":"2024-04-15T15:32:49.763672+0000","last_undegraded":"2024-04-15T15:32:49.763672+0000","last_fullsized":"2024-04-15T15:32:49.763672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.574398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.742900+0000","last_change":"2024-04-15T15:32:49.735996+0000","last_active":"2024-04-15T15:32:49.742900+0000","last_peered":"2024-04-15T15:32:49.742900+0000","last_clean":"2024-04-15T15:32:49.742900+0000","last_became_active":"2024-04-15T15:32:49.735432+0000","last_became_peered":"2024-04-15T15:32:49.735432+0000","last_unstale":"2024-04-15T15:32:49.742900+0000","last_undegraded":"2024-04-15T15:32:49.742900+0000","last_fullsized":"2024-04-15T15:32:49.742900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:19.235494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.737334+0000","last_change":"2024-04-15T15:32:48.746610+0000","last_active":"2024-04-15T15:32:49.737334+0000","last_peered":"2024-04-15T15:32:49.737334+0000","last_clean":"2024-04-15T15:32:49.737334+0000","last_became_active":"2024-04-15T15:32:48.746347+0000","last_became_peered":"2024-04-15T15:32:48.746347+0000","last_unstale":"2024-04-15T15:32:49.737334+0000","last_undegraded":"2024-04-15T15:32:49.737334+0000","last_fullsized":"2024-04-15T15:32:49.737334+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:18.228832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754460+0000","last_change":"2024-04-15T15:32:49.752678+0000","last_active":"2024-04-15T15:32:49.754460+0000","last_peered":"2024-04-15T15:32:49.754460+0000","last_clean":"2024-04-15T15:32:49.754460+0000","last_became_active":"2024-04-15T15:32:49.751993+0000","last_became_peered":"2024-04-15T15:32:49.751993+0000","last_unstale":"2024-04-15T15:32:49.754460+0000","last_undegraded":"2024-04-15T15:32:49.754460+0000","last_fullsized":"2024-04-15T15:32:49.754460+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:36:16.378875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.731329+0000","last_change":"2024-04-15T15:32:48.739465+0000","last_active":"2024-04-15T15:32:49.731329+0000","last_peered":"2024-04-15T15:32:49.731329+0000","last_clean":"2024-04-15T15:32:49.731329+0000","last_became_active":"2024-04-15T15:32:48.739148+0000","last_became_peered":"2024-04-15T15:32:48.739148+0000","last_unstale":"2024-04-15T15:32:49.731329+0000","last_undegraded":"2024-04-15T15:32:49.731329+0000","last_fullsized":"2024-04-15T15:32:49.731329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:02.383398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.758326+0000","last_change":"2024-04-15T15:32:49.750695+0000","last_active":"2024-04-15T15:32:49.758326+0000","last_peered":"2024-04-15T15:32:49.758326+0000","last_clean":"2024-04-15T15:32:49.758326+0000","last_became_active":"2024-04-15T15:32:49.749350+0000","last_became_peered":"2024-04-15T15:32:49.749350+0000","last_unstale":"2024-04-15T15:32:49.758326+0000","last_undegraded":"2024-04-15T15:32:49.758326+0000","last_fullsized":"2024-04-15T15:32:49.758326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:35:12.830046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.733640+0000","last_change":"2024-04-15T15:32:48.753473+0000","last_active":"2024-04-15T15:32:49.733640+0000","last_peered":"2024-04-15T15:32:49.733640+0000","last_clean":"2024-04-15T15:32:49.733640+0000","last_became_active":"2024-04-15T15:32:48.753231+0000","last_became_peered":"2024-04-15T15:32:48.753231+0000","last_unstale":"2024-04-15T15:32:49.733640+0000","last_undegraded":"2024-04-15T15:32:49.733640+0000","last_fullsized":"2024-04-15T15:32:49.733640+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:26:26.845147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754635+0000","last_change":"2024-04-15T15:32:49.749879+0000","last_active":"2024-04-15T15:32:49.754635+0000","last_peered":"2024-04-15T15:32:49.754635+0000","last_clean":"2024-04-15T15:32:49.754635+0000","last_became_active":"2024-04-15T15:32:49.749641+0000","last_became_peered":"2024-04-15T15:32:49.749641+0000","last_unstale":"2024-04-15T15:32:49.754635+0000","last_undegraded":"2024-04-15T15:32:49.754635+0000","last_fullsized":"2024-04-15T15:32:49.754635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:26:27.851809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.726363+0000","last_change":"2024-04-15T15:32:48.749804+0000","last_active":"2024-04-15T15:32:49.726363+0000","last_peered":"2024-04-15T15:32:49.726363+0000","last_clean":"2024-04-15T15:32:49.726363+0000","last_became_active":"2024-04-15T15:32:48.749494+0000","last_became_peered":"2024-04-15T15:32:48.749494+0000","last_unstale":"2024-04-15T15:32:49.726363+0000","last_undegraded":"2024-04-15T15:32:49.726363+0000","last_fullsized":"2024-04-15T15:32:49.726363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:32:59.564976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761328+0000","last_change":"2024-04-15T15:32:49.759926+0000","last_active":"2024-04-15T15:32:49.761328+0000","last_peered":"2024-04-15T15:32:49.761328+0000","last_clean":"2024-04-15T15:32:49.761328+0000","last_became_active":"2024-04-15T15:32:49.759651+0000","last_became_peered":"2024-04-15T15:32:49.759651+0000","last_unstale":"2024-04-15T15:32:49.761328+0000","last_undegraded":"2024-04-15T15:32:49.761328+0000","last_fullsized":"2024-04-15T15:32:49.761328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:33:00.571639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771161+0000","last_change":"2024-04-15T15:32:48.744992+0000","last_active":"2024-04-15T15:32:49.771161+0000","last_peered":"2024-04-15T15:32:49.771161+0000","last_clean":"2024-04-15T15:32:49.771161+0000","last_became_active":"2024-04-15T15:32:48.744672+0000","last_became_peered":"2024-04-15T15:32:48.744672+0000","last_unstale":"2024-04-15T15:32:49.771161+0000","last_undegraded":"2024-04-15T15:32:49.771161+0000","last_fullsized":"2024-04-15T15:32:49.771161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:22.801586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754245+0000","last_change":"2024-04-15T15:32:49.750852+0000","last_active":"2024-04-15T15:32:49.754245+0000","last_peered":"2024-04-15T15:32:49.754245+0000","last_clean":"2024-04-15T15:32:49.754245+0000","last_became_active":"2024-04-15T15:32:49.750597+0000","last_became_peered":"2024-04-15T15:32:49.750597+0000","last_unstale":"2024-04-15T15:32:49.754245+0000","last_undegraded":"2024-04-15T15:32:49.754245+0000","last_fullsized":"2024-04-15T15:32:49.754245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:05.677330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.775286+0000","last_change":"2024-04-15T15:32:48.751602+0000","last_active":"2024-04-15T15:32:49.775286+0000","last_peered":"2024-04-15T15:32:49.775286+0000","last_clean":"2024-04-15T15:32:49.775286+0000","last_became_active":"2024-04-15T15:32:48.751318+0000","last_became_peered":"2024-04-15T15:32:48.751318+0000","last_unstale":"2024-04-15T15:32:49.775286+0000","last_undegraded":"2024-04-15T15:32:49.775286+0000","last_fullsized":"2024-04-15T15:32:49.775286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:04.670668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.752504+0000","last_change":"2024-04-15T15:32:49.747351+0000","last_active":"2024-04-15T15:32:49.752504+0000","last_peered":"2024-04-15T15:32:49.752504+0000","last_clean":"2024-04-15T15:32:49.752504+0000","last_became_active":"2024-04-15T15:32:49.747083+0000","last_became_peered":"2024-04-15T15:32:49.747083+0000","last_unstale":"2024-04-15T15:32:49.752504+0000","last_undegraded":"2024-04-15T15:32:49.752504+0000","last_fullsized":"2024-04-15T15:32:49.752504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:56:42.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.765230+0000","last_change":"2024-04-15T15:32:48.752305+0000","last_active":"2024-04-15T15:32:49.765230+0000","last_peered":"2024-04-15T15:32:49.765230+0000","last_clean":"2024-04-15T15:32:49.765230+0000","last_became_active":"2024-04-15T15:32:48.752034+0000","last_became_peered":"2024-04-15T15:32:48.752034+0000","last_unstale":"2024-04-15T15:32:49.765230+0000","last_undegraded":"2024-04-15T15:32:49.765230+0000","last_fullsized":"2024-04-15T15:32:49.765230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:47:23.414487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.746656+0000","last_change":"2024-04-15T15:32:49.740285+0000","last_active":"2024-04-15T15:32:49.746656+0000","last_peered":"2024-04-15T15:32:49.746656+0000","last_clean":"2024-04-15T15:32:49.746656+0000","last_became_active":"2024-04-15T15:32:49.740003+0000","last_became_peered":"2024-04-15T15:32:49.740003+0000","last_unstale":"2024-04-15T15:32:49.746656+0000","last_undegraded":"2024-04-15T15:32:49.746656+0000","last_fullsized":"2024-04-15T15:32:49.746656+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:18:06.850353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.737094+0000","last_change":"2024-04-15T15:32:48.747245+0000","last_active":"2024-04-15T15:32:49.737094+0000","last_peered":"2024-04-15T15:32:49.737094+0000","last_clean":"2024-04-15T15:32:49.737094+0000","last_became_active":"2024-04-15T15:32:48.746952+0000","last_became_peered":"2024-04-15T15:32:48.746952+0000","last_unstale":"2024-04-15T15:32:49.737094+0000","last_undegraded":"2024-04-15T15:32:49.737094+0000","last_fullsized":"2024-04-15T15:32:49.737094+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:02.383398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.755350+0000","last_change":"2024-04-15T15:32:49.737161+0000","last_active":"2024-04-15T15:32:49.755350+0000","last_peered":"2024-04-15T15:32:49.755350+0000","last_clean":"2024-04-15T15:32:49.755350+0000","last_became_active":"2024-04-15T15:32:49.736885+0000","last_became_peered":"2024-04-15T15:32:49.736885+0000","last_unstale":"2024-04-15T15:32:49.755350+0000","last_undegraded":"2024-04-15T15:32:49.755350+0000","last_fullsized":"2024-04-15T15:32:49.755350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:55.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.733888+0000","last_change":"2024-04-15T15:32:48.740735+0000","last_active":"2024-04-15T15:32:49.733888+0000","last_peered":"2024-04-15T15:32:49.733888+0000","last_clean":"2024-04-15T15:32:49.733888+0000","last_became_active":"2024-04-15T15:32:48.740512+0000","last_became_peered":"2024-04-15T15:32:48.740512+0000","last_unstale":"2024-04-15T15:32:49.733888+0000","last_undegraded":"2024-04-15T15:32:49.733888+0000","last_fullsized":"2024-04-15T15:32:49.733888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:53.405485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.747826+0000","last_change":"2024-04-15T15:32:49.743344+0000","last_active":"2024-04-15T15:32:49.747826+0000","last_peered":"2024-04-15T15:32:49.747826+0000","last_clean":"2024-04-15T15:32:49.747826+0000","last_became_active":"2024-04-15T15:32:49.742921+0000","last_became_peered":"2024-04-15T15:32:49.742921+0000","last_unstale":"2024-04-15T15:32:49.747826+0000","last_undegraded":"2024-04-15T15:32:49.747826+0000","last_fullsized":"2024-04-15T15:32:49.747826+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:56:56.655030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.766883+0000","last_change":"2024-04-15T15:32:48.747162+0000","last_active":"2024-04-15T15:32:49.766883+0000","last_peered":"2024-04-15T15:32:49.766883+0000","last_clean":"2024-04-15T15:32:49.766883+0000","last_became_active":"2024-04-15T15:32:48.746877+0000","last_became_peered":"2024-04-15T15:32:48.746877+0000","last_unstale":"2024-04-15T15:32:49.766883+0000","last_undegraded":"2024-04-15T15:32:49.766883+0000","last_fullsized":"2024-04-15T15:32:49.766883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:16:39.839599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.752505+0000","last_change":"2024-04-15T15:32:49.748081+0000","last_active":"2024-04-15T15:32:49.752505+0000","last_peered":"2024-04-15T15:32:49.752505+0000","last_clean":"2024-04-15T15:32:49.752505+0000","last_became_active":"2024-04-15T15:32:49.747915+0000","last_became_peered":"2024-04-15T15:32:49.747915+0000","last_unstale":"2024-04-15T15:32:49.752505+0000","last_undegraded":"2024-04-15T15:32:49.752505+0000","last_fullsized":"2024-04-15T15:32:49.752505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:03:48.949919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771492+0000","last_change":"2024-04-15T15:32:48.739587+0000","last_active":"2024-04-15T15:32:49.771492+0000","last_peered":"2024-04-15T15:32:49.771492+0000","last_clean":"2024-04-15T15:32:49.771492+0000","last_became_active":"2024-04-15T15:32:48.739302+0000","last_became_peered":"2024-04-15T15:32:48.739302+0000","last_unstale":"2024-04-15T15:32:49.771492+0000","last_undegraded":"2024-04-15T15:32:49.771492+0000","last_fullsized":"2024-04-15T15:32:49.771492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:56:41.169728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761303+0000","last_change":"2024-04-15T15:32:49.749733+0000","last_active":"2024-04-15T15:32:49.761303+0000","last_peered":"2024-04-15T15:32:49.761303+0000","last_clean":"2024-04-15T15:32:49.761303+0000","last_became_active":"2024-04-15T15:32:49.749444+0000","last_became_peered":"2024-04-15T15:32:49.749444+0000","last_unstale":"2024-04-15T15:32:49.761303+0000","last_undegraded":"2024-04-15T15:32:49.761303+0000","last_fullsized":"2024-04-15T15:32:49.761303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:01:47.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771936+0000","last_change":"2024-04-15T15:32:48.744465+0000","last_active":"2024-04-15T15:32:49.771936+0000","last_peered":"2024-04-15T15:32:49.771936+0000","last_clean":"2024-04-15T15:32:49.771936+0000","last_became_active":"2024-04-15T15:32:48.743671+0000","last_became_peered":"2024-04-15T15:32:48.743671+0000","last_unstale":"2024-04-15T15:32:49.771936+0000","last_undegraded":"2024-04-15T15:32:49.771936+0000","last_fullsized":"2024-04-15T15:32:49.771936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.574398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.743859+0000","last_change":"2024-04-15T15:32:49.742424+0000","last_active":"2024-04-15T15:32:49.743859+0000","last_peered":"2024-04-15T15:32:49.743859+0000","last_clean":"2024-04-15T15:32:49.743859+0000","last_became_active":"2024-04-15T15:32:49.742155+0000","last_became_peered":"2024-04-15T15:32:49.742155+0000","last_unstale":"2024-04-15T15:32:49.743859+0000","last_undegraded":"2024-04-15T15:32:49.743859+0000","last_fullsized":"2024-04-15T15:32:49.743859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:16:40.846261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.767488+0000","last_change":"2024-04-15T15:32:48.740895+0000","last_active":"2024-04-15T15:32:49.767488+0000","last_peered":"2024-04-15T15:32:49.767488+0000","last_clean":"2024-04-15T15:32:49.767488+0000","last_became_active":"2024-04-15T15:32:48.740520+0000","last_became_peered":"2024-04-15T15:32:48.740520+0000","last_unstale":"2024-04-15T15:32:49.767488+0000","last_undegraded":"2024-04-15T15:32:49.767488+0000","last_fullsized":"2024-04-15T15:32:49.767488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:27:42.252059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.744884+0000","last_change":"2024-04-15T15:32:49.739989+0000","last_active":"2024-04-15T15:32:49.744884+0000","last_peered":"2024-04-15T15:32:49.744884+0000","last_clean":"2024-04-15T15:32:49.744884+0000","last_became_active":"2024-04-15T15:32:49.739760+0000","last_became_peered":"2024-04-15T15:32:49.739760+0000","last_unstale":"2024-04-15T15:32:49.744884+0000","last_undegraded":"2024-04-15T15:32:49.744884+0000","last_fullsized":"2024-04-15T15:32:49.744884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:27:18.549424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.737471+0000","last_change":"2024-04-15T15:32:48.747992+0000","last_active":"2024-04-15T15:32:49.737471+0000","last_peered":"2024-04-15T15:32:49.737471+0000","last_clean":"2024-04-15T15:32:49.737471+0000","last_became_active":"2024-04-15T15:32:48.747762+0000","last_became_peered":"2024-04-15T15:32:48.747762+0000","last_unstale":"2024-04-15T15:32:49.737471+0000","last_undegraded":"2024-04-15T15:32:49.737471+0000","last_fullsized":"2024-04-15T15:32:49.737471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.574398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754601+0000","last_change":"2024-04-15T15:32:49.746848+0000","last_active":"2024-04-15T15:32:49.754601+0000","last_peered":"2024-04-15T15:32:49.754601+0000","last_clean":"2024-04-15T15:32:49.754601+0000","last_became_active":"2024-04-15T15:32:49.746533+0000","last_became_peered":"2024-04-15T15:32:49.746533+0000","last_unstale":"2024-04-15T15:32:49.754601+0000","last_undegraded":"2024-04-15T15:32:49.754601+0000","last_fullsized":"2024-04-15T15:32:49.754601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:23.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.763643+0000","last_change":"2024-04-15T15:32:48.735485+0000","last_active":"2024-04-15T15:32:49.763643+0000","last_peered":"2024-04-15T15:32:49.763643+0000","last_clean":"2024-04-15T15:32:49.763643+0000","last_became_active":"2024-04-15T15:32:48.734595+0000","last_became_peered":"2024-04-15T15:32:48.734595+0000","last_unstale":"2024-04-15T15:32:49.763643+0000","last_undegraded":"2024-04-15T15:32:49.763643+0000","last_fullsized":"2024-04-15T15:32:49.763643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:34:48.743687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.764660+0000","last_change":"2024-04-15T15:32:49.762453+0000","last_active":"2024-04-15T15:32:49.764660+0000","last_peered":"2024-04-15T15:32:49.764660+0000","last_clean":"2024-04-15T15:32:49.764660+0000","last_became_active":"2024-04-15T15:32:49.762211+0000","last_became_peered":"2024-04-15T15:32:49.762211+0000","last_unstale":"2024-04-15T15:32:49.764660+0000","last_undegraded":"2024-04-15T15:32:49.764660+0000","last_fullsized":"2024-04-15T15:32:49.764660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:47:24.421149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.725098+0000","last_change":"2024-04-15T15:32:48.744347+0000","last_active":"2024-04-15T15:32:49.725098+0000","last_peered":"2024-04-15T15:32:49.725098+0000","last_clean":"2024-04-15T15:32:49.725098+0000","last_became_active":"2024-04-15T15:32:48.743780+0000","last_became_peered":"2024-04-15T15:32:48.743780+0000","last_unstale":"2024-04-15T15:32:49.725098+0000","last_undegraded":"2024-04-15T15:32:49.725098+0000","last_fullsized":"2024-04-15T15:32:49.725098+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:03:16.510166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.761468+0000","last_change":"2024-04-15T15:32:49.754647+0000","last_active":"2024-04-15T15:32:49.761468+0000","last_peered":"2024-04-15T15:32:49.761468+0000","last_clean":"2024-04-15T15:32:49.761468+0000","last_became_active":"2024-04-15T15:32:49.754368+0000","last_became_peered":"2024-04-15T15:32:49.754368+0000","last_unstale":"2024-04-15T15:32:49.761468+0000","last_undegraded":"2024-04-15T15:32:49.761468+0000","last_fullsized":"2024-04-15T15:32:49.761468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:03:48.949919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.727660+0000","last_change":"2024-04-15T15:32:48.743784+0000","last_active":"2024-04-15T15:32:49.727660+0000","last_peered":"2024-04-15T15:32:49.727660+0000","last_clean":"2024-04-15T15:32:49.727660+0000","last_became_active":"2024-04-15T15:32:48.743488+0000","last_became_peered":"2024-04-15T15:32:48.743488+0000","last_unstale":"2024-04-15T15:32:49.727660+0000","last_undegraded":"2024-04-15T15:32:49.727660+0000","last_fullsized":"2024-04-15T15:32:49.727660+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:40.937337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754477+0000","last_change":"2024-04-15T15:32:49.752691+0000","last_active":"2024-04-15T15:32:49.754477+0000","last_peered":"2024-04-15T15:32:49.754477+0000","last_clean":"2024-04-15T15:32:49.754477+0000","last_became_active":"2024-04-15T15:32:49.751951+0000","last_became_peered":"2024-04-15T15:32:49.751951+0000","last_unstale":"2024-04-15T15:32:49.754477+0000","last_undegraded":"2024-04-15T15:32:49.754477+0000","last_fullsized":"2024-04-15T15:32:49.754477+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:14:37.396788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.725115+0000","last_change":"2024-04-15T15:32:48.733046+0000","last_active":"2024-04-15T15:32:49.725115+0000","last_peered":"2024-04-15T15:32:49.725115+0000","last_clean":"2024-04-15T15:32:49.725115+0000","last_became_active":"2024-04-15T15:32:48.732672+0000","last_became_peered":"2024-04-15T15:32:48.732672+0000","last_unstale":"2024-04-15T15:32:49.725115+0000","last_undegraded":"2024-04-15T15:32:49.725115+0000","last_fullsized":"2024-04-15T15:32:49.725115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:28.851099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.757863+0000","last_change":"2024-04-15T15:32:49.755674+0000","last_active":"2024-04-15T15:32:49.757863+0000","last_peered":"2024-04-15T15:32:49.757863+0000","last_clean":"2024-04-15T15:32:49.757863+0000","last_became_active":"2024-04-15T15:32:49.755398+0000","last_became_peered":"2024-04-15T15:32:49.755398+0000","last_unstale":"2024-04-15T15:32:49.757863+0000","last_undegraded":"2024-04-15T15:32:49.757863+0000","last_fullsized":"2024-04-15T15:32:49.757863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:23.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.771622+0000","last_change":"2024-04-15T15:32:48.746475+0000","last_active":"2024-04-15T15:32:49.771622+0000","last_peered":"2024-04-15T15:32:49.771622+0000","last_clean":"2024-04-15T15:32:49.771622+0000","last_became_active":"2024-04-15T15:32:48.746220+0000","last_became_peered":"2024-04-15T15:32:48.746220+0000","last_unstale":"2024-04-15T15:32:49.771622+0000","last_undegraded":"2024-04-15T15:32:49.771622+0000","last_fullsized":"2024-04-15T15:32:49.771622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:00:04.670668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.757947+0000","last_change":"2024-04-15T15:32:49.754576+0000","last_active":"2024-04-15T15:32:49.757947+0000","last_peered":"2024-04-15T15:32:49.757947+0000","last_clean":"2024-04-15T15:32:49.757947+0000","last_became_active":"2024-04-15T15:32:49.748031+0000","last_became_peered":"2024-04-15T15:32:49.748031+0000","last_unstale":"2024-04-15T15:32:49.757947+0000","last_undegraded":"2024-04-15T15:32:49.757947+0000","last_fullsized":"2024-04-15T15:32:49.757947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:18:06.850353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.725197+0000","last_change":"2024-04-15T15:32:48.738088+0000","last_active":"2024-04-15T15:32:49.725197+0000","last_peered":"2024-04-15T15:32:49.725197+0000","last_clean":"2024-04-15T15:32:49.725197+0000","last_became_active":"2024-04-15T15:32:48.737785+0000","last_became_peered":"2024-04-15T15:32:48.737785+0000","last_unstale":"2024-04-15T15:32:49.725197+0000","last_undegraded":"2024-04-15T15:32:49.725197+0000","last_fullsized":"2024-04-15T15:32:49.725197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:56:27.399631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.747860+0000","last_change":"2024-04-15T15:32:49.743999+0000","last_active":"2024-04-15T15:32:49.747860+0000","last_peered":"2024-04-15T15:32:49.747860+0000","last_clean":"2024-04-15T15:32:49.747860+0000","last_became_active":"2024-04-15T15:32:49.743572+0000","last_became_peered":"2024-04-15T15:32:49.743572+0000","last_unstale":"2024-04-15T15:32:49.747860+0000","last_undegraded":"2024-04-15T15:32:49.747860+0000","last_fullsized":"2024-04-15T15:32:49.747860+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:01:47.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.732766+0000","last_change":"2024-04-15T15:32:48.748274+0000","last_active":"2024-04-15T15:32:49.732766+0000","last_peered":"2024-04-15T15:32:49.732766+0000","last_clean":"2024-04-15T15:32:49.732766+0000","last_became_active":"2024-04-15T15:32:48.747940+0000","last_became_peered":"2024-04-15T15:32:48.747940+0000","last_unstale":"2024-04-15T15:32:49.732766+0000","last_undegraded":"2024-04-15T15:32:49.732766+0000","last_fullsized":"2024-04-15T15:32:49.732766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.574398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.742368+0000","last_change":"2024-04-15T15:32:49.737736+0000","last_active":"2024-04-15T15:32:49.742368+0000","last_peered":"2024-04-15T15:32:49.742368+0000","last_clean":"2024-04-15T15:32:49.742368+0000","last_became_active":"2024-04-15T15:32:49.737454+0000","last_became_peered":"2024-04-15T15:32:49.737454+0000","last_unstale":"2024-04-15T15:32:49.742368+0000","last_undegraded":"2024-04-15T15:32:49.742368+0000","last_fullsized":"2024-04-15T15:32:49.742368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:16:40.846261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.731865+0000","last_change":"2024-04-15T15:32:48.736503+0000","last_active":"2024-04-15T15:32:49.731865+0000","last_peered":"2024-04-15T15:32:49.731865+0000","last_clean":"2024-04-15T15:32:49.731865+0000","last_became_active":"2024-04-15T15:32:48.736210+0000","last_became_peered":"2024-04-15T15:32:48.736210+0000","last_unstale":"2024-04-15T15:32:49.731865+0000","last_undegraded":"2024-04-15T15:32:49.731865+0000","last_fullsized":"2024-04-15T15:32:49.731865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:46:18.228832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.750254+0000","last_change":"2024-04-15T15:32:49.746329+0000","last_active":"2024-04-15T15:32:49.750254+0000","last_peered":"2024-04-15T15:32:49.750254+0000","last_clean":"2024-04-15T15:32:49.750254+0000","last_became_active":"2024-04-15T15:32:49.746037+0000","last_became_peered":"2024-04-15T15:32:49.746037+0000","last_unstale":"2024-04-15T15:32:49.750254+0000","last_undegraded":"2024-04-15T15:32:49.750254+0000","last_fullsized":"2024-04-15T15:32:49.750254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:29:47.031910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.738951+0000","last_change":"2024-04-15T15:32:48.732043+0000","last_active":"2024-04-15T15:32:49.738951+0000","last_peered":"2024-04-15T15:32:49.738951+0000","last_clean":"2024-04-15T15:32:49.738951+0000","last_became_active":"2024-04-15T15:32:48.731703+0000","last_became_peered":"2024-04-15T15:32:48.731703+0000","last_unstale":"2024-04-15T15:32:49.738951+0000","last_undegraded":"2024-04-15T15:32:49.738951+0000","last_fullsized":"2024-04-15T15:32:49.738951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:43:02.383398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.743802+0000","last_change":"2024-04-15T15:32:49.741653+0000","last_active":"2024-04-15T15:32:49.743802+0000","last_peered":"2024-04-15T15:32:49.743802+0000","last_clean":"2024-04-15T15:32:49.743802+0000","last_became_active":"2024-04-15T15:32:49.741361+0000","last_became_peered":"2024-04-15T15:32:49.741361+0000","last_unstale":"2024-04-15T15:32:49.743802+0000","last_undegraded":"2024-04-15T15:32:49.743802+0000","last_fullsized":"2024-04-15T15:32:49.743802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:41.943999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.730723+0000","last_change":"2024-04-15T15:32:48.748049+0000","last_active":"2024-04-15T15:32:49.730723+0000","last_peered":"2024-04-15T15:32:49.730723+0000","last_clean":"2024-04-15T15:32:49.730723+0000","last_became_active":"2024-04-15T15:32:48.747719+0000","last_became_peered":"2024-04-15T15:32:48.747719+0000","last_unstale":"2024-04-15T15:32:49.730723+0000","last_undegraded":"2024-04-15T15:32:49.730723+0000","last_fullsized":"2024-04-15T15:32:49.730723+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:58:02.671290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.754695+0000","last_change":"2024-04-15T15:32:49.747968+0000","last_active":"2024-04-15T15:32:49.754695+0000","last_peered":"2024-04-15T15:32:49.754695+0000","last_clean":"2024-04-15T15:32:49.754695+0000","last_became_active":"2024-04-15T15:32:49.747678+0000","last_became_peered":"2024-04-15T15:32:49.747678+0000","last_unstale":"2024-04-15T15:32:49.754695+0000","last_undegraded":"2024-04-15T15:32:49.754695+0000","last_fullsized":"2024-04-15T15:32:49.754695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:33:00.571639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.730744+0000","last_change":"2024-04-15T15:32:48.749736+0000","last_active":"2024-04-15T15:32:49.730744+0000","last_peered":"2024-04-15T15:32:49.730744+0000","last_clean":"2024-04-15T15:32:49.730744+0000","last_became_active":"2024-04-15T15:32:48.749327+0000","last_became_peered":"2024-04-15T15:32:48.749327+0000","last_unstale":"2024-04-15T15:32:49.730744+0000","last_undegraded":"2024-04-15T15:32:49.730744+0000","last_fullsized":"2024-04-15T15:32:49.730744+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:32:59.564976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.759331+0000","last_change":"2024-04-15T15:32:49.740222+0000","last_active":"2024-04-15T15:32:49.759331+0000","last_peered":"2024-04-15T15:32:49.759331+0000","last_clean":"2024-04-15T15:32:49.759331+0000","last_became_active":"2024-04-15T15:32:49.739832+0000","last_became_peered":"2024-04-15T15:32:49.739832+0000","last_unstale":"2024-04-15T15:32:49.759331+0000","last_undegraded":"2024-04-15T15:32:49.759331+0000","last_fullsized":"2024-04-15T15:32:49.759331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:48.713587+0000","last_clean_scrub_stamp":"2024-04-15T15:32:48.713587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:59:06.769003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.728707+0000","last_change":"2024-04-15T15:32:48.743536+0000","last_active":"2024-04-15T15:32:49.728707+0000","last_peered":"2024-04-15T15:32:49.728707+0000","last_clean":"2024-04-15T15:32:49.728707+0000","last_became_active":"2024-04-15T15:32:48.743234+0000","last_became_peered":"2024-04-15T15:32:48.743234+0000","last_unstale":"2024-04-15T15:32:49.728707+0000","last_undegraded":"2024-04-15T15:32:49.728707+0000","last_fullsized":"2024-04-15T15:32:49.728707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:32:47.706925+0000","last_clean_scrub_stamp":"2024-04-15T15:32:47.706925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:29:46.025248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-15T15:32:49.727848+0000","last_change":"2024-04-15T15:31:23.443687+0000","last_active":"2024-04-15T15:32:49.727848+0000","last_peered":"2024-04-15T15:32:49.727848+0000","last_clean":"2024-04-15T15:32:49.727848+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:32:49.727848+0000","last_undegraded":"2024-04-15T15:32:49.727848+0000","last_fullsized":"2024-04-15T15:32:49.727848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_clean_scrub_stamp":"2024-04-15T15:31:22.092427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:28:43.096549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":780097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":188629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":188159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":446464,"data_stored":188651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":188117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":188137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":778449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:32:54.191 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-15T15:32:54.192 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-15T15:32:54.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa0a0600640 1 Processor -- start 2024-04-15T15:32:54.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa0a0600640 1 -- start start 2024-04-15T15:32:54.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa0a0600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa09815b5d0 0x7fa09815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa0a0600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0980b3e30 0x7fa0980b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa0a0600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa098070160 con 0x7fa0980b25f0 2024-04-15T15:32:54.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa0a0600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa09815b9b0 con 0x7fa0980b3e30 2024-04-15T15:32:54.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa0a0600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa09815f1f0 con 0x7fa09815b5d0 2024-04-15T15:32:54.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa09d200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0980b3e30 0x7fa0980b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa09d200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0980b3e30 0x7fa0980b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42930/0 (socket says 172.21.15.73:42930) 2024-04-15T15:32:54.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa09d200640 1 -- 172.21.15.73:0/1351294995 learned_addr learned my addr 172.21.15.73:0/1351294995 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:54.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa09dc00640 1 --2- 172.21.15.73:0/1351294995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa09815b5d0 0x7fa09815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa09d200640 1 -- 172.21.15.73:0/1351294995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa09815b5d0 msgr2=0x7fa09815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:54.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa09d200640 1 --2- 172.21.15.73:0/1351294995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa09815b5d0 0x7fa09815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa09d200640 1 -- 172.21.15.73:0/1351294995 >> v1:172.21.15.118:6789/0 conn(0x7fa0980b25f0 legacy=0x7fa0980b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.377+0000 7fa09d200640 1 -- 172.21.15.73:0/1351294995 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09806fe80 con 0x7fa0980b3e30 2024-04-15T15:32:54.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa09d200640 1 --2- 172.21.15.73:0/1351294995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0980b3e30 0x7fa0980b20b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa084009870 tx=0x7fa08401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7e77305d8f04ac server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:54.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa097e00640 1 -- 172.21.15.73:0/1351294995 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0840b0070 con 0x7fa0980b3e30 2024-04-15T15:32:54.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa097e00640 1 -- 172.21.15.73:0/1351294995 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0840ab600 con 0x7fa0980b3e30 2024-04-15T15:32:54.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa097e00640 1 -- 172.21.15.73:0/1351294995 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0840ab9d0 con 0x7fa0980b3e30 2024-04-15T15:32:54.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa0a0600640 1 -- 172.21.15.73:0/1351294995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0980b3e30 msgr2=0x7fa0980b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa0a0600640 1 --2- 172.21.15.73:0/1351294995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0980b3e30 0x7fa0980b20b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa084009870 tx=0x7fa08401c410 comp rx=0 tx=0).stop 2024-04-15T15:32:54.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa0a0600640 1 -- 172.21.15.73:0/1351294995 shutdown_connections 2024-04-15T15:32:54.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa0a0600640 1 --2- 172.21.15.73:0/1351294995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0980b3e30 0x7fa0980b20b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa0a0600640 1 --2- 172.21.15.73:0/1351294995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa09815b5d0 0x7fa09815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa0a0600640 1 -- 172.21.15.73:0/1351294995 >> 172.21.15.73:0/1351294995 conn(0x7fa098067dd0 msgr2=0x7fa0980d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:54.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa0a0600640 1 -- 172.21.15.73:0/1351294995 shutdown_connections 2024-04-15T15:32:54.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.381+0000 7fa0a0600640 1 -- 172.21.15.73:0/1351294995 wait complete. 2024-04-15T15:32:54.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa0a0600640 1 Processor -- start 2024-04-15T15:32:54.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa0a0600640 1 -- start start 2024-04-15T15:32:54.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa0a0600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0980b25f0 0x7fa09815e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa0a0600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0980b3e30 0x7fa0980ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa0a0600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa09815b5d0 0x7fa09814c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa0a0600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa09806faa0 con 0x7fa09815b5d0 2024-04-15T15:32:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa0a0600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa0980cfd00 con 0x7fa0980b25f0 2024-04-15T15:32:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa0a0600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa09806fc20 con 0x7fa0980b3e30 2024-04-15T15:32:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09e600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa09815b5d0 0x7fa09814c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09e600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa09815b5d0 0x7fa09814c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42940/0 (socket says 172.21.15.73:42940) 2024-04-15T15:32:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09e600640 1 -- 172.21.15.73:0/1167971009 learned_addr learned my addr 172.21.15.73:0/1167971009 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09dc00640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0980b25f0 0x7fa09815e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09d200640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0980b3e30 0x7fa0980ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09e600640 1 -- 172.21.15.73:0/1167971009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0980b3e30 msgr2=0x7fa0980ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09e600640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0980b3e30 0x7fa0980ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09e600640 1 -- 172.21.15.73:0/1167971009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0980b25f0 msgr2=0x7fa09815e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09e600640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0980b25f0 0x7fa09815e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09e600640 1 -- 172.21.15.73:0/1167971009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09814a820 con 0x7fa09815b5d0 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa09e600640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa09815b5d0 0x7fa09814c7c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa09000c340 tx=0x7fa09000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa095600640 1 -- 172.21.15.73:0/1167971009 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090005220 con 0x7fa09815b5d0 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa095600640 1 -- 172.21.15.73:0/1167971009 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0900053c0 con 0x7fa09815b5d0 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa095600640 1 -- 172.21.15.73:0/1167971009 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090007270 con 0x7fa09815b5d0 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa0a0600640 1 -- 172.21.15.73:0/1167971009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09814ab00 con 0x7fa09815b5d0 2024-04-15T15:32:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.385+0000 7fa0a0600640 1 -- 172.21.15.73:0/1167971009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09814b0c0 con 0x7fa09815b5d0 2024-04-15T15:32:54.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.389+0000 7fa0a0600640 1 -- 172.21.15.73:0/1167971009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa098068ab0 con 0x7fa09815b5d0 2024-04-15T15:32:54.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.389+0000 7fa095600640 1 -- 172.21.15.73:0/1167971009 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa090019020 con 0x7fa09815b5d0 2024-04-15T15:32:54.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.389+0000 7fa095600640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa078068380 0x7fa07806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.389+0000 7fa095600640 1 -- 172.21.15.73:0/1167971009 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa090085c60 con 0x7fa09815b5d0 2024-04-15T15:32:54.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.389+0000 7fa09dc00640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa078068380 0x7fa07806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.389+0000 7fa09dc00640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa078068380 0x7fa07806a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0980b25c0 tx=0x7fa08c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.393+0000 7fa095600640 1 -- 172.21.15.73:0/1167971009 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa090055ad0 con 0x7fa09815b5d0 2024-04-15T15:32:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.609+0000 7fa0a0600640 1 -- 172.21.15.73:0/1167971009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa0980d06b0 con 0x7fa09815b5d0 2024-04-15T15:32:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa095600640 1 -- 172.21.15.73:0/1167971009 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fa090059dd0 con 0x7fa09815b5d0 2024-04-15T15:32:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-04-15T15:32:54.613 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAbSB1mysrBMRAASR9v0p/QS/vXby5B449DsA== 2024-04-15T15:32:54.613 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2024-04-15T15:32:54.613 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2024-04-15T15:32:54.613 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-15T15:32:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2024-04-15T15:32:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 -- 172.21.15.73:0/1167971009 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa078068380 msgr2=0x7fa07806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa078068380 0x7fa07806a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0980b25c0 tx=0x7fa08c00b040 comp rx=0 tx=0).stop 2024-04-15T15:32:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 -- 172.21.15.73:0/1167971009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa09815b5d0 msgr2=0x7fa09814c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa09815b5d0 0x7fa09814c7c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa09000c340 tx=0x7fa09000c800 comp rx=0 tx=0).stop 2024-04-15T15:32:54.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 -- 172.21.15.73:0/1167971009 shutdown_connections 2024-04-15T15:32:54.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa09815b5d0 0x7fa09814c7c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa078068380 0x7fa07806a840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0980b3e30 0x7fa0980ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 --2- 172.21.15.73:0/1167971009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0980b25f0 0x7fa09815e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 -- 172.21.15.73:0/1167971009 >> 172.21.15.73:0/1167971009 conn(0x7fa098067dd0 msgr2=0x7fa0980b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:54.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 -- 172.21.15.73:0/1167971009 shutdown_connections 2024-04-15T15:32:54.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.613+0000 7fa0a0600640 1 -- 172.21.15.73:0/1167971009 wait complete. 2024-04-15T15:32:54.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:32:54.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.769+0000 7ffb04400640 1 Processor -- start 2024-04-15T15:32:54.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.769+0000 7ffb04400640 1 -- start start 2024-04-15T15:32:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb04400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc0b20b0 0x7ffafc0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb04400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffafc15cbd0 0x7ffafc15d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb04400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffafc0cd3a0 con 0x7ffafc146110 2024-04-15T15:32:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb04400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ffafc0b5160 con 0x7ffafc15cbd0 2024-04-15T15:32:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb04400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc0b40c0 con 0x7ffafc0b20b0 2024-04-15T15:32:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb02400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffafc15cbd0 0x7ffafc15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb01000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc0b20b0 0x7ffafc0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb01000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc0b20b0 0x7ffafc0b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:40180/0 (socket says 172.21.15.73:40180) 2024-04-15T15:32:54.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb01000640 1 -- 172.21.15.73:0/626353226 learned_addr learned my addr 172.21.15.73:0/626353226 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb02400640 1 -- 172.21.15.73:0/626353226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc0b20b0 msgr2=0x7ffafc0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb02400640 1 --2- 172.21.15.73:0/626353226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc0b20b0 0x7ffafc0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb02400640 1 -- 172.21.15.73:0/626353226 >> v1:172.21.15.118:6789/0 conn(0x7ffafc146110 legacy=0x7ffafc0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb02400640 1 -- 172.21.15.73:0/626353226 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc0b43a0 con 0x7ffafc15cbd0 2024-04-15T15:32:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.773+0000 7ffb01000640 1 --2- 172.21.15.73:0/626353226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc0b20b0 0x7ffafc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:54.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb02400640 1 --2- 172.21.15.73:0/626353226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffafc15cbd0 0x7ffafc15d060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009d90 tx=0x7ffaf401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52aeb226cbaacfaf server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:54.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffafbe00640 1 -- 172.21.15.73:0/626353226 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40b2070 con 0x7ffafc15cbd0 2024-04-15T15:32:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffafbe00640 1 -- 172.21.15.73:0/626353226 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf40a5920 con 0x7ffafc15cbd0 2024-04-15T15:32:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffafbe00640 1 -- 172.21.15.73:0/626353226 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40a5cf0 con 0x7ffafc15cbd0 2024-04-15T15:32:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb04400640 1 -- 172.21.15.73:0/626353226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffafc15cbd0 msgr2=0x7ffafc15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb04400640 1 --2- 172.21.15.73:0/626353226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffafc15cbd0 0x7ffafc15d060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009d90 tx=0x7ffaf401c970 comp rx=0 tx=0).stop 2024-04-15T15:32:54.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb04400640 1 -- 172.21.15.73:0/626353226 shutdown_connections 2024-04-15T15:32:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb04400640 1 --2- 172.21.15.73:0/626353226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffafc15cbd0 0x7ffafc15d060 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb04400640 1 --2- 172.21.15.73:0/626353226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc0b20b0 0x7ffafc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb04400640 1 -- 172.21.15.73:0/626353226 >> 172.21.15.73:0/626353226 conn(0x7ffafc067dd0 msgr2=0x7ffafc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb04400640 1 -- 172.21.15.73:0/626353226 shutdown_connections 2024-04-15T15:32:54.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb04400640 1 -- 172.21.15.73:0/626353226 wait complete. 2024-04-15T15:32:54.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb04400640 1 Processor -- start 2024-04-15T15:32:54.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.777+0000 7ffb04400640 1 -- start start 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb04400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffafc0b20b0 0x7ffafc0b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb04400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc146110 0x7ffafc15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb04400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffafc15cbd0 0x7ffafc15f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb04400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc169210 con 0x7ffafc0b20b0 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb04400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc0b3d70 con 0x7ffafc15cbd0 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb04400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc169390 con 0x7ffafc146110 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb01a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffafc0b20b0 0x7ffafc0b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb01a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffafc0b20b0 0x7ffafc0b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42954/0 (socket says 172.21.15.73:42954) 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb01a00640 1 -- 172.21.15.73:0/3877386164 learned_addr learned my addr 172.21.15.73:0/3877386164 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb02400640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffafc15cbd0 0x7ffafc15f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb01000640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc146110 0x7ffafc15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb01a00640 1 -- 172.21.15.73:0/3877386164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc146110 msgr2=0x7ffafc15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb01a00640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc146110 0x7ffafc15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb01a00640 1 -- 172.21.15.73:0/3877386164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffafc15cbd0 msgr2=0x7ffafc15f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb01a00640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffafc15cbd0 0x7ffafc15f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb01a00640 1 -- 172.21.15.73:0/3877386164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc0b5840 con 0x7ffafc0b20b0 2024-04-15T15:32:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb01a00640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffafc0b20b0 0x7ffafc0b0de0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000c450 tx=0x7ffaf000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffaf9600640 1 -- 172.21.15.73:0/3877386164 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0016020 con 0x7ffafc0b20b0 2024-04-15T15:32:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffaf9600640 1 -- 172.21.15.73:0/3877386164 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf00052d0 con 0x7ffafc0b20b0 2024-04-15T15:32:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffaf9600640 1 -- 172.21.15.73:0/3877386164 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0007260 con 0x7ffafc0b20b0 2024-04-15T15:32:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb04400640 1 -- 172.21.15.73:0/3877386164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffafc0b1630 con 0x7ffafc0b20b0 2024-04-15T15:32:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb04400640 1 -- 172.21.15.73:0/3877386164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffafc0b1bf0 con 0x7ffafc0b20b0 2024-04-15T15:32:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffb04400640 1 -- 172.21.15.73:0/3877386164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffafc068ab0 con 0x7ffafc0b20b0 2024-04-15T15:32:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.781+0000 7ffaf9600640 1 -- 172.21.15.73:0/3877386164 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffaf0007400 con 0x7ffafc0b20b0 2024-04-15T15:32:54.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.785+0000 7ffaf9600640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ffadc068380 0x7ffadc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:54.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.785+0000 7ffaf9600640 1 -- 172.21.15.73:0/3877386164 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ffaf00863f0 con 0x7ffafc0b20b0 2024-04-15T15:32:54.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.785+0000 7ffb01000640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ffadc068380 0x7ffadc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:54.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.785+0000 7ffb01000640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ffadc068380 0x7ffadc06a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffafc1f88d0 tx=0x7ffae8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.789+0000 7ffaf9600640 1 -- 172.21.15.73:0/3877386164 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffaf0020020 con 0x7ffafc0b20b0 2024-04-15T15:32:54.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.977+0000 7ffb04400640 1 -- 172.21.15.73:0/3877386164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffafc15e5f0 con 0x7ffafc0b20b0 2024-04-15T15:32:54.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.977+0000 7ffaf9600640 1 -- 172.21.15.73:0/3877386164 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5187 (secure 0 0 0) 0x7ffaf0005480 con 0x7ffafc0b20b0 2024-04-15T15:32:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:54.978 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5322,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1374015509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1374015509},{"type":"v1","addr":"172.21.15.73:6836","nonce":1374015509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:32:49.112134+0000","modified":"2024-04-15T15:32:52.124603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/2635966606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2635966606},{"type":"v1","addr":"172.21.15.118:6834","nonce":2635966606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":2}]} 2024-04-15T15:32:54.979 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 18 2024-04-15T15:32:54.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 -- 172.21.15.73:0/3877386164 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ffadc068380 msgr2=0x7ffadc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ffadc068380 0x7ffadc06a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffafc1f88d0 tx=0x7ffae8009240 comp rx=0 tx=0).stop 2024-04-15T15:32:54.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 -- 172.21.15.73:0/3877386164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffafc0b20b0 msgr2=0x7ffafc0b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:54.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffafc0b20b0 0x7ffafc0b0de0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000c450 tx=0x7ffaf000c910 comp rx=0 tx=0).stop 2024-04-15T15:32:54.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 -- 172.21.15.73:0/3877386164 shutdown_connections 2024-04-15T15:32:54.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffafc15cbd0 0x7ffafc15f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ffadc068380 0x7ffadc06a840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffafc146110 0x7ffafc15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 --2- 172.21.15.73:0/3877386164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffafc0b20b0 0x7ffafc0b0de0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:54.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 -- 172.21.15.73:0/3877386164 >> 172.21.15.73:0/3877386164 conn(0x7ffafc067dd0 msgr2=0x7ffafc13d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:54.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 -- 172.21.15.73:0/3877386164 shutdown_connections 2024-04-15T15:32:54.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:54.981+0000 7ffb04400640 1 -- 172.21.15.73:0/3877386164 wait complete. 2024-04-15T15:32:55.404 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T15:32:49.112134+0000', 'modified': '2024-04-15T15:32:52.124603+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5328}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5328': {'gid': 5328, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6834/2635966606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6832', 'nonce': 2635966606}, {'type': 'v1', 'addr': '172.21.15.118:6834', 'nonce': 2635966606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5328, 'qdb_cluster': [5328]} 2024-04-15T15:32:55.404 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-15T15:32:55.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-15T15:32:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f67e00640 1 Processor -- start 2024-04-15T15:32:55.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f67e00640 1 -- start start 2024-04-15T15:32:55.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f67e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f680cf390 0x7f4f6815f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f67e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4f6806e690 0x7f4f6815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f67e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f680cf770 con 0x7f4f680cff10 2024-04-15T15:32:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f67e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4f68162290 con 0x7f4f6806e690 2024-04-15T15:32:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f67e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4f68162550 con 0x7f4f680cf390 2024-04-15T15:32:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f67400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4f680cff10 0x7f4f6806d010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58632/0 (socket says 172.21.15.73:58632) 2024-04-15T15:32:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f67400640 1 -- 172.21.15.73:0/4087234540 learned_addr learned my addr 172.21.15.73:0/4087234540 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f66000640 1 --2- 172.21.15.73:0/4087234540 >> v2:172.21.15.73:3300/0 conn(0x7f4f6806e690 0x7f4f6815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f66a00640 1 --2- 172.21.15.73:0/4087234540 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f680cf390 0x7f4f6815f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f65600640 1 -- 172.21.15.73:0/4087234540 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776289584 0 0) 0x7f4f680cf770 con 0x7f4f680cff10 2024-04-15T15:32:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f65600640 1 -- 172.21.15.73:0/4087234540 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f4c003530 con 0x7f4f680cff10 2024-04-15T15:32:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f66000640 1 -- 172.21.15.73:0/4087234540 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f680cf390 msgr2=0x7f4f6815f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f66000640 1 --2- 172.21.15.73:0/4087234540 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f680cf390 0x7f4f6815f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f66000640 1 -- 172.21.15.73:0/4087234540 >> v1:172.21.15.73:6789/0 conn(0x7f4f680cff10 legacy=0x7f4f6806d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f66000640 1 -- 172.21.15.73:0/4087234540 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f68162830 con 0x7f4f6806e690 2024-04-15T15:32:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.541+0000 7f4f66a00640 1 --2- 172.21.15.73:0/4087234540 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f680cf390 0x7f4f6815f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f66000640 1 --2- 172.21.15.73:0/4087234540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6806e690 0x7f4f6815fc60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097c0 tx=0x7f4f5401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad7a5fa5c47f6c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f65600640 1 -- 172.21.15.73:0/4087234540 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f540a7070 con 0x7f4f6806e690 2024-04-15T15:32:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f65600640 1 -- 172.21.15.73:0/4087234540 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f540b0070 con 0x7f4f6806e690 2024-04-15T15:32:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f65600640 1 -- 172.21.15.73:0/4087234540 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f540ab870 con 0x7f4f6806e690 2024-04-15T15:32:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f67e00640 1 -- 172.21.15.73:0/4087234540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6806e690 msgr2=0x7f4f6815fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f67e00640 1 --2- 172.21.15.73:0/4087234540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6806e690 0x7f4f6815fc60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097c0 tx=0x7f4f5401c470 comp rx=0 tx=0).stop 2024-04-15T15:32:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f67e00640 1 -- 172.21.15.73:0/4087234540 shutdown_connections 2024-04-15T15:32:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f67e00640 1 --2- 172.21.15.73:0/4087234540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6806e690 0x7f4f6815fc60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f67e00640 1 --2- 172.21.15.73:0/4087234540 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f680cf390 0x7f4f6815f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f67e00640 1 -- 172.21.15.73:0/4087234540 >> 172.21.15.73:0/4087234540 conn(0x7f4f6806ba50 msgr2=0x7f4f6806be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f67e00640 1 -- 172.21.15.73:0/4087234540 shutdown_connections 2024-04-15T15:32:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.545+0000 7f4f67e00640 1 -- 172.21.15.73:0/4087234540 wait complete. 2024-04-15T15:32:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67e00640 1 Processor -- start 2024-04-15T15:32:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67e00640 1 -- start start 2024-04-15T15:32:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f6806e690 0x7f4f68154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f680cf390 0x7f4f681502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f680cff10 0x7f4f68150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4f680d0730 con 0x7f4f680cff10 2024-04-15T15:32:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4f68161230 con 0x7f4f680cf390 2024-04-15T15:32:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4f680cad10 con 0x7f4f6806e690 2024-04-15T15:32:55.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f680cff10 0x7f4f68150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f680cff10 0x7f4f68150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42968/0 (socket says 172.21.15.73:42968) 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67400640 1 -- 172.21.15.73:0/893577744 learned_addr learned my addr 172.21.15.73:0/893577744 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f66000640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f680cf390 0x7f4f681502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f66a00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f6806e690 0x7f4f68154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67400640 1 -- 172.21.15.73:0/893577744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f6806e690 msgr2=0x7f4f68154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67400640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f6806e690 0x7f4f68154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67400640 1 -- 172.21.15.73:0/893577744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f680cf390 msgr2=0x7f4f681502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67400640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f680cf390 0x7f4f681502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67400640 1 -- 172.21.15.73:0/893577744 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f680ca100 con 0x7f4f680cff10 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f66a00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f6806e690 0x7f4f68154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67400640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f680cff10 0x7f4f68150820 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000c3f0 tx=0x7f4f6000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:55.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f5ea00640 1 -- 172.21.15.73:0/893577744 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60017070 con 0x7f4f680cff10 2024-04-15T15:32:55.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f5ea00640 1 -- 172.21.15.73:0/893577744 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f60005cf0 con 0x7f4f680cff10 2024-04-15T15:32:55.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f5ea00640 1 -- 172.21.15.73:0/893577744 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60007310 con 0x7f4f680cff10 2024-04-15T15:32:55.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67e00640 1 -- 172.21.15.73:0/893577744 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f680ca3e0 con 0x7f4f680cff10 2024-04-15T15:32:55.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.549+0000 7f4f67e00640 1 -- 172.21.15.73:0/893577744 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f680ca9a0 con 0x7f4f680cff10 2024-04-15T15:32:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f5ea00640 1 -- 172.21.15.73:0/893577744 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f600074b0 con 0x7f4f680cff10 2024-04-15T15:32:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f5ea00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4f48068380 0x7f4f4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f5ea00640 1 -- 172.21.15.73:0/893577744 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4f60085f60 con 0x7f4f680cff10 2024-04-15T15:32:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f70bca000 1 Processor -- start 2024-04-15T15:32:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f66a00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4f48068380 0x7f4f4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f70bca000 1 -- start start 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f66a00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4f48068380 0x7f4f4806a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009b40 tx=0x7f4f58003a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462d7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 0x56024628b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x56024628b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f70bca000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5602460dc290 con 0x5602462d78e0 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f70bca000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x560246077bd0 con 0x5602462d8200 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.553+0000 7f4f70bca000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x5602460d8250 con 0x56024628b5e0 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f66a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462d7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f66a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462d7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42982/0 (socket says 172.21.15.73:42982) 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f66a00640 1 -- 172.21.15.73:0/273232258 learned_addr learned my addr 172.21.15.73:0/273232258 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f67400640 1 --2- 172.21.15.73:0/273232258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x56024628b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f66000640 1 --2- 172.21.15.73:0/273232258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 0x56024628b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f66a00640 1 -- 172.21.15.73:0/273232258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 msgr2=0x56024628b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f66a00640 1 --2- 172.21.15.73:0/273232258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x56024628b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f66a00640 1 -- 172.21.15.73:0/273232258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 msgr2=0x56024628b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:55.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f66a00640 1 --2- 172.21.15.73:0/273232258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 0x56024628b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f66a00640 1 -- 172.21.15.73:0/273232258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560246121520 con 0x5602462d78e0 2024-04-15T15:32:55.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f66a00640 1 --2- 172.21.15.73:0/273232258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462d7cc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4f58016520 tx=0x7f4f58012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9454fe895ed453f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:55.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f53400640 1 -- 172.21.15.73:0/273232258 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58026070 con 0x5602462d78e0 2024-04-15T15:32:55.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f53400640 1 -- 172.21.15.73:0/273232258 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f580148a0 con 0x5602462d78e0 2024-04-15T15:32:55.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f53400640 1 -- 172.21.15.73:0/273232258 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58014c90 con 0x5602462d78e0 2024-04-15T15:32:55.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 -- 172.21.15.73:0/273232258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 msgr2=0x5602462d7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 --2- 172.21.15.73:0/273232258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462d7cc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4f58016520 tx=0x7f4f58012000 comp rx=0 tx=0).stop 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 -- 172.21.15.73:0/273232258 shutdown_connections 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 --2- 172.21.15.73:0/273232258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x56024628b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 --2- 172.21.15.73:0/273232258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 0x56024628b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 --2- 172.21.15.73:0/273232258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462d7cc0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 -- 172.21.15.73:0/273232258 >> 172.21.15.73:0/273232258 conn(0x560246175510 msgr2=0x5602462ba8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 -- 172.21.15.73:0/273232258 shutdown_connections 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 -- 172.21.15.73:0/273232258 wait complete. 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 -- start start 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 Processor -- start 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.557+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x5602462dec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462df180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 0x560246298270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x560246098530 con 0x5602462d78e0 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x560246296a30 con 0x5602462d8200 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x560246177bd0 con 0x56024628b5e0 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 10 client.0 _ll_register_callbacks cb 0x560246278fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462df180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42992/0 (socket says 172.21.15.73:42992) 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66000640 1 -- 172.21.15.73:0/1683870334 learned_addr learned my addr 172.21.15.73:0/1683870334 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f67400640 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 0x560246298270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66a00640 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x5602462dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66000640 1 -- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 msgr2=0x5602462dec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66000640 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x5602462dec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66000640 1 -- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 msgr2=0x560246298270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66000640 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 0x560246298270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66000640 1 -- 172.21.15.73:0/1683870334 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56024607f940 con 0x5602462d78e0 2024-04-15T15:32:55.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f67400640 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 0x560246298270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66000640 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462df180 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097c0 tx=0x7f4f540046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b534e64273215dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f47e00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f47e00640 1 -- 172.21.15.73:0/1683870334 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54006e20 con 0x5602462d78e0 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 1 -- 172.21.15.73:0/1683870334 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f580148a0 con 0x5602462d78e0 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f47e00640 1 -- 172.21.15.73:0/1683870334 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4f540c2c60 con 0x5602462d78e0 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f47e00640 1 -- 172.21.15.73:0/1683870334 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4f540c2e60 con 0x5602462d78e0 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 10 client.5493 fetch_fsmap learned FSMap version 18 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 1 -- 172.21.15.73:0/1683870334 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x560246062e80 con 0x5602462d78e0 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f47e00640 1 -- 172.21.15.73:0/1683870334 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f580148a0 con 0x5602462d78e0 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f47e00640 1 -- 172.21.15.73:0/1683870334 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f4f540abb20 con 0x5602462d78e0 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 10 client.5493 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 10 client.5493 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 20 client.5493 populate_metadata read hostname 'smithi073' 2024-04-15T15:32:55.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x560246299010 0x5602462993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 4 client.5493 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:32:55.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f70bca000 1 -- 172.21.15.73:0/1683870334 --> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560246075bc0 con 0x560246299010 2024-04-15T15:32:55.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66a00640 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x560246299010 0x5602462993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f66a00640 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x560246299010 0x5602462993f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46f37959197aee1a server_cookie=f926eb756fc1022b in_seq=0 out_seq=0 2024-04-15T15:32:55.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f47e00640 10 client.5493 ms_handle_connect on v2:172.21.15.118:6832/2635966606 2024-04-15T15:32:55.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f47e00640 1 -- 172.21.15.73:0/1683870334 <== mds.0 v2:172.21.15.118:6832/2635966606 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560246075bc0 con 0x560246299010 2024-04-15T15:32:55.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.561+0000 7f4f47e00640 10 client.5493 handle_command_reply: tid=0 2024-04-15T15:32:55.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 client.5493 shutdown 2024-04-15T15:32:55.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 -- 172.21.15.73:0/1683870334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 msgr2=0x5602462df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462df180 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097c0 tx=0x7f4f540046d0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 -- 172.21.15.73:0/1683870334 shutdown_connections 2024-04-15T15:32:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x560246299010 0x5602462993f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5602462d8200 0x560246298270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462df180 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1683870334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x5602462dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f47e00640 0 client.5493 ms_handle_reset on v2:172.21.15.118:6832/2635966606 2024-04-15T15:32:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 -- 172.21.15.73:0/1683870334 >> 172.21.15.73:0/1683870334 conn(0x560246175510 msgr2=0x56024628a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 -- 172.21.15.73:0/1683870334 shutdown_connections 2024-04-15T15:32:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 1 -- 172.21.15.73:0/1683870334 wait complete. 2024-04-15T15:32:55.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.565+0000 7f4f70bca000 20 client.5493 trim_cache size 0 max 16384 2024-04-15T15:32:55.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f70bca000 1 Processor -- start 2024-04-15T15:32:55.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f70bca000 1 -- start start 2024-04-15T15:32:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560246175510 0x5602462ef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56024628b5e0 0x5602462eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462ee310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f70bca000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4f680b5fb0 con 0x5602462d78e0 2024-04-15T15:32:55.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f70bca000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4f68160f00 con 0x56024628b5e0 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f70bca000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4f680b5960 con 0x560246175510 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f67400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462ee310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f67400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462ee310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43006/0 (socket says 172.21.15.73:43006) 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f67400640 1 -- 172.21.15.73:0/1455595142 learned_addr learned my addr 172.21.15.73:0/1455595142 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f66000640 1 --2- 172.21.15.73:0/1455595142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56024628b5e0 0x5602462eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f66a00640 1 --2- 172.21.15.73:0/1455595142 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560246175510 0x5602462ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f67400640 1 -- 172.21.15.73:0/1455595142 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560246175510 msgr2=0x5602462ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f67400640 1 --2- 172.21.15.73:0/1455595142 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560246175510 0x5602462ef140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f67400640 1 -- 172.21.15.73:0/1455595142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56024628b5e0 msgr2=0x5602462eddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f67400640 1 --2- 172.21.15.73:0/1455595142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56024628b5e0 0x5602462eddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f67400640 1 -- 172.21.15.73:0/1455595142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56024615d5d0 con 0x5602462d78e0 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f67400640 1 --2- 172.21.15.73:0/1455595142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462ee310 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4f600078f0 tx=0x7f4f60059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8c8e6403800b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:55.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f52a00640 1 -- 172.21.15.73:0/1455595142 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60053f10 con 0x5602462d78e0 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f52a00640 1 -- 172.21.15.73:0/1455595142 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6007dbc0 con 0x5602462d78e0 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.581+0000 7f4f52a00640 1 -- 172.21.15.73:0/1455595142 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60055060 con 0x5602462d78e0 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- 172.21.15.73:0/1455595142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 msgr2=0x5602462ee310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1455595142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462ee310 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4f600078f0 tx=0x7f4f60059040 comp rx=0 tx=0).stop 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- 172.21.15.73:0/1455595142 shutdown_connections 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1455595142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462ee310 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1455595142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56024628b5e0 0x5602462eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1455595142 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560246175510 0x5602462ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- 172.21.15.73:0/1455595142 >> 172.21.15.73:0/1455595142 conn(0x5602462901d0 msgr2=0x560246292400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- 172.21.15.73:0/1455595142 shutdown_connections 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- 172.21.15.73:0/1455595142 wait complete. 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- start start 2024-04-15T15:32:55.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 Processor -- start 2024-04-15T15:32:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560246175510 0x560246346e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x560246347360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462db640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5602460993c0 con 0x5602462d78e0 2024-04-15T15:32:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5602460d9220 con 0x560246175510 2024-04-15T15:32:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x560246061b00 con 0x56024628b5e0 2024-04-15T15:32:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 10 client.0 _ll_register_callbacks cb 0x7f4f540ab8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:32:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f67400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462db640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f67400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462db640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43016/0 (socket says 172.21.15.73:43016) 2024-04-15T15:32:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f67400640 1 -- 172.21.15.73:0/1134686767 learned_addr learned my addr 172.21.15.73:0/1134686767 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:55.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f66a00640 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560246175510 0x560246346e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f66000640 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x560246347360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f67400640 1 -- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 msgr2=0x560246347360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f67400640 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x560246347360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f67400640 1 -- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560246175510 msgr2=0x560246346e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f67400640 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560246175510 0x560246346e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f67400640 1 -- 172.21.15.73:0/1134686767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602461346e0 con 0x5602462d78e0 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f67400640 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462db640 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4f60052590 tx=0x7f4f60084130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b060aa3e7315cc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f47e00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f47e00640 1 -- 172.21.15.73:0/1134686767 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60051960 con 0x5602462d78e0 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f47e00640 1 -- 172.21.15.73:0/1134686767 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4f60051b00 con 0x5602462d78e0 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- 172.21.15.73:0/1134686767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f6007dbc0 con 0x5602462d78e0 2024-04-15T15:32:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f47e00640 1 -- 172.21.15.73:0/1134686767 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4f60054ad0 con 0x5602462d78e0 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 10 client.5499 fetch_fsmap learned FSMap version 18 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f70bca000 1 -- 172.21.15.73:0/1134686767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x560246081260 con 0x5602462d78e0 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f47e00640 1 -- 172.21.15.73:0/1134686767 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6007dbc0 con 0x5602462d78e0 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.585+0000 7f4f47e00640 1 -- 172.21.15.73:0/1134686767 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f4f60054c70 con 0x5602462d78e0 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 10 client.5499 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 10 client.5499 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 20 client.5499 populate_metadata read hostname 'smithi073' 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5602462d8200 0x5602462dbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 4 client.5499 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 -- 172.21.15.73:0/1134686767 --> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] -- command(tid 0: {"prefix": "status"}) -- 0x5602460e9cb0 con 0x5602462d8200 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f66a00640 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5602462d8200 0x5602462dbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f66a00640 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5602462d8200 0x5602462dbfa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f395c4e60d3490f server_cookie=963f5f75dc30b54 in_seq=0 out_seq=0 2024-04-15T15:32:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f47e00640 10 client.5499 ms_handle_connect on v2:172.21.15.118:6832/2635966606 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f47e00640 1 -- 172.21.15.73:0/1134686767 <== mds.0 v2:172.21.15.118:6832/2635966606 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5602460e9cb0 con 0x5602462d8200 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f47e00640 10 client.5499 handle_command_reply: tid=0 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 client.5499 shutdown 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 -- 172.21.15.73:0/1134686767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 msgr2=0x5602462db640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462db640 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4f60052590 tx=0x7f4f60084130 comp rx=0 tx=0).stop 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 -- 172.21.15.73:0/1134686767 shutdown_connections 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5602462d8200 0x5602462dbfa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602462d78e0 0x5602462db640 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56024628b5e0 0x560246347360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 --2- 172.21.15.73:0/1134686767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560246175510 0x560246346e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f47e00640 0 client.5499 ms_handle_reset on v2:172.21.15.118:6832/2635966606 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 -- 172.21.15.73:0/1134686767 >> 172.21.15.73:0/1134686767 conn(0x5602462901d0 msgr2=0x560246292c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 -- 172.21.15.73:0/1134686767 shutdown_connections 2024-04-15T15:32:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 1 -- 172.21.15.73:0/1134686767 wait complete. 2024-04-15T15:32:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f70bca000 20 client.5499 trim_cache size 0 max 16384 2024-04-15T15:32:55.596 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:32:55.596 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "a72de584-7db8-4f62-b310-5ee655143eeb", 2024-04-15T15:32:55.596 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-04-15T15:32:55.596 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5328, 2024-04-15T15:32:55.596 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-04-15T15:32:55.596 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-04-15T15:32:55.596 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-04-15T15:32:55.597 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 5.8576104129999997, 2024-04-15T15:32:55.597 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 18, 2024-04-15T15:32:55.597 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 39, 2024-04-15T15:32:55.597 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 39, 2024-04-15T15:32:55.597 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 13.721526872 2024-04-15T15:32:55.597 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 -- 172.21.15.73:0/893577744 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4f48068380 msgr2=0x7f4f4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4f48068380 0x7f4f4806a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009b40 tx=0x7f4f58003a40 comp rx=0 tx=0).stop 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 -- 172.21.15.73:0/893577744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f680cff10 msgr2=0x7f4f68150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f680cff10 0x7f4f68150820 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000c3f0 tx=0x7f4f6000c8b0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 -- 172.21.15.73:0/893577744 shutdown_connections 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f680cff10 0x7f4f68150820 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f680cf390 0x7f4f681502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4f48068380 0x7f4f4806a840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 --2- 172.21.15.73:0/893577744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f6806e690 0x7f4f68154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 -- 172.21.15.73:0/893577744 >> 172.21.15.73:0/893577744 conn(0x7f4f6806ba50 msgr2=0x7f4f68154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 -- 172.21.15.73:0/893577744 shutdown_connections 2024-04-15T15:32:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.589+0000 7f4f67e00640 1 -- 172.21.15.73:0/893577744 wait complete. 2024-04-15T15:32:55.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:32:55.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e8800640 1 Processor -- start 2024-04-15T15:32:55.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e8800640 1 -- start start 2024-04-15T15:32:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e8800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f10e00b27c0 0x7f10e015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e8800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f10e00b3e30 0x7f10e00b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e8800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e0070160 con 0x7f10e015b5d0 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e8800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f10e015b9b0 con 0x7f10e00b27c0 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e8800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f10e015f1f0 con 0x7f10e00b3e30 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e5e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f10e015b5d0 0x7f10e00b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58644/0 (socket says 172.21.15.73:58644) 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e5e00640 1 -- 172.21.15.73:0/3374073322 learned_addr learned my addr 172.21.15.73:0/3374073322 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e5400640 1 --2- 172.21.15.73:0/3374073322 >> v2:172.21.15.73:3300/0 conn(0x7f10e00b27c0 0x7f10e015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e6800640 1 --2- 172.21.15.73:0/3374073322 >> v2:172.21.15.118:3300/0 conn(0x7f10e00b3e30 0x7f10e00b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e4a00640 1 -- 172.21.15.73:0/3374073322 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132302858 0 0) 0x7f10e0070160 con 0x7f10e015b5d0 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e4a00640 1 -- 172.21.15.73:0/3374073322 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10c8003530 con 0x7f10e015b5d0 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e5400640 1 -- 172.21.15.73:0/3374073322 >> v2:172.21.15.118:3300/0 conn(0x7f10e00b3e30 msgr2=0x7f10e00b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e5400640 1 --2- 172.21.15.73:0/3374073322 >> v2:172.21.15.118:3300/0 conn(0x7f10e00b3e30 0x7f10e00b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e5400640 1 -- 172.21.15.73:0/3374073322 >> v1:172.21.15.73:6789/0 conn(0x7f10e015b5d0 legacy=0x7f10e00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.745+0000 7f10e5400640 1 -- 172.21.15.73:0/3374073322 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e006fe80 con 0x7f10e00b27c0 2024-04-15T15:32:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e5400640 1 --2- 172.21.15.73:0/3374073322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e00b27c0 0x7f10e015fc90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f10e00b2fe0 tx=0x7f10d001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c553aff2dd3d903 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e4a00640 1 -- 172.21.15.73:0/3374073322 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d00b0070 con 0x7f10e00b27c0 2024-04-15T15:32:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e4a00640 1 -- 172.21.15.73:0/3374073322 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d00ab400 con 0x7f10e00b27c0 2024-04-15T15:32:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e4a00640 1 -- 172.21.15.73:0/3374073322 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d00ab7d0 con 0x7f10e00b27c0 2024-04-15T15:32:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e8800640 1 -- 172.21.15.73:0/3374073322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e00b27c0 msgr2=0x7f10e015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e8800640 1 --2- 172.21.15.73:0/3374073322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e00b27c0 0x7f10e015fc90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f10e00b2fe0 tx=0x7f10d001c330 comp rx=0 tx=0).stop 2024-04-15T15:32:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e8800640 1 -- 172.21.15.73:0/3374073322 shutdown_connections 2024-04-15T15:32:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e8800640 1 --2- 172.21.15.73:0/3374073322 >> v2:172.21.15.118:3300/0 conn(0x7f10e00b3e30 0x7f10e00b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e8800640 1 --2- 172.21.15.73:0/3374073322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e00b27c0 0x7f10e015fc90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e8800640 1 -- 172.21.15.73:0/3374073322 >> 172.21.15.73:0/3374073322 conn(0x7f10e0067dd0 msgr2=0x7f10e00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e8800640 1 -- 172.21.15.73:0/3374073322 shutdown_connections 2024-04-15T15:32:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.749+0000 7f10e8800640 1 -- 172.21.15.73:0/3374073322 wait complete. 2024-04-15T15:32:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 Processor -- start 2024-04-15T15:32:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 -- start start 2024-04-15T15:32:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e00b27c0 0x7f10e0154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10e00b3e30 0x7f10e00a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e015b5d0 0x7f10e00aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f10e006faa0 con 0x7f10e015b5d0 2024-04-15T15:32:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f10e00b4240 con 0x7f10e00b27c0 2024-04-15T15:32:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f10e006fc20 con 0x7f10e00b3e30 2024-04-15T15:32:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e015b5d0 0x7f10e00aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e015b5d0 0x7f10e00aa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43042/0 (socket says 172.21.15.73:43042) 2024-04-15T15:32:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e6800640 1 -- 172.21.15.73:0/3128822558 learned_addr learned my addr 172.21.15.73:0/3128822558 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e6800640 1 -- 172.21.15.73:0/3128822558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10e00b3e30 msgr2=0x7f10e00a9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e6800640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10e00b3e30 0x7f10e00a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e5e00640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e00b27c0 0x7f10e0154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e6800640 1 -- 172.21.15.73:0/3128822558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e00b27c0 msgr2=0x7f10e0154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e6800640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e00b27c0 0x7f10e0154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e6800640 1 -- 172.21.15.73:0/3128822558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e015ea10 con 0x7f10e015b5d0 2024-04-15T15:32:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e5e00640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e00b27c0 0x7f10e0154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e6800640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e015b5d0 0x7f10e00aa4f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00efc0 tx=0x7f10dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10da000640 1 -- 172.21.15.73:0/3128822558 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc018020 con 0x7f10e015b5d0 2024-04-15T15:32:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10da000640 1 -- 172.21.15.73:0/3128822558 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10dc014480 con 0x7f10e015b5d0 2024-04-15T15:32:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10da000640 1 -- 172.21.15.73:0/3128822558 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc014870 con 0x7f10e015b5d0 2024-04-15T15:32:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 -- 172.21.15.73:0/3128822558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e015de90 con 0x7f10e015b5d0 2024-04-15T15:32:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 -- 172.21.15.73:0/3128822558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e015e730 con 0x7f10e015b5d0 2024-04-15T15:32:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.753+0000 7f10e8800640 1 -- 172.21.15.73:0/3128822558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e0068ab0 con 0x7f10e015b5d0 2024-04-15T15:32:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.757+0000 7f10da000640 1 -- 172.21.15.73:0/3128822558 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10dc01b020 con 0x7f10e015b5d0 2024-04-15T15:32:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.757+0000 7f10da000640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f10c40683b0 0x7f10c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.757+0000 7f10da000640 1 -- 172.21.15.73:0/3128822558 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f10dc087580 con 0x7f10e015b5d0 2024-04-15T15:32:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.757+0000 7f10e5e00640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f10c40683b0 0x7f10c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.757+0000 7f10e5e00640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f10c40683b0 0x7f10c406a870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f10d4005890 tx=0x7f10d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.761+0000 7f10da000640 1 -- 172.21.15.73:0/3128822558 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f10dc022070 con 0x7f10e015b5d0 2024-04-15T15:32:55.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 -- 172.21.15.73:0/3128822558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f10e006f370 con 0x7f10e015b5d0 2024-04-15T15:32:55.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10da000640 1 -- 172.21.15.73:0/3128822558 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f10dc010040 con 0x7f10e015b5d0 2024-04-15T15:32:55.954 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-15T15:32:55.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 -- 172.21.15.73:0/3128822558 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f10c40683b0 msgr2=0x7f10c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f10c40683b0 0x7f10c406a870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f10d4005890 tx=0x7f10d4009040 comp rx=0 tx=0).stop 2024-04-15T15:32:55.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 -- 172.21.15.73:0/3128822558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e015b5d0 msgr2=0x7f10e00aa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:55.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e015b5d0 0x7f10e00aa4f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00efc0 tx=0x7f10dc00c490 comp rx=0 tx=0).stop 2024-04-15T15:32:55.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 -- 172.21.15.73:0/3128822558 shutdown_connections 2024-04-15T15:32:55.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e015b5d0 0x7f10e00aa4f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f10c40683b0 0x7f10c406a870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10e00b3e30 0x7f10e00a9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 --2- 172.21.15.73:0/3128822558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e00b27c0 0x7f10e0154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.953+0000 7f10e8800640 1 -- 172.21.15.73:0/3128822558 >> 172.21.15.73:0/3128822558 conn(0x7f10e0067dd0 msgr2=0x7f10e0152720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.957+0000 7f10e8800640 1 -- 172.21.15.73:0/3128822558 shutdown_connections 2024-04-15T15:32:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:55.957+0000 7f10e8800640 1 -- 172.21.15.73:0/3128822558 wait complete. 2024-04-15T15:32:55.975 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-15T15:32:55.975 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:32:55.975 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-04-15T15:32:55.975 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-15T15:32:55.975 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T15:32:55.975 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-15T15:32:55.975 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-15T15:32:55.975 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:32:55.976 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-15T15:32:55.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:55.976 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-04-15T15:32:55.986 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:32:55.986 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:32:55.986 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:32:55.986 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:55.986 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-04-15T15:32:55.986 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:55.986 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:55.986 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42380sec preferred_lft 42380sec 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-04-15T15:32:55.987 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:61:e3:76:67 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:32:55.988 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T15:32:55.989 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-15T15:32:55.989 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:55.989 INFO:teuthology.orchestra.run.smithi073.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:32:55.989 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-15T15:32:55.989 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-15T15:32:55.989 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:55.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:55.989 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:32:56.045 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-04-15T15:32:56.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:56.047 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-04-15T15:32:56.099 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-04-15T15:32:56.099 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:32:56.100 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:32:56.100 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:32:56.100 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:32:56.100 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:32:56.100 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:32:56.100 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:56.100 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:56.100 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:56.100 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:32:56.101 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:56.101 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:32:56.101 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:32:56.101 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:32:56.101 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:32:56.101 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:32:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:56.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:56.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:56.236 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-15T15:32:56.245 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-15T15:32:56.246 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-15T15:32:56.246 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-15T15:32:56.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:56.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-04-15T15:32:56.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:56.312 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-15T15:32:56.363 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-15T15:32:56.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:56.364 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-15T15:32:56.416 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-15T15:32:56.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:56.417 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:32:56.511 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:32:56.512 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-15T15:32:56.512 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:32:56.527 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:32:56.527 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-15T15:32:56.527 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:32:56.527 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:56.527 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:56.537 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:32:56.537 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-15T15:32:56.538 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:32:56.538 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:56.538 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:56.538 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790" 2024-04-15T15:32:56.538 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2024-04-15T15:32:56.538 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a72de584-7db8-4f62-b310-5ee655143eeb" will pass to kernel 2024-04-15T15:32:56.541 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-15T15:32:56.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:56.541 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-15T15:32:56.607 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:56.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:56.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:56.723 INFO:teuthology.orchestra.run.smithi073.stdout:client5311 2024-04-15T15:32:56.723 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:56.724 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:56.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:32:56.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.913+0000 7f1083c00640 1 Processor -- start 2024-04-15T15:32:56.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.913+0000 7f1083c00640 1 -- start start 2024-04-15T15:32:56.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.913+0000 7f1083c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f107c15b5d0 0x7f107c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:56.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.913+0000 7f1083c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f107c0b3e30 0x7f107c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:56.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.913+0000 7f1083c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107c070160 con 0x7f107c0b25f0 2024-04-15T15:32:56.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.913+0000 7f1083c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f107c15b9b0 con 0x7f107c15b5d0 2024-04-15T15:32:56.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.913+0000 7f1083c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f107c0b2a40 con 0x7f107c0b3e30 2024-04-15T15:32:56.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.913+0000 7f1081200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f107c15b5d0 0x7f107c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:56.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.913+0000 7f1081200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f107c15b5d0 0x7f107c15fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43048/0 (socket says 172.21.15.73:43048) 2024-04-15T15:32:56.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.913+0000 7f1081200640 1 -- 172.21.15.73:0/1283214715 learned_addr learned my addr 172.21.15.73:0/1283214715 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.917+0000 7f107be00640 1 --2- 172.21.15.73:0/1283214715 >> v2:172.21.15.118:3300/0 conn(0x7f107c0b3e30 0x7f107c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.917+0000 7f1081200640 1 -- 172.21.15.73:0/1283214715 >> v2:172.21.15.118:3300/0 conn(0x7f107c0b3e30 msgr2=0x7f107c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.917+0000 7f1081200640 1 --2- 172.21.15.73:0/1283214715 >> v2:172.21.15.118:3300/0 conn(0x7f107c0b3e30 0x7f107c0b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.917+0000 7f1081200640 1 -- 172.21.15.73:0/1283214715 >> v1:172.21.15.118:6789/0 conn(0x7f107c0b25f0 legacy=0x7f107c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.917+0000 7f1081200640 1 -- 172.21.15.73:0/1283214715 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c15f1f0 con 0x7f107c15b5d0 2024-04-15T15:32:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.917+0000 7f107be00640 1 --2- 172.21.15.73:0/1283214715 >> v2:172.21.15.118:3300/0 conn(0x7f107c0b3e30 0x7f107c0b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:56.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.917+0000 7f1081200640 1 --2- 172.21.15.73:0/1283214715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c15b5d0 0x7f107c15fc90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1070009870 tx=0x7f107001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3634bb18a9aef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:56.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.917+0000 7f107b400640 1 -- 172.21.15.73:0/1283214715 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10700b0070 con 0x7f107c15b5d0 2024-04-15T15:32:56.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.917+0000 7f107b400640 1 -- 172.21.15.73:0/1283214715 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10700ab600 con 0x7f107c15b5d0 2024-04-15T15:32:56.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.917+0000 7f107b400640 1 -- 172.21.15.73:0/1283214715 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10700ab9d0 con 0x7f107c15b5d0 2024-04-15T15:32:56.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 -- 172.21.15.73:0/1283214715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c15b5d0 msgr2=0x7f107c15fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:56.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 --2- 172.21.15.73:0/1283214715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c15b5d0 0x7f107c15fc90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1070009870 tx=0x7f107001c360 comp rx=0 tx=0).stop 2024-04-15T15:32:56.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 -- 172.21.15.73:0/1283214715 shutdown_connections 2024-04-15T15:32:56.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 --2- 172.21.15.73:0/1283214715 >> v2:172.21.15.118:3300/0 conn(0x7f107c0b3e30 0x7f107c0b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:56.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 --2- 172.21.15.73:0/1283214715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c15b5d0 0x7f107c15fc90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:56.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 -- 172.21.15.73:0/1283214715 >> 172.21.15.73:0/1283214715 conn(0x7f107c067dd0 msgr2=0x7f107c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:56.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 -- 172.21.15.73:0/1283214715 shutdown_connections 2024-04-15T15:32:56.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 -- 172.21.15.73:0/1283214715 wait complete. 2024-04-15T15:32:56.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 Processor -- start 2024-04-15T15:32:56.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 -- start start 2024-04-15T15:32:56.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f107c0b25f0 0x7f107c14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:56.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c0b3e30 0x7f107c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:56.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c15b5d0 0x7f107c151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:56.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f107c0b4240 con 0x7f107c0b3e30 2024-04-15T15:32:56.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f107c0cfd00 con 0x7f107c15b5d0 2024-04-15T15:32:56.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f1083c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f107c06faa0 con 0x7f107c0b25f0 2024-04-15T15:32:56.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f107be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c0b3e30 0x7f107c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:56.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f107be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c0b3e30 0x7f107c150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43062/0 (socket says 172.21.15.73:43062) 2024-04-15T15:32:56.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f107be00640 1 -- 172.21.15.73:0/3472329695 learned_addr learned my addr 172.21.15.73:0/3472329695 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:56.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f107be00640 1 -- 172.21.15.73:0/3472329695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f107c0b25f0 msgr2=0x7f107c14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f107be00640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f107c0b25f0 0x7f107c14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f107be00640 1 -- 172.21.15.73:0/3472329695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c15b5d0 msgr2=0x7f107c151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f107be00640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c15b5d0 0x7f107c151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f107be00640 1 -- 172.21.15.73:0/3472329695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c14cda0 con 0x7f107c0b3e30 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.921+0000 7f107be00640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c0b3e30 0x7f107c150f30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f106800c7f0 tx=0x7f106800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1078c00640 1 -- 172.21.15.73:0/3472329695 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068015070 con 0x7f107c0b3e30 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1078c00640 1 -- 172.21.15.73:0/3472329695 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1068007820 con 0x7f107c0b3e30 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1083c00640 1 -- 172.21.15.73:0/3472329695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c14d040 con 0x7f107c0b3e30 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1078c00640 1 -- 172.21.15.73:0/3472329695 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068007c10 con 0x7f107c0b3e30 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1083c00640 1 -- 172.21.15.73:0/3472329695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c14d600 con 0x7f107c0b3e30 2024-04-15T15:32:56.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1083c00640 1 -- 172.21.15.73:0/3472329695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107c068ab0 con 0x7f107c0b3e30 2024-04-15T15:32:56.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1078c00640 1 -- 172.21.15.73:0/3472329695 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1068018070 con 0x7f107c0b3e30 2024-04-15T15:32:56.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1078c00640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f105c0683b0 0x7f105c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:56.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1078c00640 1 -- 172.21.15.73:0/3472329695 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f1068086c50 con 0x7f107c0b3e30 2024-04-15T15:32:56.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1081200640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f105c0683b0 0x7f105c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:56.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.925+0000 7f1081200640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f105c0683b0 0x7f105c06a870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f10700ad000 tx=0x7f1070004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:56.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:56.929+0000 7f1078c00640 1 -- 172.21.15.73:0/3472329695 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f106808c020 con 0x7f107c0b3e30 2024-04-15T15:32:57.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.121+0000 7f1083c00640 1 -- 172.21.15.73:0/3472329695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f107c06f620 con 0x7f107c0b3e30 2024-04-15T15:32:57.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.121+0000 7f1078c00640 1 -- 172.21.15.73:0/3472329695 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f1068057080 con 0x7f107c0b3e30 2024-04-15T15:32:57.123 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-15T15:32:57.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 -- 172.21.15.73:0/3472329695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f105c0683b0 msgr2=0x7f105c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:57.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f105c0683b0 0x7f105c06a870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f10700ad000 tx=0x7f1070004740 comp rx=0 tx=0).stop 2024-04-15T15:32:57.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 -- 172.21.15.73:0/3472329695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c0b3e30 msgr2=0x7f107c150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:57.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c0b3e30 0x7f107c150f30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f106800c7f0 tx=0x7f106800ccb0 comp rx=0 tx=0).stop 2024-04-15T15:32:57.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 -- 172.21.15.73:0/3472329695 shutdown_connections 2024-04-15T15:32:57.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c15b5d0 0x7f107c151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:57.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f107c0b3e30 0x7f107c150f30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:57.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f105c0683b0 0x7f105c06a870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:57.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 --2- 172.21.15.73:0/3472329695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f107c0b25f0 0x7f107c14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:57.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 -- 172.21.15.73:0/3472329695 >> 172.21.15.73:0/3472329695 conn(0x7f107c067dd0 msgr2=0x7f107c0cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:57.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 -- 172.21.15.73:0/3472329695 shutdown_connections 2024-04-15T15:32:57.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:57.125+0000 7f1083c00640 1 -- 172.21.15.73:0/3472329695 wait complete. 2024-04-15T15:32:57.143 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-15T15:32:57.144 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:32:57.144 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-04-15T15:32:57.144 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-15T15:32:57.145 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-15T15:32:57.145 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-15T15:32:57.145 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-15T15:32:57.145 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:32:57.145 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-15T15:32:57.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:57.145 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-04-15T15:32:57.155 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:32:57.155 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:32:57.155 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:32:57.155 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:32:57.156 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42391sec preferred_lft 42391sec 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 02:42:71:7b:96:37 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:57.157 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:32:57.158 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T15:32:57.158 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-15T15:32:57.158 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:57.158 INFO:teuthology.orchestra.run.smithi118.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:32:57.158 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-15T15:32:57.158 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-15T15:32:57.158 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:32:57.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:57.159 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:32:57.223 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-04-15T15:32:57.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:57.225 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-04-15T15:32:57.283 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-04-15T15:32:57.283 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:32:57.283 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:32:57.283 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:32:57.283 INFO:teuthology.orchestra.run.smithi118.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:32:57.283 INFO:teuthology.orchestra.run.smithi118.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:32:57.284 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:32:57.284 INFO:teuthology.orchestra.run.smithi118.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:57.284 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:57.284 INFO:teuthology.orchestra.run.smithi118.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:32:57.284 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:32:57.284 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:32:57.284 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:32:57.284 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:32:57.284 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:32:57.284 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:32:57.284 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:32:57.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:32:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:57.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:57.430 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-04-15T15:32:57.439 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-15T15:32:57.439 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-15T15:32:57.439 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-15T15:32:57.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:57.440 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-04-15T15:32:57.504 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:57.504 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-15T15:32:57.556 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-15T15:32:57.556 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:32:57.556 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-15T15:32:57.607 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-15T15:32:57.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:57.607 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:32:57.695 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:32:57.696 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-15T15:32:57.696 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:32:57.710 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:32:57.711 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-15T15:32:57.711 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:32:57.711 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:57.711 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:57.721 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:32:57.721 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-15T15:32:57.721 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:32:57.721 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:32:57.721 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:32:57.721 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790" 2024-04-15T15:32:57.721 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2024-04-15T15:32:57.721 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a72de584-7db8-4f62-b310-5ee655143eeb" will pass to kernel 2024-04-15T15:32:57.725 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-15T15:32:57.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:32:57.725 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-15T15:32:57.745 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:32:57.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:32:57.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:32:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:32:57.847 INFO:teuthology.orchestra.run.smithi118.stdout:client5517 2024-04-15T15:32:57.847 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:32:57.847 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:57.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds debug_mds 25 2024-04-15T15:32:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.001+0000 7f31e0a00640 1 Processor -- start 2024-04-15T15:32:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.001+0000 7f31e0a00640 1 -- start start 2024-04-15T15:32:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.001+0000 7f31e0a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f31dc146110 0x7f31dc0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.001+0000 7f31e0a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc0b20b0 0x7f31dc0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.001+0000 7f31e0a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31dc0cd3a0 con 0x7f31dc071e10 2024-04-15T15:32:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.001+0000 7f31e0a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f31dc0b5160 con 0x7f31dc146110 2024-04-15T15:32:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.001+0000 7f31e0a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc0b40c0 con 0x7f31dc0b20b0 2024-04-15T15:32:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.001+0000 7f31da800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f31dc071e10 0x7f31dc0722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44914/0 (socket says 172.21.15.73:44914) 2024-04-15T15:32:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.001+0000 7f31da800640 1 -- 172.21.15.73:0/3898238514 learned_addr learned my addr 172.21.15.73:0/3898238514 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d9e00640 1 --2- 172.21.15.73:0/3898238514 >> v2:172.21.15.118:3300/0 conn(0x7f31dc146110 0x7f31dc0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d9400640 1 --2- 172.21.15.73:0/3898238514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc0b20b0 0x7f31dc0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d8a00640 1 -- 172.21.15.73:0/3898238514 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650023880 0 0) 0x7f31dc0cd3a0 con 0x7f31dc071e10 2024-04-15T15:32:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d8a00640 1 -- 172.21.15.73:0/3898238514 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31c0003530 con 0x7f31dc071e10 2024-04-15T15:32:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d9e00640 1 -- 172.21.15.73:0/3898238514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc0b20b0 msgr2=0x7f31dc0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d9e00640 1 --2- 172.21.15.73:0/3898238514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc0b20b0 0x7f31dc0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d9e00640 1 -- 172.21.15.73:0/3898238514 >> v1:172.21.15.73:6789/0 conn(0x7f31dc071e10 legacy=0x7f31dc0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d9e00640 1 -- 172.21.15.73:0/3898238514 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc0b43a0 con 0x7f31dc146110 2024-04-15T15:32:58.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d9e00640 1 --2- 172.21.15.73:0/3898238514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc146110 0x7f31dc0cd7b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009d90 tx=0x7f31cc01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2736c0cbda7c88d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:58.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d8a00640 1 -- 172.21.15.73:0/3898238514 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0b2070 con 0x7f31dc146110 2024-04-15T15:32:58.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d8a00640 1 -- 172.21.15.73:0/3898238514 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc0a5920 con 0x7f31dc146110 2024-04-15T15:32:58.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.005+0000 7f31d8a00640 1 -- 172.21.15.73:0/3898238514 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0a5cf0 con 0x7f31dc146110 2024-04-15T15:32:58.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 -- 172.21.15.73:0/3898238514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc146110 msgr2=0x7f31dc0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 --2- 172.21.15.73:0/3898238514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc146110 0x7f31dc0cd7b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009d90 tx=0x7f31cc01c970 comp rx=0 tx=0).stop 2024-04-15T15:32:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 -- 172.21.15.73:0/3898238514 shutdown_connections 2024-04-15T15:32:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 --2- 172.21.15.73:0/3898238514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc0b20b0 0x7f31dc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 --2- 172.21.15.73:0/3898238514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc146110 0x7f31dc0cd7b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 -- 172.21.15.73:0/3898238514 >> 172.21.15.73:0/3898238514 conn(0x7f31dc067dd0 msgr2=0x7f31dc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 -- 172.21.15.73:0/3898238514 shutdown_connections 2024-04-15T15:32:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 -- 172.21.15.73:0/3898238514 wait complete. 2024-04-15T15:32:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 Processor -- start 2024-04-15T15:32:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 -- start start 2024-04-15T15:32:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc071e10 0x7f31dc13d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc0b20b0 0x7f31dc145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc146110 0x7f31dc0a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0cdcf0 con 0x7f31dc0b20b0 2024-04-15T15:32:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0b3d70 con 0x7f31dc146110 2024-04-15T15:32:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31e0a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc15dbe0 con 0x7f31dc071e10 2024-04-15T15:32:58.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc0b20b0 0x7f31dc145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc0b20b0 0x7f31dc145250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59212/0 (socket says 172.21.15.73:59212) 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9400640 1 -- 172.21.15.73:0/3978958437 learned_addr learned my addr 172.21.15.73:0/3978958437 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9400640 1 -- 172.21.15.73:0/3978958437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc071e10 msgr2=0x7f31dc13d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31da800640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc146110 0x7f31dc0a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9e00640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc071e10 0x7f31dc13d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9400640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc071e10 0x7f31dc13d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9400640 1 -- 172.21.15.73:0/3978958437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc146110 msgr2=0x7f31dc0a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9400640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc146110 0x7f31dc0a9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9400640 1 -- 172.21.15.73:0/3978958437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc1441b0 con 0x7f31dc0b20b0 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31da800640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc146110 0x7f31dc0a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9e00640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc071e10 0x7f31dc13d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.009+0000 7f31d9400640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc0b20b0 0x7f31dc145250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f31c800e870 tx=0x7f31c800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.013+0000 7f31d2000640 1 -- 172.21.15.73:0/3978958437 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8017070 con 0x7f31dc0b20b0 2024-04-15T15:32:58.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.013+0000 7f31d2000640 1 -- 172.21.15.73:0/3978958437 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c800c940 con 0x7f31dc0b20b0 2024-04-15T15:32:58.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.013+0000 7f31d2000640 1 -- 172.21.15.73:0/3978958437 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c800ccf0 con 0x7f31dc0b20b0 2024-04-15T15:32:58.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.013+0000 7f31e0a00640 1 -- 172.21.15.73:0/3978958437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc144490 con 0x7f31dc0b20b0 2024-04-15T15:32:58.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.013+0000 7f31e0a00640 1 -- 172.21.15.73:0/3978958437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc144a50 con 0x7f31dc0b20b0 2024-04-15T15:32:58.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.013+0000 7f31e0a00640 1 -- 172.21.15.73:0/3978958437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31dc068ab0 con 0x7f31dc0b20b0 2024-04-15T15:32:58.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.013+0000 7f31d2000640 1 -- 172.21.15.73:0/3978958437 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31c801a070 con 0x7f31dc0b20b0 2024-04-15T15:32:58.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.013+0000 7f31d2000640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31bc0683b0 0x7f31bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.013+0000 7f31d2000640 1 -- 172.21.15.73:0/3978958437 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f31c8086e00 con 0x7f31dc0b20b0 2024-04-15T15:32:58.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.013+0000 7f31d9e00640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31bc0683b0 0x7f31bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.017+0000 7f31d9e00640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31bc0683b0 0x7f31bc06a870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0af000 tx=0x7f31cc0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:58.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.017+0000 7f31d2000640 1 -- 172.21.15.73:0/3978958437 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31c8057190 con 0x7f31dc0b20b0 2024-04-15T15:32:58.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.177+0000 7f31e0a00640 1 -- 172.21.15.73:0/3978958437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f31dc0b3090 con 0x7f31dc0b20b0 2024-04-15T15:32:58.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.181+0000 7f31d2000640 1 -- 172.21.15.73:0/3978958437 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v11)=0 v11) ==== 108+0+0 (secure 0 0 0) 0x7f31c8056a90 con 0x7f31dc0b20b0 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 -- 172.21.15.73:0/3978958437 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31bc0683b0 msgr2=0x7f31bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31bc0683b0 0x7f31bc06a870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0af000 tx=0x7f31cc0a7070 comp rx=0 tx=0).stop 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 -- 172.21.15.73:0/3978958437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc0b20b0 msgr2=0x7f31dc145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc0b20b0 0x7f31dc145250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f31c800e870 tx=0x7f31c800ec70 comp rx=0 tx=0).stop 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 -- 172.21.15.73:0/3978958437 shutdown_connections 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31dc146110 0x7f31dc0a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc0b20b0 0x7f31dc145250 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f31bc0683b0 0x7f31bc06a870 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 --2- 172.21.15.73:0/3978958437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31dc071e10 0x7f31dc13d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 -- 172.21.15.73:0/3978958437 >> 172.21.15.73:0/3978958437 conn(0x7f31dc067dd0 msgr2=0x7f31dc0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 -- 172.21.15.73:0/3978958437 shutdown_connections 2024-04-15T15:32:58.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.185+0000 7f31e0a00640 1 -- 172.21.15.73:0/3978958437 wait complete. 2024-04-15T15:32:58.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_quiesce_splitauth true 2024-04-15T15:32:58.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb023a00640 1 Processor -- start 2024-04-15T15:32:58.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb023a00640 1 -- start start 2024-04-15T15:32:58.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb023a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb01c0b17a0 0x7fb01c0d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb023a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb01c06dad0 0x7fb01c09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb023a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01c0d1000 con 0x7fb01c09afa0 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb023a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb01c09b410 con 0x7fb01c06dad0 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb023a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb01c0d12e0 con 0x7fb01c0b17a0 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb01be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb01c06dad0 0x7fb01c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb021a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb01c09afa0 0x7fb01c15e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44920/0 (socket says 172.21.15.73:44920) 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb021a00640 1 -- 172.21.15.73:0/1490266741 learned_addr learned my addr 172.21.15.73:0/1490266741 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb01be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb01c06dad0 0x7fb01c09aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59214/0 (socket says 172.21.15.73:59214) 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb021000640 1 --2- 172.21.15.73:0/1490266741 >> v2:172.21.15.118:3300/0 conn(0x7fb01c0b17a0 0x7fb01c0d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb01be00640 1 -- 172.21.15.73:0/1490266741 >> v2:172.21.15.118:3300/0 conn(0x7fb01c0b17a0 msgr2=0x7fb01c0d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb01be00640 1 --2- 172.21.15.73:0/1490266741 >> v2:172.21.15.118:3300/0 conn(0x7fb01c0b17a0 0x7fb01c0d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb01be00640 1 -- 172.21.15.73:0/1490266741 >> v1:172.21.15.73:6789/0 conn(0x7fb01c09afa0 legacy=0x7fb01c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb01b400640 1 -- 172.21.15.73:0/1490266741 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153556189 0 0) 0x7fb01c0d1000 con 0x7fb01c09afa0 2024-04-15T15:32:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.341+0000 7fb01be00640 1 -- 172.21.15.73:0/1490266741 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01c0d15c0 con 0x7fb01c06dad0 2024-04-15T15:32:58.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb01be00640 1 --2- 172.21.15.73:0/1490266741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c06dad0 0x7fb01c09aa60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0687b0 tx=0x7fb00c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2018f18e0ad22145 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:58.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb01b400640 1 -- 172.21.15.73:0/1490266741 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0b0070 con 0x7fb01c06dad0 2024-04-15T15:32:58.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb01b400640 1 -- 172.21.15.73:0/1490266741 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00c0ab600 con 0x7fb01c06dad0 2024-04-15T15:32:58.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb01b400640 1 -- 172.21.15.73:0/1490266741 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0ab9d0 con 0x7fb01c06dad0 2024-04-15T15:32:58.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb023a00640 1 -- 172.21.15.73:0/1490266741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c06dad0 msgr2=0x7fb01c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb023a00640 1 --2- 172.21.15.73:0/1490266741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c06dad0 0x7fb01c09aa60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0687b0 tx=0x7fb00c01c480 comp rx=0 tx=0).stop 2024-04-15T15:32:58.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb023a00640 1 -- 172.21.15.73:0/1490266741 shutdown_connections 2024-04-15T15:32:58.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb023a00640 1 --2- 172.21.15.73:0/1490266741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c06dad0 0x7fb01c09aa60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb023a00640 1 --2- 172.21.15.73:0/1490266741 >> v2:172.21.15.118:3300/0 conn(0x7fb01c0b17a0 0x7fb01c0d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb023a00640 1 -- 172.21.15.73:0/1490266741 >> 172.21.15.73:0/1490266741 conn(0x7fb01c0b3fe0 msgr2=0x7fb01c0b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:58.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb023a00640 1 -- 172.21.15.73:0/1490266741 shutdown_connections 2024-04-15T15:32:58.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.345+0000 7fb023a00640 1 -- 172.21.15.73:0/1490266741 wait complete. 2024-04-15T15:32:58.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb023a00640 1 Processor -- start 2024-04-15T15:32:58.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb023a00640 1 -- start start 2024-04-15T15:32:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb023a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c06dad0 0x7fb01c154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb023a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb01c09afa0 0x7fb01c154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb023a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c0b17a0 0x7fb01c160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb023a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c15ee00 con 0x7fb01c0b17a0 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb023a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c15ec80 con 0x7fb01c09afa0 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb023a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb01c0b1b80 con 0x7fb01c06dad0 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb021a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c0b17a0 0x7fb01c160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb021a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c0b17a0 0x7fb01c160e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59226/0 (socket says 172.21.15.73:59226) 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb021a00640 1 -- 172.21.15.73:0/1408249566 learned_addr learned my addr 172.21.15.73:0/1408249566 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb021000640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c06dad0 0x7fb01c154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb01be00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb01c09afa0 0x7fb01c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb021a00640 1 -- 172.21.15.73:0/1408249566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c06dad0 msgr2=0x7fb01c154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb021a00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c06dad0 0x7fb01c154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb021a00640 1 -- 172.21.15.73:0/1408249566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb01c09afa0 msgr2=0x7fb01c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb021a00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb01c09afa0 0x7fb01c154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb021a00640 1 -- 172.21.15.73:0/1408249566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01c1586f0 con 0x7fb01c0b17a0 2024-04-15T15:32:58.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb021a00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c0b17a0 0x7fb01c160e70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c700 tx=0x7fb01400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:58.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb018c00640 1 -- 172.21.15.73:0/1408249566 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb014018070 con 0x7fb01c0b17a0 2024-04-15T15:32:58.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb018c00640 1 -- 172.21.15.73:0/1408249566 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01400ce10 con 0x7fb01c0b17a0 2024-04-15T15:32:58.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb018c00640 1 -- 172.21.15.73:0/1408249566 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01400a860 con 0x7fb01c0b17a0 2024-04-15T15:32:58.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb023a00640 1 -- 172.21.15.73:0/1408249566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01c14bfe0 con 0x7fb01c0b17a0 2024-04-15T15:32:58.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.349+0000 7fb023a00640 1 -- 172.21.15.73:0/1408249566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb01c14c5a0 con 0x7fb01c0b17a0 2024-04-15T15:32:58.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.353+0000 7fb023a00640 1 -- 172.21.15.73:0/1408249566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01c068ab0 con 0x7fb01c0b17a0 2024-04-15T15:32:58.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.353+0000 7fb018c00640 1 -- 172.21.15.73:0/1408249566 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb01401b070 con 0x7fb01c0b17a0 2024-04-15T15:32:58.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.353+0000 7fb018c00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faff8068380 0x7faff806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.353+0000 7fb018c00640 1 -- 172.21.15.73:0/1408249566 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb0140860e0 con 0x7fb01c0b17a0 2024-04-15T15:32:58.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.353+0000 7fb021000640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faff8068380 0x7faff806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.353+0000 7fb021000640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faff8068380 0x7faff806a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb004006fd0 tx=0x7fb004008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:58.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.357+0000 7fb018c00640 1 -- 172.21.15.73:0/1408249566 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb014055e20 con 0x7fb01c0b17a0 2024-04-15T15:32:58.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.513+0000 7fb023a00640 1 -- 172.21.15.73:0/1408249566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mds_cache_quiesce_splitauth}] v 0) -- 0x7fb01c0b4d80 con 0x7fb01c0b17a0 2024-04-15T15:32:58.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb018c00640 1 -- 172.21.15.73:0/1408249566 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_quiesce_splitauth}]=0 v12)=0 v12) ==== 128+0+0 (secure 0 0 0) 0x7fb01405a120 con 0x7fb01c0b17a0 2024-04-15T15:32:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 -- 172.21.15.73:0/1408249566 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faff8068380 msgr2=0x7faff806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faff8068380 0x7faff806a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb004006fd0 tx=0x7fb004008040 comp rx=0 tx=0).stop 2024-04-15T15:32:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 -- 172.21.15.73:0/1408249566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c0b17a0 msgr2=0x7fb01c160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c0b17a0 0x7fb01c160e70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c700 tx=0x7fb01400cbc0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 -- 172.21.15.73:0/1408249566 shutdown_connections 2024-04-15T15:32:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb01c0b17a0 0x7fb01c160e70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb01c09afa0 0x7fb01c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faff8068380 0x7faff806a840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 --2- 172.21.15.73:0/1408249566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c06dad0 0x7fb01c154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 -- 172.21.15.73:0/1408249566 >> 172.21.15.73:0/1408249566 conn(0x7fb01c0b3fe0 msgr2=0x7fb01c0b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 -- 172.21.15.73:0/1408249566 shutdown_connections 2024-04-15T15:32:58.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.521+0000 7fb023a00640 1 -- 172.21.15.73:0/1408249566 wait complete. 2024-04-15T15:32:58.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol_quiesce --mode=777 2024-04-15T15:32:58.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.681+0000 7fe207200640 1 Processor -- start 2024-04-15T15:32:58.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe207200640 1 -- start start 2024-04-15T15:32:58.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe207200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe208162480 0x7fe208162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe207200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 0x7fe20815e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe207200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe208162da0 con 0x7fe20806cb60 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe207200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe20809aa60 con 0x7fe208162480 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe207200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe2080d0bd0 con 0x7fe20806ff20 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe205e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe208162480 0x7fe208162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe1fd400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe20806cb60 0x7fe2080d04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44936/0 (socket says 172.21.15.73:44936) 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe1fd400640 1 -- 172.21.15.73:0/2021519403 learned_addr learned my addr 172.21.15.73:0/2021519403 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe206800640 1 --2- 172.21.15.73:0/2021519403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 0x7fe20815e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe205e00640 1 -- 172.21.15.73:0/2021519403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 msgr2=0x7fe20815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe205e00640 1 --2- 172.21.15.73:0/2021519403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 0x7fe20815e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe205e00640 1 -- 172.21.15.73:0/2021519403 >> v1:172.21.15.73:6789/0 conn(0x7fe20806cb60 legacy=0x7fe2080d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.685+0000 7fe205e00640 1 -- 172.21.15.73:0/2021519403 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2080d0e80 con 0x7fe208162480 2024-04-15T15:32:58.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe205e00640 1 --2- 172.21.15.73:0/2021519403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe208162480 0x7fe208162860 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009d90 tx=0x7fe1f801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf4d1e37c2fda6e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:58.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe205400640 1 -- 172.21.15.73:0/2021519403 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80b2070 con 0x7fe208162480 2024-04-15T15:32:58.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe205400640 1 -- 172.21.15.73:0/2021519403 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f80a5890 con 0x7fe208162480 2024-04-15T15:32:58.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe205400640 1 -- 172.21.15.73:0/2021519403 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80a5c60 con 0x7fe208162480 2024-04-15T15:32:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe207200640 1 -- 172.21.15.73:0/2021519403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe208162480 msgr2=0x7fe208162860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe207200640 1 --2- 172.21.15.73:0/2021519403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe208162480 0x7fe208162860 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009d90 tx=0x7fe1f801c8e0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe207200640 1 -- 172.21.15.73:0/2021519403 shutdown_connections 2024-04-15T15:32:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe207200640 1 --2- 172.21.15.73:0/2021519403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 0x7fe20815e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe207200640 1 --2- 172.21.15.73:0/2021519403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe208162480 0x7fe208162860 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe207200640 1 -- 172.21.15.73:0/2021519403 >> 172.21.15.73:0/2021519403 conn(0x7fe2080b3f20 msgr2=0x7fe2080b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe207200640 1 -- 172.21.15.73:0/2021519403 shutdown_connections 2024-04-15T15:32:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe207200640 1 -- 172.21.15.73:0/2021519403 wait complete. 2024-04-15T15:32:58.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe207200640 1 Processor -- start 2024-04-15T15:32:58.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.689+0000 7fe207200640 1 -- start start 2024-04-15T15:32:58.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe207200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe20806cb60 0x7fe20815da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe207200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 0x7fe2080b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe207200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe208162480 0x7fe2080b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe207200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe20815ef70 con 0x7fe20806cb60 2024-04-15T15:32:58.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe207200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe20815edf0 con 0x7fe208162480 2024-04-15T15:32:58.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe207200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe20815f0f0 con 0x7fe20806ff20 2024-04-15T15:32:58.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe205e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe20806cb60 0x7fe20815da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe205e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe20806cb60 0x7fe20815da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59246/0 (socket says 172.21.15.73:59246) 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe205e00640 1 -- 172.21.15.73:0/3254871552 learned_addr learned my addr 172.21.15.73:0/3254871552 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe1fd400640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 0x7fe2080b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe205e00640 1 -- 172.21.15.73:0/3254871552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 msgr2=0x7fe2080b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe205e00640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 0x7fe2080b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe205e00640 1 -- 172.21.15.73:0/3254871552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe208162480 msgr2=0x7fe2080b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe206800640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe208162480 0x7fe2080b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe205e00640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe208162480 0x7fe2080b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe205e00640 1 -- 172.21.15.73:0/3254871552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2080b6cf0 con 0x7fe20806cb60 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe1fd400640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 0x7fe2080b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe206800640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe208162480 0x7fe2080b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:32:58.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe205e00640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe20806cb60 0x7fe20815da30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80b0040 tx=0x7fe1f8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe1fea00640 1 -- 172.21.15.73:0/3254871552 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80bd020 con 0x7fe20806cb60 2024-04-15T15:32:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe1fea00640 1 -- 172.21.15.73:0/3254871552 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f80b8670 con 0x7fe20806cb60 2024-04-15T15:32:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe207200640 1 -- 172.21.15.73:0/3254871552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2080b5710 con 0x7fe20806cb60 2024-04-15T15:32:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe1fea00640 1 -- 172.21.15.73:0/3254871552 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80b2040 con 0x7fe20806cb60 2024-04-15T15:32:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe207200640 1 -- 172.21.15.73:0/3254871552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2080b5cd0 con 0x7fe20806cb60 2024-04-15T15:32:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe207200640 1 -- 172.21.15.73:0/3254871552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe208068ab0 con 0x7fe20806cb60 2024-04-15T15:32:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.693+0000 7fe1fea00640 1 -- 172.21.15.73:0/3254871552 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe1f80c0020 con 0x7fe20806cb60 2024-04-15T15:32:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.697+0000 7fe1fea00640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe1e4068380 0x7fe1e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:58.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.697+0000 7fe1fea00640 1 -- 172.21.15.73:0/3254871552 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe1f8121b20 con 0x7fe20806cb60 2024-04-15T15:32:58.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.697+0000 7fe1fd400640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe1e4068380 0x7fe1e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:58.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.697+0000 7fe1fd400640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe1e4068380 0x7fe1e406a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0007fd0 tx=0x7fe1f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:58.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.701+0000 7fe1fea00640 1 -- 172.21.15.73:0/3254871552 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe1f80c7030 con 0x7fe20806cb60 2024-04-15T15:32:58.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:58.881+0000 7fe207200640 1 -- 172.21.15.73:0/3254871552 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol_quiesce", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7fe2080703b0 con 0x7fe1e4068380 2024-04-15T15:32:58.888 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:32:58.889+0000 7fa422000640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-15T15:32:58.889 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:32:58.889+0000 7fa422000640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-15T15:32:58.889 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:32:58.889+0000 7fa422000640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-15T15:32:58.889 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:32:58.889+0000 7fa422000640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-15T15:32:58.889 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-15T15:32:58.889+0000 7fa422000640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-15T15:32:59.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.029+0000 7fe1fea00640 1 -- 172.21.15.73:0/3254871552 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe2080703b0 con 0x7fe1e4068380 2024-04-15T15:32:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 -- 172.21.15.73:0/3254871552 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe1e4068380 msgr2=0x7fe1e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe1e4068380 0x7fe1e406a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0007fd0 tx=0x7fe1f0009040 comp rx=0 tx=0).stop 2024-04-15T15:32:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 -- 172.21.15.73:0/3254871552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe20806cb60 msgr2=0x7fe20815da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe20806cb60 0x7fe20815da30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80b0040 tx=0x7fe1f8019680 comp rx=0 tx=0).stop 2024-04-15T15:32:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 -- 172.21.15.73:0/3254871552 shutdown_connections 2024-04-15T15:32:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe208162480 0x7fe2080b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe1e4068380 0x7fe1e406a840 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe20806ff20 0x7fe2080b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 --2- 172.21.15.73:0/3254871552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe20806cb60 0x7fe20815da30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 -- 172.21.15.73:0/3254871552 >> 172.21.15.73:0/3254871552 conn(0x7fe2080b3f20 msgr2=0x7fe20815f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 -- 172.21.15.73:0/3254871552 shutdown_connections 2024-04-15T15:32:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.033+0000 7fe207200640 1 -- 172.21.15.73:0/3254871552 wait complete. 2024-04-15T15:32:59.053 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol_quiesce 2024-04-15T15:32:59.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.189+0000 7f7427200640 1 Processor -- start 2024-04-15T15:32:59.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.189+0000 7f7427200640 1 -- start start 2024-04-15T15:32:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f7427200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 0x7f742015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f7427200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f74200b3e30 0x7f74200b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f7427200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7420070160 con 0x7f742015b5d0 2024-04-15T15:32:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f7427200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f742015b9b0 con 0x7f74200b3e30 2024-04-15T15:32:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f7427200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f742015f1f0 con 0x7f74200b27c0 2024-04-15T15:32:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f7425200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f74200b3e30 0x7f74200b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f741f400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 0x7f742015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f7425200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f74200b3e30 0x7f74200b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:38942/0 (socket says 172.21.15.73:38942) 2024-04-15T15:32:59.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f7425200640 1 -- 172.21.15.73:0/3253461986 learned_addr learned my addr 172.21.15.73:0/3253461986 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:59.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f741f400640 1 -- 172.21.15.73:0/3253461986 >> v2:172.21.15.118:3300/0 conn(0x7f74200b3e30 msgr2=0x7f74200b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:59.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f741f400640 1 --2- 172.21.15.73:0/3253461986 >> v2:172.21.15.118:3300/0 conn(0x7f74200b3e30 0x7f74200b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f741f400640 1 -- 172.21.15.73:0/3253461986 >> v1:172.21.15.118:6789/0 conn(0x7f742015b5d0 legacy=0x7f74200b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f741f400640 1 -- 172.21.15.73:0/3253461986 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742006fe80 con 0x7f74200b27c0 2024-04-15T15:32:59.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.193+0000 7f7425200640 1 --2- 172.21.15.73:0/3253461986 >> v2:172.21.15.118:3300/0 conn(0x7f74200b3e30 0x7f74200b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:32:59.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f741f400640 1 --2- 172.21.15.73:0/3253461986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 0x7f742015fc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f740c0097c0 tx=0x7f740c01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e4723b8a7d965c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:59.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f741ea00640 1 -- 172.21.15.73:0/3253461986 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c0b0070 con 0x7f74200b27c0 2024-04-15T15:32:59.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f741ea00640 1 -- 172.21.15.73:0/3253461986 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c004030 con 0x7f74200b27c0 2024-04-15T15:32:59.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f741ea00640 1 -- 172.21.15.73:0/3253461986 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c004440 con 0x7f74200b27c0 2024-04-15T15:32:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 -- 172.21.15.73:0/3253461986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 msgr2=0x7f742015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 --2- 172.21.15.73:0/3253461986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 0x7f742015fc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f740c0097c0 tx=0x7f740c01c350 comp rx=0 tx=0).stop 2024-04-15T15:32:59.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 -- 172.21.15.73:0/3253461986 shutdown_connections 2024-04-15T15:32:59.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 --2- 172.21.15.73:0/3253461986 >> v2:172.21.15.118:3300/0 conn(0x7f74200b3e30 0x7f74200b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 --2- 172.21.15.73:0/3253461986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 0x7f742015fc90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 -- 172.21.15.73:0/3253461986 >> 172.21.15.73:0/3253461986 conn(0x7f7420067dd0 msgr2=0x7f74200d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:59.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 -- 172.21.15.73:0/3253461986 shutdown_connections 2024-04-15T15:32:59.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 -- 172.21.15.73:0/3253461986 wait complete. 2024-04-15T15:32:59.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 Processor -- start 2024-04-15T15:32:59.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 -- start start 2024-04-15T15:32:59.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 0x7f74200adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.197+0000 7f7427200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74200b3e30 0x7f742015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7427200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f742015b5d0 0x7f742014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7427200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f742006faa0 con 0x7f74200b3e30 2024-04-15T15:32:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7427200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f74200b4240 con 0x7f742015b5d0 2024-04-15T15:32:59.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7427200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f742006fc20 con 0x7f74200b27c0 2024-04-15T15:32:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f741f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74200b3e30 0x7f742015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f741f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74200b3e30 0x7f742015a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59278/0 (socket says 172.21.15.73:59278) 2024-04-15T15:32:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f741fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 0x7f74200adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f741f400640 1 -- 172.21.15.73:0/243865711 learned_addr learned my addr 172.21.15.73:0/243865711 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7425200640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f742015b5d0 0x7f742014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f741f400640 1 -- 172.21.15.73:0/243865711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 msgr2=0x7f74200adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f741f400640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 0x7f74200adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f741f400640 1 -- 172.21.15.73:0/243865711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f742015b5d0 msgr2=0x7f742014bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f741f400640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f742015b5d0 0x7f742014bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f741f400640 1 -- 172.21.15.73:0/243865711 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74200ae5b0 con 0x7f74200b3e30 2024-04-15T15:32:59.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f741f400640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74200b3e30 0x7f742015a460 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f740c019f80 tx=0x7f740c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:59.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7417e00640 1 -- 172.21.15.73:0/243865711 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c0b9070 con 0x7f74200b3e30 2024-04-15T15:32:59.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7417e00640 1 -- 172.21.15.73:0/243865711 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c003b00 con 0x7f74200b3e30 2024-04-15T15:32:59.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7427200640 1 -- 172.21.15.73:0/243865711 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74200ae890 con 0x7f74200b3e30 2024-04-15T15:32:59.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7417e00640 1 -- 172.21.15.73:0/243865711 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c0b0040 con 0x7f74200b3e30 2024-04-15T15:32:59.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7427200640 1 -- 172.21.15.73:0/243865711 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74200aee50 con 0x7f74200b3e30 2024-04-15T15:32:59.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7427200640 1 -- 172.21.15.73:0/243865711 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7420068ab0 con 0x7f74200b3e30 2024-04-15T15:32:59.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.201+0000 7f7417e00640 1 -- 172.21.15.73:0/243865711 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f740c0bc070 con 0x7f74200b3e30 2024-04-15T15:32:59.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.205+0000 7f7417e00640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7400068380 0x7f740006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.205+0000 7f7417e00640 1 -- 172.21.15.73:0/243865711 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f740c120dc0 con 0x7f74200b3e30 2024-04-15T15:32:59.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.205+0000 7f741fe00640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7400068380 0x7f740006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.205+0000 7f741fe00640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7400068380 0x7f740006a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f74201faa60 tx=0x7f7410009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:59.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.209+0000 7f7417e00640 1 -- 172.21.15.73:0/243865711 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f740c016090 con 0x7f74200b3e30 2024-04-15T15:32:59.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.393+0000 7f7427200640 1 -- 172.21.15.73:0/243865711 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol_quiesce", "target": ["mon-mgr", ""]}) -- 0x7f74200afce0 con 0x7f7400068380 2024-04-15T15:32:59.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.397+0000 7f7417e00640 1 -- 172.21.15.73:0/243865711 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+70 (secure 0 0 0) 0x7f74200afce0 con 0x7f7400068380 2024-04-15T15:32:59.398 INFO:teuthology.orchestra.run.smithi073.stdout:/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.397+0000 7f7427200640 1 -- 172.21.15.73:0/243865711 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7400068380 msgr2=0x7f740006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.397+0000 7f7427200640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7400068380 0x7f740006a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f74201faa60 tx=0x7f7410009040 comp rx=0 tx=0).stop 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.397+0000 7f7427200640 1 -- 172.21.15.73:0/243865711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74200b3e30 msgr2=0x7f742015a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.397+0000 7f7427200640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74200b3e30 0x7f742015a460 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f740c019f80 tx=0x7f740c0190f0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.401+0000 7f7427200640 1 -- 172.21.15.73:0/243865711 shutdown_connections 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.401+0000 7f7427200640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f742015b5d0 0x7f742014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.401+0000 7f7427200640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74200b3e30 0x7f742015a460 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.401+0000 7f7427200640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7400068380 0x7f740006a840 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.401+0000 7f7427200640 1 --2- 172.21.15.73:0/243865711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74200b27c0 0x7f74200adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.401+0000 7f7427200640 1 -- 172.21.15.73:0/243865711 >> 172.21.15.73:0/243865711 conn(0x7f7420067dd0 msgr2=0x7f74200cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.401+0000 7f7427200640 1 -- 172.21.15.73:0/243865711 shutdown_connections 2024-04-15T15:32:59.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.401+0000 7f7427200640 1 -- 172.21.15.73:0/243865711 wait complete. 2024-04-15T15:32:59.419 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:59.419 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:59.428 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:32:59.429 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:32:59.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:32:59.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.657+0000 7f4801e00640 1 Processor -- start 2024-04-15T15:32:59.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.657+0000 7f4801e00640 1 -- start start 2024-04-15T15:32:59.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.657+0000 7f4801e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f47fc0b27c0 0x7f47fc15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.657+0000 7f4801e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47fc0b3e30 0x7f47fc0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.657+0000 7f4801e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47fc070160 con 0x7f47fc15b5d0 2024-04-15T15:32:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.657+0000 7f4801e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f47fc15b9b0 con 0x7f47fc0b3e30 2024-04-15T15:32:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.657+0000 7f4801e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f47fc15f1f0 con 0x7f47fc0b27c0 2024-04-15T15:32:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fb400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47fc0b3e30 0x7f47fc0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fb400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47fc0b3e30 0x7f47fc0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59292/0 (socket says 172.21.15.73:59292) 2024-04-15T15:32:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fb400640 1 -- 172.21.15.73:0/1039153862 learned_addr learned my addr 172.21.15.73:0/1039153862 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47f2000640 1 --2- 172.21.15.73:0/1039153862 >> v2:172.21.15.118:3300/0 conn(0x7f47fc0b27c0 0x7f47fc15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fb400640 1 -- 172.21.15.73:0/1039153862 >> v2:172.21.15.118:3300/0 conn(0x7f47fc0b27c0 msgr2=0x7f47fc15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fb400640 1 --2- 172.21.15.73:0/1039153862 >> v2:172.21.15.118:3300/0 conn(0x7f47fc0b27c0 0x7f47fc15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fb400640 1 -- 172.21.15.73:0/1039153862 >> v1:172.21.15.118:6789/0 conn(0x7f47fc15b5d0 legacy=0x7f47fc0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fb400640 1 -- 172.21.15.73:0/1039153862 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc06fe80 con 0x7f47fc0b3e30 2024-04-15T15:32:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fb400640 1 --2- 172.21.15.73:0/1039153862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 0x7f47fc0b4740 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0b2c50 tx=0x7f47f401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac95d79210a2c46c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fa000640 1 -- 172.21.15.73:0/1039153862 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f40090d0 con 0x7f47fc0b3e30 2024-04-15T15:32:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fa000640 1 -- 172.21.15.73:0/1039153862 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f40a5720 con 0x7f47fc0b3e30 2024-04-15T15:32:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.661+0000 7f47fa000640 1 -- 172.21.15.73:0/1039153862 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4009270 con 0x7f47fc0b3e30 2024-04-15T15:32:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 -- 172.21.15.73:0/1039153862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 msgr2=0x7f47fc0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 --2- 172.21.15.73:0/1039153862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 0x7f47fc0b4740 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0b2c50 tx=0x7f47f401c860 comp rx=0 tx=0).stop 2024-04-15T15:32:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 -- 172.21.15.73:0/1039153862 shutdown_connections 2024-04-15T15:32:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 --2- 172.21.15.73:0/1039153862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 0x7f47fc0b4740 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 --2- 172.21.15.73:0/1039153862 >> v2:172.21.15.118:3300/0 conn(0x7f47fc0b27c0 0x7f47fc15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 -- 172.21.15.73:0/1039153862 >> 172.21.15.73:0/1039153862 conn(0x7f47fc067dd0 msgr2=0x7f47fc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 -- 172.21.15.73:0/1039153862 shutdown_connections 2024-04-15T15:32:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 -- 172.21.15.73:0/1039153862 wait complete. 2024-04-15T15:32:59.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 Processor -- start 2024-04-15T15:32:59.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 -- start start 2024-04-15T15:32:59.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47fc0b27c0 0x7f47fc15d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 0x7f47fc0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47fc15b5d0 0x7f47fc165100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc06faa0 con 0x7f47fc0b3e30 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc0b4240 con 0x7f47fc0b27c0 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f4801e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f47fc06fc20 con 0x7f47fc15b5d0 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47f2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 0x7f47fc0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47f2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 0x7f47fc0b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59298/0 (socket says 172.21.15.73:59298) 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47f2000640 1 -- 172.21.15.73:0/1994360527 learned_addr learned my addr 172.21.15.73:0/1994360527 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47faa00640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47fc0b27c0 0x7f47fc15d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47fb400640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47fc15b5d0 0x7f47fc165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47f2000640 1 -- 172.21.15.73:0/1994360527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47fc15b5d0 msgr2=0x7f47fc165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47f2000640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47fc15b5d0 0x7f47fc165100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47f2000640 1 -- 172.21.15.73:0/1994360527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47fc0b27c0 msgr2=0x7f47fc15d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47f2000640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47fc0b27c0 0x7f47fc15d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47f2000640 1 -- 172.21.15.73:0/1994360527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc06f6b0 con 0x7f47fc0b3e30 2024-04-15T15:32:59.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.665+0000 7f47fb400640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47fc15b5d0 0x7f47fc165100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:32:59.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f47f2000640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 0x7f47fc0b1690 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f47e400d620 tx=0x7f47e400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:59.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f47f3e00640 1 -- 172.21.15.73:0/1994360527 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40125f0 con 0x7f47fc0b3e30 2024-04-15T15:32:59.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f47f3e00640 1 -- 172.21.15.73:0/1994360527 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e4019070 con 0x7f47fc0b3e30 2024-04-15T15:32:59.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f4801e00640 1 -- 172.21.15.73:0/1994360527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47fc072c50 con 0x7f47fc0b3e30 2024-04-15T15:32:59.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f47f3e00640 1 -- 172.21.15.73:0/1994360527 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40129b0 con 0x7f47fc0b3e30 2024-04-15T15:32:59.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f4801e00640 1 -- 172.21.15.73:0/1994360527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47fc15ca80 con 0x7f47fc0b3e30 2024-04-15T15:32:59.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f4801e00640 1 -- 172.21.15.73:0/1994360527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47fc068ab0 con 0x7f47fc0b3e30 2024-04-15T15:32:59.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f47f3e00640 1 -- 172.21.15.73:0/1994360527 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47e4012b50 con 0x7f47fc0b3e30 2024-04-15T15:32:59.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f47f3e00640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f47d8068380 0x7f47d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f47f3e00640 1 -- 172.21.15.73:0/1994360527 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f47e4086f00 con 0x7f47fc0b3e30 2024-04-15T15:32:59.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.669+0000 7f47faa00640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f47d8068380 0x7f47d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.673+0000 7f47faa00640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f47d8068380 0x7f47d806a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f47ec007fd0 tx=0x7f47ec007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:32:59.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.677+0000 7f47f3e00640 1 -- 172.21.15.73:0/1994360527 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f47e4057290 con 0x7f47fc0b3e30 2024-04-15T15:32:59.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.833+0000 7f4801e00640 1 -- 172.21.15.73:0/1994360527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47fc06f370 con 0x7f47fc0b3e30 2024-04-15T15:32:59.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f47f3e00640 1 -- 172.21.15.73:0/1994360527 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16918 (secure 0 0 0) 0x7f47e4056b90 con 0x7f47fc0b3e30 2024-04-15T15:32:59.837 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:32:59.837 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":39,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:50.731602+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:32:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 -- 172.21.15.73:0/1994360527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f47d8068380 msgr2=0x7f47d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f47d8068380 0x7f47d806a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f47ec007fd0 tx=0x7f47ec007e40 comp rx=0 tx=0).stop 2024-04-15T15:32:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 -- 172.21.15.73:0/1994360527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 msgr2=0x7f47fc0b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 0x7f47fc0b1690 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f47e400d620 tx=0x7f47e400dae0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 -- 172.21.15.73:0/1994360527 shutdown_connections 2024-04-15T15:32:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f47d8068380 0x7f47d806a840 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47fc15b5d0 0x7f47fc165100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47fc0b3e30 0x7f47fc0b1690 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 --2- 172.21.15.73:0/1994360527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47fc0b27c0 0x7f47fc15d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 -- 172.21.15.73:0/1994360527 >> 172.21.15.73:0/1994360527 conn(0x7f47fc067dd0 msgr2=0x7f47fc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:32:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 -- 172.21.15.73:0/1994360527 shutdown_connections 2024-04-15T15:32:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.837+0000 7f4801e00640 1 -- 172.21.15.73:0/1994360527 wait complete. 2024-04-15T15:32:59.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:32:46.793984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:32:48.072270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T15:32:59.858 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:32:59.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f12a1400640 1 Processor -- start 2024-04-15T15:32:59.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f12a1400640 1 -- start start 2024-04-15T15:32:59.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f12a1400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f129c15b5d0 0x7f129c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f12a1400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f129c0b27c0 0x7f129c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:32:59.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f12a1400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c070160 con 0x7f129c0b3e30 2024-04-15T15:32:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f12a1400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f129c15b9b0 con 0x7f129c0b27c0 2024-04-15T15:32:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f12a1400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f129c15f1f0 con 0x7f129c15b5d0 2024-04-15T15:32:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f129b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f129c0b27c0 0x7f129c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f129b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f129c0b27c0 0x7f129c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59310/0 (socket says 172.21.15.73:59310) 2024-04-15T15:32:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f129b200640 1 -- 172.21.15.73:0/958866724 learned_addr learned my addr 172.21.15.73:0/958866724 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:32:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f129a800640 1 --2- 172.21.15.73:0/958866724 >> v2:172.21.15.118:3300/0 conn(0x7f129c15b5d0 0x7f129c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:32:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f129b200640 1 -- 172.21.15.73:0/958866724 >> v2:172.21.15.118:3300/0 conn(0x7f129c15b5d0 msgr2=0x7f129c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:32:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f129b200640 1 --2- 172.21.15.73:0/958866724 >> v2:172.21.15.118:3300/0 conn(0x7f129c15b5d0 0x7f129c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:32:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f129b200640 1 -- 172.21.15.73:0/958866724 >> v1:172.21.15.118:6789/0 conn(0x7f129c0b3e30 legacy=0x7f129c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:32:59.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:32:59.997+0000 7f129b200640 1 -- 172.21.15.73:0/958866724 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c06fe80 con 0x7f129c0b27c0 2024-04-15T15:33:00.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f129b200640 1 --2- 172.21.15.73:0/958866724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c0b27c0 0x7f129c0b4740 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1294009e50 tx=0x7f129401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26104b3357318015 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f1299400640 1 -- 172.21.15.73:0/958866724 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12940090d0 con 0x7f129c0b27c0 2024-04-15T15:33:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f1299400640 1 -- 172.21.15.73:0/958866724 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12940a5760 con 0x7f129c0b27c0 2024-04-15T15:33:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f1299400640 1 -- 172.21.15.73:0/958866724 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1294009270 con 0x7f129c0b27c0 2024-04-15T15:33:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f12a1400640 1 -- 172.21.15.73:0/958866724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c0b27c0 msgr2=0x7f129c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f12a1400640 1 --2- 172.21.15.73:0/958866724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c0b27c0 0x7f129c0b4740 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1294009e50 tx=0x7f129401c8a0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f12a1400640 1 -- 172.21.15.73:0/958866724 shutdown_connections 2024-04-15T15:33:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f12a1400640 1 --2- 172.21.15.73:0/958866724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c0b27c0 0x7f129c0b4740 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f12a1400640 1 --2- 172.21.15.73:0/958866724 >> v2:172.21.15.118:3300/0 conn(0x7f129c15b5d0 0x7f129c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f12a1400640 1 -- 172.21.15.73:0/958866724 >> 172.21.15.73:0/958866724 conn(0x7f129c067dd0 msgr2=0x7f129c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f12a1400640 1 -- 172.21.15.73:0/958866724 shutdown_connections 2024-04-15T15:33:00.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.001+0000 7f12a1400640 1 -- 172.21.15.73:0/958866724 wait complete. 2024-04-15T15:33:00.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f12a1400640 1 Processor -- start 2024-04-15T15:33:00.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f12a1400640 1 -- start start 2024-04-15T15:33:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f12a1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f129c0b27c0 0x7f129c15eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f12a1400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f129c0b3e30 0x7f129c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f12a1400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c15b5d0 0x7f129c157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f12a1400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f129c06faa0 con 0x7f129c15b5d0 2024-04-15T15:33:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f12a1400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f129c0b4240 con 0x7f129c0b27c0 2024-04-15T15:33:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f12a1400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f129c06fc20 con 0x7f129c0b3e30 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f129b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c15b5d0 0x7f129c157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f129b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c15b5d0 0x7f129c157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59322/0 (socket says 172.21.15.73:59322) 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f129b200640 1 -- 172.21.15.73:0/2998926699 learned_addr learned my addr 172.21.15.73:0/2998926699 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f129a800640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f129c0b27c0 0x7f129c15eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f1299e00640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f129c0b3e30 0x7f129c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f129b200640 1 -- 172.21.15.73:0/2998926699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f129c0b3e30 msgr2=0x7f129c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f129b200640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f129c0b3e30 0x7f129c15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f129b200640 1 -- 172.21.15.73:0/2998926699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f129c0b27c0 msgr2=0x7f129c15eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f129b200640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f129c0b27c0 0x7f129c15eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f129b200640 1 -- 172.21.15.73:0/2998926699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c15c2c0 con 0x7f129c15b5d0 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f1299e00640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f129c0b3e30 0x7f129c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f129b200640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c15b5d0 0x7f129c157d50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f12940af040 tx=0x7f1294019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f1292a00640 1 -- 172.21.15.73:0/2998926699 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12940bc020 con 0x7f129c15b5d0 2024-04-15T15:33:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f1292a00640 1 -- 172.21.15.73:0/2998926699 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12940b8670 con 0x7f129c15b5d0 2024-04-15T15:33:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f1292a00640 1 -- 172.21.15.73:0/2998926699 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1294009510 con 0x7f129c15b5d0 2024-04-15T15:33:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f12a1400640 1 -- 172.21.15.73:0/2998926699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129c15c540 con 0x7f129c15b5d0 2024-04-15T15:33:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.005+0000 7f12a1400640 1 -- 172.21.15.73:0/2998926699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f129c15cb00 con 0x7f129c15b5d0 2024-04-15T15:33:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.009+0000 7f12a1400640 1 -- 172.21.15.73:0/2998926699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f129c068ab0 con 0x7f129c15b5d0 2024-04-15T15:33:00.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.009+0000 7f1292a00640 1 -- 172.21.15.73:0/2998926699 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12940bf020 con 0x7f129c15b5d0 2024-04-15T15:33:00.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.009+0000 7f1292a00640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f127c068380 0x7f127c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.009+0000 7f1292a00640 1 -- 172.21.15.73:0/2998926699 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f12941219e0 con 0x7f129c15b5d0 2024-04-15T15:33:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.009+0000 7f129a800640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f127c068380 0x7f127c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.009+0000 7f129a800640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f127c068380 0x7f127c06a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f128c009b60 tx=0x7f128c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.013+0000 7f1292a00640 1 -- 172.21.15.73:0/2998926699 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12940c6030 con 0x7f129c15b5d0 2024-04-15T15:33:00.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.173+0000 7f12a1400640 1 -- 172.21.15.73:0/2998926699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f129c06cdf0 con 0x7f129c15b5d0 2024-04-15T15:33:00.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f1292a00640 1 -- 172.21.15.73:0/2998926699 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f129c15c2c0 con 0x7f129c15b5d0 2024-04-15T15:33:00.178 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 -- 172.21.15.73:0/2998926699 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f127c068380 msgr2=0x7f127c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f127c068380 0x7f127c06a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f128c009b60 tx=0x7f128c009190 comp rx=0 tx=0).stop 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 -- 172.21.15.73:0/2998926699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c15b5d0 msgr2=0x7f129c157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c15b5d0 0x7f129c157d50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f12940af040 tx=0x7f1294019640 comp rx=0 tx=0).stop 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 -- 172.21.15.73:0/2998926699 shutdown_connections 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f129c15b5d0 0x7f129c157d50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f127c068380 0x7f127c06a840 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f129c0b3e30 0x7f129c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 --2- 172.21.15.73:0/2998926699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f129c0b27c0 0x7f129c15eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 -- 172.21.15.73:0/2998926699 >> 172.21.15.73:0/2998926699 conn(0x7f129c067dd0 msgr2=0x7f129c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:00.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 -- 172.21.15.73:0/2998926699 shutdown_connections 2024-04-15T15:33:00.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.177+0000 7f12a1400640 1 -- 172.21.15.73:0/2998926699 wait complete. 2024-04-15T15:33:00.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:33:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc51d200640 1 Processor -- start 2024-04-15T15:33:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc51d200640 1 -- start start 2024-04-15T15:33:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc51d200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc51809b170 0x7fc51815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc51d200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5180d0d40 con 0x7fc5180b17a0 2024-04-15T15:33:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc51d200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5180d1000 con 0x7fc5180d08b0 2024-04-15T15:33:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc51d200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc5180d12e0 con 0x7fc51809b170 2024-04-15T15:33:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc515e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc5180b17a0 0x7fc51806dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44950/0 (socket says 172.21.15.73:44950) 2024-04-15T15:33:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc515e00640 1 -- 172.21.15.73:0/3763486146 learned_addr learned my addr 172.21.15.73:0/3763486146 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc516800640 1 --2- 172.21.15.73:0/3763486146 >> v2:172.21.15.73:3300/0 conn(0x7fc51809b170 0x7fc51815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc516800640 1 -- 172.21.15.73:0/3763486146 >> v1:172.21.15.118:6789/0 conn(0x7fc5180d08b0 legacy=0x7fc51809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc516800640 1 -- 172.21.15.73:0/3763486146 >> v1:172.21.15.73:6789/0 conn(0x7fc5180b17a0 legacy=0x7fc51806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc516800640 1 -- 172.21.15.73:0/3763486146 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5180d15c0 con 0x7fc51809b170 2024-04-15T15:33:00.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.353+0000 7fc514a00640 1 -- 172.21.15.73:0/3763486146 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1781331576 0 0) 0x7fc5180d0d40 con 0x7fc5180b17a0 2024-04-15T15:33:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc516800640 1 --2- 172.21.15.73:0/3763486146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51809b170 0x7fc51815e160 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc510009d90 tx=0x7fc51001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741fa7bf43ff3b37 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc514a00640 1 -- 172.21.15.73:0/3763486146 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5100b2070 con 0x7fc51809b170 2024-04-15T15:33:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc514a00640 1 -- 172.21.15.73:0/3763486146 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5100a5a00 con 0x7fc51809b170 2024-04-15T15:33:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc514a00640 1 -- 172.21.15.73:0/3763486146 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5100a5dd0 con 0x7fc51809b170 2024-04-15T15:33:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc51d200640 1 -- 172.21.15.73:0/3763486146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51809b170 msgr2=0x7fc51815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc51d200640 1 --2- 172.21.15.73:0/3763486146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51809b170 0x7fc51815e160 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc510009d90 tx=0x7fc51001c940 comp rx=0 tx=0).stop 2024-04-15T15:33:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc51d200640 1 -- 172.21.15.73:0/3763486146 shutdown_connections 2024-04-15T15:33:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc51d200640 1 --2- 172.21.15.73:0/3763486146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51809b170 0x7fc51815e160 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc51d200640 1 -- 172.21.15.73:0/3763486146 >> 172.21.15.73:0/3763486146 conn(0x7fc5180b3fe0 msgr2=0x7fc5180b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc51d200640 1 -- 172.21.15.73:0/3763486146 shutdown_connections 2024-04-15T15:33:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc51d200640 1 -- 172.21.15.73:0/3763486146 wait complete. 2024-04-15T15:33:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc51d200640 1 Processor -- start 2024-04-15T15:33:00.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.357+0000 7fc51d200640 1 -- start start 2024-04-15T15:33:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc51d200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc51809b170 0x7fc518161900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc51d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5180b17a0 0x7fc5180c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc51d200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5180d08b0 0x7fc5180b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc51d200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc51816c890 con 0x7fc5180d08b0 2024-04-15T15:33:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc51d200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc5180b1dd0 con 0x7fc5180b17a0 2024-04-15T15:33:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc51d200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc51816ca10 con 0x7fc51809b170 2024-04-15T15:33:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc516800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5180d08b0 0x7fc5180b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc516800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5180d08b0 0x7fc5180b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59348/0 (socket says 172.21.15.73:59348) 2024-04-15T15:33:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc516800640 1 -- 172.21.15.73:0/111418312 learned_addr learned my addr 172.21.15.73:0/111418312 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc515e00640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc51809b170 0x7fc518161900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc515400640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5180b17a0 0x7fc5180c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc516800640 1 -- 172.21.15.73:0/111418312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc51809b170 msgr2=0x7fc518161900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc516800640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc51809b170 0x7fc518161900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc516800640 1 -- 172.21.15.73:0/111418312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5180b17a0 msgr2=0x7fc5180c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc516800640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5180b17a0 0x7fc5180c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc516800640 1 -- 172.21.15.73:0/111418312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc518161e40 con 0x7fc5180d08b0 2024-04-15T15:33:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc516800640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5180d08b0 0x7fc5180b6cb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc5100b0040 tx=0x7fc5100196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc50e000640 1 -- 172.21.15.73:0/111418312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5100b2040 con 0x7fc5180d08b0 2024-04-15T15:33:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc50e000640 1 -- 172.21.15.73:0/111418312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc510003ba0 con 0x7fc5180d08b0 2024-04-15T15:33:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc50e000640 1 -- 172.21.15.73:0/111418312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5100ad700 con 0x7fc5180d08b0 2024-04-15T15:33:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc51d200640 1 -- 172.21.15.73:0/111418312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5180c8b60 con 0x7fc5180d08b0 2024-04-15T15:33:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc51d200640 1 -- 172.21.15.73:0/111418312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5180b5e30 con 0x7fc5180d08b0 2024-04-15T15:33:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc51d200640 1 -- 172.21.15.73:0/111418312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc518068ab0 con 0x7fc5180d08b0 2024-04-15T15:33:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.361+0000 7fc50e000640 1 -- 172.21.15.73:0/111418312 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fc5100c2060 con 0x7fc5180d08b0 2024-04-15T15:33:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.365+0000 7fc50e000640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4f8068410 0x7fc4f806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.365+0000 7fc50e000640 1 -- 172.21.15.73:0/111418312 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc510120f50 con 0x7fc5180d08b0 2024-04-15T15:33:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.365+0000 7fc515e00640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4f8068410 0x7fc4f806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.365+0000 7fc515e00640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4f8068410 0x7fc4f806a8d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc5080017e0 tx=0x7fc508009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.369+0000 7fc50e000640 1 -- 172.21.15.73:0/111418312 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc5180c8b60 con 0x7fc5180d08b0 2024-04-15T15:33:00.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 -- 172.21.15.73:0/111418312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc5180b4d80 con 0x7fc5180d08b0 2024-04-15T15:33:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc50e000640 1 -- 172.21.15.73:0/111418312 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) ==== 104+0+11 (secure 0 0 0) 0x7fc518161e40 con 0x7fc5180d08b0 2024-04-15T15:33:00.542 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:33:00.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 -- 172.21.15.73:0/111418312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4f8068410 msgr2=0x7fc4f806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4f8068410 0x7fc4f806a8d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc5080017e0 tx=0x7fc508009040 comp rx=0 tx=0).stop 2024-04-15T15:33:00.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 -- 172.21.15.73:0/111418312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5180d08b0 msgr2=0x7fc5180b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5180d08b0 0x7fc5180b6cb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc5100b0040 tx=0x7fc5100196e0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 -- 172.21.15.73:0/111418312 shutdown_connections 2024-04-15T15:33:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5180d08b0 0x7fc5180b6cb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5180b17a0 0x7fc5180c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc4f8068410 0x7fc4f806a8d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 --2- 172.21.15.73:0/111418312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc51809b170 0x7fc518161900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 -- 172.21.15.73:0/111418312 >> 172.21.15.73:0/111418312 conn(0x7fc5180b3fe0 msgr2=0x7fc51806d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 -- 172.21.15.73:0/111418312 shutdown_connections 2024-04-15T15:33:00.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.541+0000 7fc51d200640 1 -- 172.21.15.73:0/111418312 wait complete. 2024-04-15T15:33:00.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:33:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c48e00640 1 Processor -- start 2024-04-15T15:33:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c48e00640 1 -- start start 2024-04-15T15:33:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c48e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c440b27c0 0x7f7c4415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c48e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c44070160 con 0x7f7c4415b5d0 2024-04-15T15:33:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c48e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4415f1f0 con 0x7f7c440b3e30 2024-04-15T15:33:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c48e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7c4415b9b0 con 0x7f7c440b27c0 2024-04-15T15:33:00.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c41e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7c4415b5d0 0x7f7c440b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44960/0 (socket says 172.21.15.73:44960) 2024-04-15T15:33:00.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c41e00640 1 -- 172.21.15.73:0/4185596969 learned_addr learned my addr 172.21.15.73:0/4185596969 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:00.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c39400640 1 --2- 172.21.15.73:0/4185596969 >> v2:172.21.15.73:3300/0 conn(0x7f7c440b27c0 0x7f7c4415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c39400640 1 -- 172.21.15.73:0/4185596969 >> v1:172.21.15.118:6789/0 conn(0x7f7c440b3e30 legacy=0x7f7c440b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:00.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c39400640 1 -- 172.21.15.73:0/4185596969 >> v1:172.21.15.73:6789/0 conn(0x7f7c4415b5d0 legacy=0x7f7c440b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c41400640 1 -- 172.21.15.73:0/4185596969 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075301004 0 0) 0x7f7c44070160 con 0x7f7c4415b5d0 2024-04-15T15:33:00.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.701+0000 7f7c39400640 1 -- 172.21.15.73:0/4185596969 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4406fe80 con 0x7f7c440b27c0 2024-04-15T15:33:00.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c39400640 1 --2- 172.21.15.73:0/4185596969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 0x7f7c4415fc90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0097c0 tx=0x7f7c2c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02340273407e642 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:00.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c41400640 1 -- 172.21.15.73:0/4185596969 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c0b0070 con 0x7f7c440b27c0 2024-04-15T15:33:00.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c41400640 1 -- 172.21.15.73:0/4185596969 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2c0ab600 con 0x7f7c440b27c0 2024-04-15T15:33:00.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c41400640 1 -- 172.21.15.73:0/4185596969 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c0ab9d0 con 0x7f7c440b27c0 2024-04-15T15:33:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c48e00640 1 -- 172.21.15.73:0/4185596969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 msgr2=0x7f7c4415fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c48e00640 1 --2- 172.21.15.73:0/4185596969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 0x7f7c4415fc90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0097c0 tx=0x7f7c2c01c2e0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c48e00640 1 -- 172.21.15.73:0/4185596969 shutdown_connections 2024-04-15T15:33:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c48e00640 1 --2- 172.21.15.73:0/4185596969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 0x7f7c4415fc90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c48e00640 1 -- 172.21.15.73:0/4185596969 >> 172.21.15.73:0/4185596969 conn(0x7f7c44067dd0 msgr2=0x7f7c440d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:00.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c48e00640 1 -- 172.21.15.73:0/4185596969 shutdown_connections 2024-04-15T15:33:00.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.705+0000 7f7c48e00640 1 -- 172.21.15.73:0/4185596969 wait complete. 2024-04-15T15:33:00.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c48e00640 1 Processor -- start 2024-04-15T15:33:00.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c48e00640 1 -- start start 2024-04-15T15:33:00.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c48e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 0x7f7c440ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c48e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c440b3e30 0x7f7c441522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c48e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4415b5d0 0x7f7c44151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c48e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4406faa0 con 0x7f7c440b27c0 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c48e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7c440b4240 con 0x7f7c4415b5d0 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c48e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4406fc20 con 0x7f7c440b3e30 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c41e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 0x7f7c440ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c39400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c440b3e30 0x7f7c441522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c41e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 0x7f7c440ab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59368/0 (socket says 172.21.15.73:59368) 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c41e00640 1 -- 172.21.15.73:0/2020851156 learned_addr learned my addr 172.21.15.73:0/2020851156 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c42800640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4415b5d0 0x7f7c44151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c39400640 1 -- 172.21.15.73:0/2020851156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4415b5d0 msgr2=0x7f7c44151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c39400640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4415b5d0 0x7f7c44151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c39400640 1 -- 172.21.15.73:0/2020851156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 msgr2=0x7f7c440ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c39400640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 0x7f7c440ab3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c39400640 1 -- 172.21.15.73:0/2020851156 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c441535a0 con 0x7f7c440b3e30 2024-04-15T15:33:00.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c41e00640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 0x7f7c440ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:00.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c39400640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c440b3e30 0x7f7c441522b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0ab000 tx=0x7f7c2c01ab20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:00.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c3aa00640 1 -- 172.21.15.73:0/2020851156 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c0b0050 con 0x7f7c440b3e30 2024-04-15T15:33:00.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c3aa00640 1 -- 172.21.15.73:0/2020851156 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2c0bc070 con 0x7f7c440b3e30 2024-04-15T15:33:00.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c3aa00640 1 -- 172.21.15.73:0/2020851156 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c0b5a90 con 0x7f7c440b3e30 2024-04-15T15:33:00.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c48e00640 1 -- 172.21.15.73:0/2020851156 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c44152a20 con 0x7f7c440b3e30 2024-04-15T15:33:00.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.709+0000 7f7c48e00640 1 -- 172.21.15.73:0/2020851156 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c44152fe0 con 0x7f7c440b3e30 2024-04-15T15:33:00.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.713+0000 7f7c48e00640 1 -- 172.21.15.73:0/2020851156 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c44068ab0 con 0x7f7c440b3e30 2024-04-15T15:33:00.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.713+0000 7f7c3aa00640 1 -- 172.21.15.73:0/2020851156 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f7c2c0ab4c0 con 0x7f7c440b3e30 2024-04-15T15:33:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.713+0000 7f7c3aa00640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c20068410 0x7f7c2006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:00.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.713+0000 7f7c3aa00640 1 -- 172.21.15.73:0/2020851156 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f7c2c121360 con 0x7f7c440b3e30 2024-04-15T15:33:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.713+0000 7f7c41e00640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c20068410 0x7f7c2006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:00.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.713+0000 7f7c41e00640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c20068410 0x7f7c2006a8d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7c34000f70 tx=0x7f7c34007e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:00.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.717+0000 7f7c3aa00640 1 -- 172.21.15.73:0/2020851156 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c441535a0 con 0x7f7c440b3e30 2024-04-15T15:33:00.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.873+0000 7f7c48e00640 1 -- 172.21.15.73:0/2020851156 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7c440afc90 con 0x7f7c440b3e30 2024-04-15T15:33:00.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c3aa00640 1 -- 172.21.15.73:0/2020851156 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) ==== 100+0+11 (secure 0 0 0) 0x7f7c2c016050 con 0x7f7c440b3e30 2024-04-15T15:33:00.876 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:33:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 -- 172.21.15.73:0/2020851156 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c20068410 msgr2=0x7f7c2006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c20068410 0x7f7c2006a8d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7c34000f70 tx=0x7f7c34007e20 comp rx=0 tx=0).stop 2024-04-15T15:33:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 -- 172.21.15.73:0/2020851156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c440b3e30 msgr2=0x7f7c441522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c440b3e30 0x7f7c441522b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0ab000 tx=0x7f7c2c01ab20 comp rx=0 tx=0).stop 2024-04-15T15:33:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 -- 172.21.15.73:0/2020851156 shutdown_connections 2024-04-15T15:33:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4415b5d0 0x7f7c44151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7c20068410 0x7f7c2006a8d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c440b3e30 0x7f7c441522b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 --2- 172.21.15.73:0/2020851156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b27c0 0x7f7c440ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:00.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 -- 172.21.15.73:0/2020851156 >> 172.21.15.73:0/2020851156 conn(0x7f7c44067dd0 msgr2=0x7f7c44155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:00.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 -- 172.21.15.73:0/2020851156 shutdown_connections 2024-04-15T15:33:00.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:00.877+0000 7f7c48e00640 1 -- 172.21.15.73:0/2020851156 wait complete. 2024-04-15T15:33:00.898 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:33:01.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49f200640 1 Processor -- start 2024-04-15T15:33:01.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49f200640 1 -- start start 2024-04-15T15:33:01.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00d0450 0x7fa4a00cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49f200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa4a00cca10 0x7fa4a006ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49f200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a0073960 con 0x7fa4a01630f0 2024-04-15T15:33:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49f200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a00d0830 con 0x7fa4a00cca10 2024-04-15T15:33:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a00ccf50 con 0x7fa4a00d0450 2024-04-15T15:33:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49e800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa4a01630f0 0x7fa4a015ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44976/0 (socket says 172.21.15.73:44976) 2024-04-15T15:33:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49e800640 1 -- 172.21.15.73:0/382049932 learned_addr learned my addr 172.21.15.73:0/382049932 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49de00640 1 --2- 172.21.15.73:0/382049932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00d0450 0x7fa4a00cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49d400640 1 --2- 172.21.15.73:0/382049932 >> v2:172.21.15.118:3300/0 conn(0x7fa4a00cca10 0x7fa4a006ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49ca00640 1 -- 172.21.15.73:0/382049932 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316762395 0 0) 0x7fa4a0073960 con 0x7fa4a01630f0 2024-04-15T15:33:01.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49ca00640 1 -- 172.21.15.73:0/382049932 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa484003530 con 0x7fa4a01630f0 2024-04-15T15:33:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49ca00640 1 -- 172.21.15.73:0/382049932 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1646000342 0 0) 0x7fa484003530 con 0x7fa4a01630f0 2024-04-15T15:33:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49de00640 1 -- 172.21.15.73:0/382049932 >> v2:172.21.15.118:3300/0 conn(0x7fa4a00cca10 msgr2=0x7fa4a006ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49de00640 1 --2- 172.21.15.73:0/382049932 >> v2:172.21.15.118:3300/0 conn(0x7fa4a00cca10 0x7fa4a006ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49de00640 1 -- 172.21.15.73:0/382049932 >> v1:172.21.15.73:6789/0 conn(0x7fa4a01630f0 legacy=0x7fa4a015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.033+0000 7fa49de00640 1 -- 172.21.15.73:0/382049932 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a00cd230 con 0x7fa4a00d0450 2024-04-15T15:33:01.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.037+0000 7fa49de00640 1 --2- 172.21.15.73:0/382049932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00d0450 0x7fa4a00cc4d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa490009dc0 tx=0x7fa49001c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53eb33281d2b9e3d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.037+0000 7fa49ca00640 1 -- 172.21.15.73:0/382049932 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4900ac070 con 0x7fa4a00d0450 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.037+0000 7fa49ca00640 1 -- 172.21.15.73:0/382049932 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4900a6450 con 0x7fa4a00d0450 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.037+0000 7fa49ca00640 1 -- 172.21.15.73:0/382049932 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498001680 con 0x7fa4a00d0450 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.037+0000 7fa49f200640 1 -- 172.21.15.73:0/382049932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00d0450 msgr2=0x7fa4a00cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.037+0000 7fa49f200640 1 --2- 172.21.15.73:0/382049932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00d0450 0x7fa4a00cc4d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa490009dc0 tx=0x7fa49001c7b0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 -- 172.21.15.73:0/382049932 shutdown_connections 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 --2- 172.21.15.73:0/382049932 >> v2:172.21.15.118:3300/0 conn(0x7fa4a00cca10 0x7fa4a006ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 --2- 172.21.15.73:0/382049932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00d0450 0x7fa4a00cc4d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 -- 172.21.15.73:0/382049932 >> 172.21.15.73:0/382049932 conn(0x7fa4a0072370 msgr2=0x7fa4a0072750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 -- 172.21.15.73:0/382049932 shutdown_connections 2024-04-15T15:33:01.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 -- 172.21.15.73:0/382049932 wait complete. 2024-04-15T15:33:01.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 Processor -- start 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 -- start start 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00cca10 0x7fa4a01576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a00d0450 0x7fa4a0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a01630f0 0x7fa4a01f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a016b910 con 0x7fa4a01630f0 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a0073080 con 0x7fa4a00d0450 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a016ba90 con 0x7fa4a00cca10 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a01630f0 0x7fa4a01f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a01630f0 0x7fa4a01f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59376/0 (socket says 172.21.15.73:59376) 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49e800640 1 -- 172.21.15.73:0/1496011347 learned_addr learned my addr 172.21.15.73:0/1496011347 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49de00640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00cca10 0x7fa4a01576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49d400640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a00d0450 0x7fa4a0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49e800640 1 -- 172.21.15.73:0/1496011347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00cca10 msgr2=0x7fa4a01576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49e800640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00cca10 0x7fa4a01576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49e800640 1 -- 172.21.15.73:0/1496011347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a00d0450 msgr2=0x7fa4a0070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49e800640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a00d0450 0x7fa4a0070410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49e800640 1 -- 172.21.15.73:0/1496011347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a01580f0 con 0x7fa4a01630f0 2024-04-15T15:33:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49e800640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a01630f0 0x7fa4a01f7ca0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa49800c550 tx=0x7fa49800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa496000640 1 -- 172.21.15.73:0/1496011347 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498005cf0 con 0x7fa4a01630f0 2024-04-15T15:33:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa496000640 1 -- 172.21.15.73:0/1496011347 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa498007070 con 0x7fa4a01630f0 2024-04-15T15:33:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.041+0000 7fa49f200640 1 -- 172.21.15.73:0/1496011347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a015dd70 con 0x7fa4a01630f0 2024-04-15T15:33:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.045+0000 7fa496000640 1 -- 172.21.15.73:0/1496011347 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498007420 con 0x7fa4a01630f0 2024-04-15T15:33:01.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.045+0000 7fa49f200640 1 -- 172.21.15.73:0/1496011347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a00b0780 con 0x7fa4a01630f0 2024-04-15T15:33:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.045+0000 7fa49f200640 1 -- 172.21.15.73:0/1496011347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a004fd60 con 0x7fa4a01630f0 2024-04-15T15:33:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.045+0000 7fa496000640 1 -- 172.21.15.73:0/1496011347 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fa4980075c0 con 0x7fa4a01630f0 2024-04-15T15:33:01.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.045+0000 7fa496000640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa480068410 0x7fa48006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.045+0000 7fa496000640 1 -- 172.21.15.73:0/1496011347 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa498086710 con 0x7fa4a01630f0 2024-04-15T15:33:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.045+0000 7fa49de00640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa480068410 0x7fa48006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.045+0000 7fa49de00640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa480068410 0x7fa48006a8d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa4900ae000 tx=0x7fa4900a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:01.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.049+0000 7fa496000640 1 -- 172.21.15.73:0/1496011347 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa4a01580f0 con 0x7fa4a01630f0 2024-04-15T15:33:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.221+0000 7fa49f200640 1 -- 172.21.15.73:0/1496011347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa4a00cffb0 con 0x7fa4a01630f0 2024-04-15T15:33:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.221+0000 7fa496000640 1 -- 172.21.15.73:0/1496011347 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7fa498056500 con 0x7fa4a01630f0 2024-04-15T15:33:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-15T15:33:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 -- 172.21.15.73:0/1496011347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa480068410 msgr2=0x7fa48006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa480068410 0x7fa48006a8d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa4900ae000 tx=0x7fa4900a7000 comp rx=0 tx=0).stop 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 -- 172.21.15.73:0/1496011347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a01630f0 msgr2=0x7fa4a01f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a01630f0 0x7fa4a01f7ca0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa49800c550 tx=0x7fa49800ca10 comp rx=0 tx=0).stop 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 -- 172.21.15.73:0/1496011347 shutdown_connections 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4a01630f0 0x7fa4a01f7ca0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a00d0450 0x7fa4a0070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa480068410 0x7fa48006a8d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 --2- 172.21.15.73:0/1496011347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4a00cca10 0x7fa4a01576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 -- 172.21.15.73:0/1496011347 >> 172.21.15.73:0/1496011347 conn(0x7fa4a0072370 msgr2=0x7fa4a0161c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 -- 172.21.15.73:0/1496011347 shutdown_connections 2024-04-15T15:33:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.225+0000 7fa49f200640 1 -- 172.21.15.73:0/1496011347 wait complete. 2024-04-15T15:33:01.243 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-15T15:33:01.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:01.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-15T15:33:01.274 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:33:01.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:01.274 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-15T15:33:01.324 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:33:01.324 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:01.333 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:33:01.333 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:01.384 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:33:01.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.517+0000 7f4a9aa00640 1 Processor -- start 2024-04-15T15:33:01.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.517+0000 7f4a9aa00640 1 -- start start 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a9aa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a940b27c0 0x7f4a9415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a9aa00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a940b3e30 0x7f4a940b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a9aa00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a94070160 con 0x7f4a9415b5d0 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a9aa00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9415b9b0 con 0x7f4a940b3e30 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a9aa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9415f1f0 con 0x7f4a940b27c0 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a98a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a940b3e30 0x7f4a940b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a93e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4a9415b5d0 0x7f4a940b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44978/0 (socket says 172.21.15.73:44978) 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a93e00640 1 -- 172.21.15.73:0/3401568613 learned_addr learned my addr 172.21.15.73:0/3401568613 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a93400640 1 --2- 172.21.15.73:0/3401568613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a940b27c0 0x7f4a9415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a98a00640 1 -- 172.21.15.73:0/3401568613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a940b27c0 msgr2=0x7f4a9415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a98a00640 1 --2- 172.21.15.73:0/3401568613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a940b27c0 0x7f4a9415fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a98a00640 1 -- 172.21.15.73:0/3401568613 >> v1:172.21.15.73:6789/0 conn(0x7f4a9415b5d0 legacy=0x7f4a940b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a98a00640 1 -- 172.21.15.73:0/3401568613 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9406fe80 con 0x7f4a940b3e30 2024-04-15T15:33:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a92a00640 1 -- 172.21.15.73:0/3401568613 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2191491687 0 0) 0x7f4a94070160 con 0x7f4a9415b5d0 2024-04-15T15:33:01.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.521+0000 7f4a93400640 1 --2- 172.21.15.73:0/3401568613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a940b27c0 0x7f4a9415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a98a00640 1 --2- 172.21.15.73:0/3401568613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 0x7f4a940b4740 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0097c0 tx=0x7f4a8c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2de575d5afd92ba server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a92a00640 1 -- 172.21.15.73:0/3401568613 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0b0070 con 0x7f4a940b3e30 2024-04-15T15:33:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a92a00640 1 -- 172.21.15.73:0/3401568613 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8c004030 con 0x7f4a940b3e30 2024-04-15T15:33:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a92a00640 1 -- 172.21.15.73:0/3401568613 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c004400 con 0x7f4a940b3e30 2024-04-15T15:33:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a9aa00640 1 -- 172.21.15.73:0/3401568613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 msgr2=0x7f4a940b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a9aa00640 1 --2- 172.21.15.73:0/3401568613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 0x7f4a940b4740 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0097c0 tx=0x7f4a8c01c350 comp rx=0 tx=0).stop 2024-04-15T15:33:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a9aa00640 1 -- 172.21.15.73:0/3401568613 shutdown_connections 2024-04-15T15:33:01.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a9aa00640 1 --2- 172.21.15.73:0/3401568613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a940b27c0 0x7f4a9415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a9aa00640 1 --2- 172.21.15.73:0/3401568613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 0x7f4a940b4740 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a9aa00640 1 -- 172.21.15.73:0/3401568613 >> 172.21.15.73:0/3401568613 conn(0x7f4a94067dd0 msgr2=0x7f4a940d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:01.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a9aa00640 1 -- 172.21.15.73:0/3401568613 shutdown_connections 2024-04-15T15:33:01.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a9aa00640 1 -- 172.21.15.73:0/3401568613 wait complete. 2024-04-15T15:33:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a9aa00640 1 Processor -- start 2024-04-15T15:33:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.525+0000 7f4a9aa00640 1 -- start start 2024-04-15T15:33:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a9aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a940b27c0 0x7f4a9414f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a9aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 0x7f4a941fa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a9aa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a9415b5d0 0x7f4a941522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a9aa00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9406faa0 con 0x7f4a940b3e30 2024-04-15T15:33:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a9aa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4a940cfd00 con 0x7f4a940b27c0 2024-04-15T15:33:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a9aa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9406fc20 con 0x7f4a9415b5d0 2024-04-15T15:33:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a93400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 0x7f4a941fa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a93400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 0x7f4a941fa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59394/0 (socket says 172.21.15.73:59394) 2024-04-15T15:33:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a93400640 1 -- 172.21.15.73:0/467405089 learned_addr learned my addr 172.21.15.73:0/467405089 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a98a00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a9415b5d0 0x7f4a941522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a93e00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a940b27c0 0x7f4a9414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a93400640 1 -- 172.21.15.73:0/467405089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a9415b5d0 msgr2=0x7f4a941522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a93400640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a9415b5d0 0x7f4a941522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a93400640 1 -- 172.21.15.73:0/467405089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a940b27c0 msgr2=0x7f4a9414f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a93400640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a940b27c0 0x7f4a9414f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a93400640 1 -- 172.21.15.73:0/467405089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a94159460 con 0x7f4a940b3e30 2024-04-15T15:33:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a93400640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 0x7f4a941fa7d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000c7f0 tx=0x7f4a8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a8be00640 1 -- 172.21.15.73:0/467405089 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80015070 con 0x7f4a940b3e30 2024-04-15T15:33:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a8be00640 1 -- 172.21.15.73:0/467405089 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a80007820 con 0x7f4a940b3e30 2024-04-15T15:33:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a8be00640 1 -- 172.21.15.73:0/467405089 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80007c10 con 0x7f4a940b3e30 2024-04-15T15:33:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a9aa00640 1 -- 172.21.15.73:0/467405089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a94159740 con 0x7f4a940b3e30 2024-04-15T15:33:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a9aa00640 1 -- 172.21.15.73:0/467405089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a94159d00 con 0x7f4a940b3e30 2024-04-15T15:33:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a9aa00640 1 -- 172.21.15.73:0/467405089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a94068ab0 con 0x7f4a940b3e30 2024-04-15T15:33:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.529+0000 7f4a8be00640 1 -- 172.21.15.73:0/467405089 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f4a80018070 con 0x7f4a940b3e30 2024-04-15T15:33:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.533+0000 7f4a8be00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4a74068410 0x7f4a7406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.533+0000 7f4a8be00640 1 -- 172.21.15.73:0/467405089 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4a80086c30 con 0x7f4a940b3e30 2024-04-15T15:33:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.533+0000 7f4a93e00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4a74068410 0x7f4a7406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.533+0000 7f4a93e00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4a74068410 0x7f4a7406a8d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4a840012f0 tx=0x7f4a84001770 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.537+0000 7f4a8be00640 1 -- 172.21.15.73:0/467405089 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4a800569a0 con 0x7f4a940b3e30 2024-04-15T15:33:01.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.693+0000 7f4a9aa00640 1 -- 172.21.15.73:0/467405089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a9406ec90 con 0x7f4a940b3e30 2024-04-15T15:33:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.693+0000 7f4a8be00640 1 -- 172.21.15.73:0/467405089 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16918 (secure 0 0 0) 0x7f4a8005aca0 con 0x7f4a940b3e30 2024-04-15T15:33:01.696 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:01.696 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":39,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:32:50.731602+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 -- 172.21.15.73:0/467405089 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4a74068410 msgr2=0x7f4a7406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4a74068410 0x7f4a7406a8d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4a840012f0 tx=0x7f4a84001770 comp rx=0 tx=0).stop 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 -- 172.21.15.73:0/467405089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 msgr2=0x7f4a941fa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 0x7f4a941fa7d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000c7f0 tx=0x7f4a8000ccb0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 -- 172.21.15.73:0/467405089 shutdown_connections 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4a74068410 0x7f4a7406a8d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a9415b5d0 0x7f4a941522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a940b3e30 0x7f4a941fa7d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 --2- 172.21.15.73:0/467405089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a940b27c0 0x7f4a9414f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 -- 172.21.15.73:0/467405089 >> 172.21.15.73:0/467405089 conn(0x7f4a94067dd0 msgr2=0x7f4a94164900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 -- 172.21.15.73:0/467405089 shutdown_connections 2024-04-15T15:33:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.697+0000 7f4a9aa00640 1 -- 172.21.15.73:0/467405089 wait complete. 2024-04-15T15:33:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:32:46.793984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:32:48.072270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T15:33:01.717 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:33:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e77e00640 1 Processor -- start 2024-04-15T15:33:01.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e77e00640 1 -- start start 2024-04-15T15:33:01.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e77e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e700b20b0 0x7f8e700b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e77e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7015cbd0 0x7f8e7015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e77e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e700cd3a0 con 0x7f8e70146110 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e77e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8e700b5160 con 0x7f8e700b20b0 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e77e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8e700b40c0 con 0x7f8e7015cbd0 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e74a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e700b20b0 0x7f8e700b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e74a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e700b20b0 0x7f8e700b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59408/0 (socket says 172.21.15.73:59408) 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e74a00640 1 -- 172.21.15.73:0/2623123406 learned_addr learned my addr 172.21.15.73:0/2623123406 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e75e00640 1 --2- 172.21.15.73:0/2623123406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7015cbd0 0x7f8e7015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e74a00640 1 -- 172.21.15.73:0/2623123406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7015cbd0 msgr2=0x7f8e7015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e74a00640 1 --2- 172.21.15.73:0/2623123406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7015cbd0 0x7f8e7015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e74a00640 1 -- 172.21.15.73:0/2623123406 >> v1:172.21.15.118:6789/0 conn(0x7f8e70146110 legacy=0x7f8e700cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:01.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.857+0000 7f8e74a00640 1 -- 172.21.15.73:0/2623123406 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e700b43a0 con 0x7f8e700b20b0 2024-04-15T15:33:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e74a00640 1 --2- 172.21.15.73:0/2623123406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 0x7f8e700b2530 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009870 tx=0x7f8e5c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fa49d32c21a172 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e6fe00640 1 -- 172.21.15.73:0/2623123406 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c0b1070 con 0x7f8e700b20b0 2024-04-15T15:33:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e6fe00640 1 -- 172.21.15.73:0/2623123406 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e5c0ac630 con 0x7f8e700b20b0 2024-04-15T15:33:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e6fe00640 1 -- 172.21.15.73:0/2623123406 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c0a8050 con 0x7f8e700b20b0 2024-04-15T15:33:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e77e00640 1 -- 172.21.15.73:0/2623123406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 msgr2=0x7f8e700b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e77e00640 1 --2- 172.21.15.73:0/2623123406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 0x7f8e700b2530 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009870 tx=0x7f8e5c01c520 comp rx=0 tx=0).stop 2024-04-15T15:33:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e77e00640 1 -- 172.21.15.73:0/2623123406 shutdown_connections 2024-04-15T15:33:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e77e00640 1 --2- 172.21.15.73:0/2623123406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7015cbd0 0x7f8e7015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e77e00640 1 --2- 172.21.15.73:0/2623123406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 0x7f8e700b2530 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e77e00640 1 -- 172.21.15.73:0/2623123406 >> 172.21.15.73:0/2623123406 conn(0x7f8e70067dd0 msgr2=0x7f8e700d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e77e00640 1 -- 172.21.15.73:0/2623123406 shutdown_connections 2024-04-15T15:33:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.861+0000 7f8e77e00640 1 -- 172.21.15.73:0/2623123406 wait complete. 2024-04-15T15:33:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 Processor -- start 2024-04-15T15:33:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 -- start start 2024-04-15T15:33:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 0x7f8e7006f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e70146110 0x7f8e7006ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7015cbd0 0x7f8e70157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e70169210 con 0x7f8e700b20b0 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8e700b3d70 con 0x7f8e70146110 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8e70169390 con 0x7f8e7015cbd0 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e75400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 0x7f8e7006f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e75400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 0x7f8e7006f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59420/0 (socket says 172.21.15.73:59420) 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e75400640 1 -- 172.21.15.73:0/2321745481 learned_addr learned my addr 172.21.15.73:0/2321745481 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e74a00640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e70146110 0x7f8e7006ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e75e00640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7015cbd0 0x7f8e70157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e75400640 1 -- 172.21.15.73:0/2321745481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7015cbd0 msgr2=0x7f8e70157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e75400640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7015cbd0 0x7f8e70157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e75400640 1 -- 172.21.15.73:0/2321745481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e70146110 msgr2=0x7f8e7006ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e75400640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e70146110 0x7f8e7006ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e75400640 1 -- 172.21.15.73:0/2321745481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e700ae2b0 con 0x7f8e700b20b0 2024-04-15T15:33:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e75400640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 0x7f8e7006f620 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400c480 tx=0x7f8e6400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e6d600640 1 -- 172.21.15.73:0/2321745481 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64012830 con 0x7f8e700b20b0 2024-04-15T15:33:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e6d600640 1 -- 172.21.15.73:0/2321745481 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e64017070 con 0x7f8e700b20b0 2024-04-15T15:33:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e6d600640 1 -- 172.21.15.73:0/2321745481 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64012c30 con 0x7f8e700b20b0 2024-04-15T15:33:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 -- 172.21.15.73:0/2321745481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7006ef70 con 0x7f8e700b20b0 2024-04-15T15:33:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 -- 172.21.15.73:0/2321745481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e700ae530 con 0x7f8e700b20b0 2024-04-15T15:33:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.865+0000 7f8e77e00640 1 -- 172.21.15.73:0/2321745481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e70068ab0 con 0x7f8e700b20b0 2024-04-15T15:33:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.869+0000 7f8e6d600640 1 -- 172.21.15.73:0/2321745481 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f8e6401c460 con 0x7f8e700b20b0 2024-04-15T15:33:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.869+0000 7f8e6d600640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e50068410 0x7f8e5006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.869+0000 7f8e6d600640 1 -- 172.21.15.73:0/2321745481 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8e64086a70 con 0x7f8e700b20b0 2024-04-15T15:33:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.869+0000 7f8e74a00640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e50068410 0x7f8e5006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.869+0000 7f8e74a00640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e50068410 0x7f8e5006a8d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0ae000 tx=0x7f8e5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:01.873+0000 7f8e6d600640 1 -- 172.21.15.73:0/2321745481 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8e700ae2b0 con 0x7f8e700b20b0 2024-04-15T15:33:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.029+0000 7f8e77e00640 1 -- 172.21.15.73:0/2321745481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8e700cf470 con 0x7f8e700b20b0 2024-04-15T15:33:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.029+0000 7f8e6d600640 1 -- 172.21.15.73:0/2321745481 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f8e64056dc0 con 0x7f8e700b20b0 2024-04-15T15:33:02.031 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:33:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 -- 172.21.15.73:0/2321745481 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e50068410 msgr2=0x7f8e5006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e50068410 0x7f8e5006a8d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0ae000 tx=0x7f8e5c008040 comp rx=0 tx=0).stop 2024-04-15T15:33:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 -- 172.21.15.73:0/2321745481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 msgr2=0x7f8e7006f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 0x7f8e7006f620 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400c480 tx=0x7f8e6400c940 comp rx=0 tx=0).stop 2024-04-15T15:33:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 -- 172.21.15.73:0/2321745481 shutdown_connections 2024-04-15T15:33:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8e50068410 0x7f8e5006a8d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e7015cbd0 0x7f8e70157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e70146110 0x7f8e7006ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 --2- 172.21.15.73:0/2321745481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e700b20b0 0x7f8e7006f620 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 -- 172.21.15.73:0/2321745481 >> 172.21.15.73:0/2321745481 conn(0x7f8e70067dd0 msgr2=0x7f8e70159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 -- 172.21.15.73:0/2321745481 shutdown_connections 2024-04-15T15:33:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.033+0000 7f8e77e00640 1 -- 172.21.15.73:0/2321745481 wait complete. 2024-04-15T15:33:02.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:33:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.189+0000 7fa592a00640 1 Processor -- start 2024-04-15T15:33:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.189+0000 7fa592a00640 1 -- start start 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.189+0000 7fa592a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c15b5d0 0x7fa58c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.189+0000 7fa592a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa58c0b3e30 0x7fa58c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.189+0000 7fa592a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa58c0b25f0 0x7fa58c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.189+0000 7fa592a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c15b9b0 con 0x7fa58c0b25f0 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.189+0000 7fa592a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c070160 con 0x7fa58c0b3e30 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.189+0000 7fa592a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c15f1f0 con 0x7fa58c15b5d0 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.189+0000 7fa590a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa58c0b25f0 0x7fa58c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa58be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c15b5d0 0x7fa58c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa58b400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa58c0b3e30 0x7fa58c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa590a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa58c0b25f0 0x7fa58c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59432/0 (socket says 172.21.15.73:59432) 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa58be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c15b5d0 0x7fa58c15fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:35694/0 (socket says 172.21.15.73:35694) 2024-04-15T15:33:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa590a00640 1 -- 172.21.15.73:0/3774462925 learned_addr learned my addr 172.21.15.73:0/3774462925 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa590a00640 1 -- 172.21.15.73:0/3774462925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c15b5d0 msgr2=0x7fa58c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa590a00640 1 --2- 172.21.15.73:0/3774462925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c15b5d0 0x7fa58c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa590a00640 1 -- 172.21.15.73:0/3774462925 >> v2:172.21.15.118:3300/0 conn(0x7fa58c0b3e30 msgr2=0x7fa58c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa590a00640 1 --2- 172.21.15.73:0/3774462925 >> v2:172.21.15.118:3300/0 conn(0x7fa58c0b3e30 0x7fa58c0b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa590a00640 1 -- 172.21.15.73:0/3774462925 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c06fe80 con 0x7fa58c0b25f0 2024-04-15T15:33:02.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.193+0000 7fa590a00640 1 --2- 172.21.15.73:0/3774462925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c0b25f0 0x7fa58c0b4740 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0731e0 tx=0x7fa58401ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99dd519cbaf67a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:02.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa58aa00640 1 -- 172.21.15.73:0/3774462925 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58400b0d0 con 0x7fa58c0b25f0 2024-04-15T15:33:02.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa58aa00640 1 -- 172.21.15.73:0/3774462925 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58400b270 con 0x7fa58c0b25f0 2024-04-15T15:33:02.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa58aa00640 1 -- 172.21.15.73:0/3774462925 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5840a7850 con 0x7fa58c0b25f0 2024-04-15T15:33:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 -- 172.21.15.73:0/3774462925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c0b25f0 msgr2=0x7fa58c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 --2- 172.21.15.73:0/3774462925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c0b25f0 0x7fa58c0b4740 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0731e0 tx=0x7fa58401ead0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 -- 172.21.15.73:0/3774462925 shutdown_connections 2024-04-15T15:33:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 --2- 172.21.15.73:0/3774462925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c0b25f0 0x7fa58c0b4740 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 --2- 172.21.15.73:0/3774462925 >> v2:172.21.15.118:3300/0 conn(0x7fa58c0b3e30 0x7fa58c0b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 --2- 172.21.15.73:0/3774462925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c15b5d0 0x7fa58c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 -- 172.21.15.73:0/3774462925 >> 172.21.15.73:0/3774462925 conn(0x7fa58c067dd0 msgr2=0x7fa58c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 -- 172.21.15.73:0/3774462925 shutdown_connections 2024-04-15T15:33:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 -- 172.21.15.73:0/3774462925 wait complete. 2024-04-15T15:33:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 Processor -- start 2024-04-15T15:33:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 -- start start 2024-04-15T15:33:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c0b25f0 0x7fa58c0ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa58c0b3e30 0x7fa58c156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c15b5d0 0x7fa58c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c0b4390 con 0x7fa58c15b5d0 2024-04-15T15:33:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c0b4210 con 0x7fa58c0b3e30 2024-04-15T15:33:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.197+0000 7fa592a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c06faa0 con 0x7fa58c0b25f0 2024-04-15T15:33:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa590a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c15b5d0 0x7fa58c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa58be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c0b25f0 0x7fa58c0ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa58b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa58c0b3e30 0x7fa58c156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa590a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c15b5d0 0x7fa58c15a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59440/0 (socket says 172.21.15.73:59440) 2024-04-15T15:33:02.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa590a00640 1 -- 172.21.15.73:0/3152822493 learned_addr learned my addr 172.21.15.73:0/3152822493 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:02.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa590a00640 1 -- 172.21.15.73:0/3152822493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c0b25f0 msgr2=0x7fa58c0ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa590a00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c0b25f0 0x7fa58c0ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa590a00640 1 -- 172.21.15.73:0/3152822493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa58c0b3e30 msgr2=0x7fa58c156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa590a00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa58c0b3e30 0x7fa58c156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa590a00640 1 -- 172.21.15.73:0/3152822493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c0a9660 con 0x7fa58c15b5d0 2024-04-15T15:33:02.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa590a00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c15b5d0 0x7fa58c15a290 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa5840b1040 tx=0x7fa58401b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:02.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa583e00640 1 -- 172.21.15.73:0/3152822493 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58400b0d0 con 0x7fa58c15b5d0 2024-04-15T15:33:02.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa583e00640 1 -- 172.21.15.73:0/3152822493 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58400b420 con 0x7fa58c15b5d0 2024-04-15T15:33:02.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa583e00640 1 -- 172.21.15.73:0/3152822493 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58400b720 con 0x7fa58c15b5d0 2024-04-15T15:33:02.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa592a00640 1 -- 172.21.15.73:0/3152822493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58c0aa3e0 con 0x7fa58c15b5d0 2024-04-15T15:33:02.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa592a00640 1 -- 172.21.15.73:0/3152822493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58c0a9be0 con 0x7fa58c15b5d0 2024-04-15T15:33:02.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa592a00640 1 -- 172.21.15.73:0/3152822493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58c068ab0 con 0x7fa58c15b5d0 2024-04-15T15:33:02.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa583e00640 1 -- 172.21.15.73:0/3152822493 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fa5840c0030 con 0x7fa58c15b5d0 2024-04-15T15:33:02.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa583e00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa56c068410 0x7fa56c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.201+0000 7fa583e00640 1 -- 172.21.15.73:0/3152822493 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa584121620 con 0x7fa58c15b5d0 2024-04-15T15:33:02.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.205+0000 7fa58be00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa56c068410 0x7fa56c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.205+0000 7fa58be00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa56c068410 0x7fa56c06a8d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009a40 tx=0x7fa57c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:02.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.209+0000 7fa583e00640 1 -- 172.21.15.73:0/3152822493 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa5840c7020 con 0x7fa58c15b5d0 2024-04-15T15:33:02.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.365+0000 7fa592a00640 1 -- 172.21.15.73:0/3152822493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa58c15a070 con 0x7fa58c15b5d0 2024-04-15T15:33:02.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.365+0000 7fa583e00640 1 -- 172.21.15.73:0/3152822493 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) ==== 104+0+11 (secure 0 0 0) 0x7fa5840187e0 con 0x7fa58c15b5d0 2024-04-15T15:33:02.366 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:33:02.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.365+0000 7fa592a00640 1 -- 172.21.15.73:0/3152822493 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa56c068410 msgr2=0x7fa56c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.365+0000 7fa592a00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa56c068410 0x7fa56c06a8d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009a40 tx=0x7fa57c009190 comp rx=0 tx=0).stop 2024-04-15T15:33:02.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.365+0000 7fa592a00640 1 -- 172.21.15.73:0/3152822493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c15b5d0 msgr2=0x7fa58c15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.365+0000 7fa592a00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c15b5d0 0x7fa58c15a290 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa5840b1040 tx=0x7fa58401b870 comp rx=0 tx=0).stop 2024-04-15T15:33:02.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.365+0000 7fa592a00640 1 -- 172.21.15.73:0/3152822493 shutdown_connections 2024-04-15T15:33:02.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.365+0000 7fa592a00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58c15b5d0 0x7fa58c15a290 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.365+0000 7fa592a00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa58c0b3e30 0x7fa58c156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.369+0000 7fa592a00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa56c068410 0x7fa56c06a8d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.369+0000 7fa592a00640 1 --2- 172.21.15.73:0/3152822493 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa58c0b25f0 0x7fa58c0ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.369+0000 7fa592a00640 1 -- 172.21.15.73:0/3152822493 >> 172.21.15.73:0/3152822493 conn(0x7fa58c067dd0 msgr2=0x7fa58c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:02.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.369+0000 7fa592a00640 1 -- 172.21.15.73:0/3152822493 shutdown_connections 2024-04-15T15:33:02.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.369+0000 7fa592a00640 1 -- 172.21.15.73:0/3152822493 wait complete. 2024-04-15T15:33:02.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:33:02.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f2099800640 1 Processor -- start 2024-04-15T15:33:02.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f2099800640 1 -- start start 2024-04-15T15:33:02.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f2099800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20940b20b0 0x7f20940b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f2099800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f209415cbd0 0x7f209415d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f2099800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20940cd3a0 con 0x7f2094146110 2024-04-15T15:33:02.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f2099800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f20940b5160 con 0x7f209415cbd0 2024-04-15T15:33:02.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f2099800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f20940b40c0 con 0x7f20940b20b0 2024-04-15T15:33:02.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f2092a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2094146110 0x7f20940cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44992/0 (socket says 172.21.15.73:44992) 2024-04-15T15:33:02.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f2092a00640 1 -- 172.21.15.73:0/3007059182 learned_addr learned my addr 172.21.15.73:0/3007059182 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:02.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f2093400640 1 --2- 172.21.15.73:0/3007059182 >> v2:172.21.15.118:3300/0 conn(0x7f209415cbd0 0x7f209415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.525+0000 7f208a000640 1 --2- 172.21.15.73:0/3007059182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20940b20b0 0x7f20940b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f2092000640 1 -- 172.21.15.73:0/3007059182 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595945161 0 0) 0x7f20940cd3a0 con 0x7f2094146110 2024-04-15T15:33:02.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f2092000640 1 -- 172.21.15.73:0/3007059182 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2078003530 con 0x7f2094146110 2024-04-15T15:33:02.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f208a000640 1 -- 172.21.15.73:0/3007059182 >> v2:172.21.15.118:3300/0 conn(0x7f209415cbd0 msgr2=0x7f209415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:02.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f208a000640 1 --2- 172.21.15.73:0/3007059182 >> v2:172.21.15.118:3300/0 conn(0x7f209415cbd0 0x7f209415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f208a000640 1 -- 172.21.15.73:0/3007059182 >> v1:172.21.15.73:6789/0 conn(0x7f2094146110 legacy=0x7f20940cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f208a000640 1 -- 172.21.15.73:0/3007059182 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20940b43a0 con 0x7f20940b20b0 2024-04-15T15:33:02.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f2093400640 1 --2- 172.21.15.73:0/3007059182 >> v2:172.21.15.118:3300/0 conn(0x7f209415cbd0 0x7f209415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:02.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f208a000640 1 --2- 172.21.15.73:0/3007059182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20940b20b0 0x7f20940b2530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f207c0097c0 tx=0x7f207c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682dd322104b20ef server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:02.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f2092000640 1 -- 172.21.15.73:0/3007059182 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0b2070 con 0x7f20940b20b0 2024-04-15T15:33:02.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f2092000640 1 -- 172.21.15.73:0/3007059182 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207c0ad640 con 0x7f20940b20b0 2024-04-15T15:33:02.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f2092000640 1 -- 172.21.15.73:0/3007059182 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0ada10 con 0x7f20940b20b0 2024-04-15T15:33:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f2099800640 1 -- 172.21.15.73:0/3007059182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20940b20b0 msgr2=0x7f20940b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.529+0000 7f2099800640 1 --2- 172.21.15.73:0/3007059182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20940b20b0 0x7f20940b2530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f207c0097c0 tx=0x7f207c01c4a0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 -- 172.21.15.73:0/3007059182 shutdown_connections 2024-04-15T15:33:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 --2- 172.21.15.73:0/3007059182 >> v2:172.21.15.118:3300/0 conn(0x7f209415cbd0 0x7f209415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 --2- 172.21.15.73:0/3007059182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20940b20b0 0x7f20940b2530 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 -- 172.21.15.73:0/3007059182 >> 172.21.15.73:0/3007059182 conn(0x7f2094067dd0 msgr2=0x7f20940d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 -- 172.21.15.73:0/3007059182 shutdown_connections 2024-04-15T15:33:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 -- 172.21.15.73:0/3007059182 wait complete. 2024-04-15T15:33:02.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 Processor -- start 2024-04-15T15:33:02.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 -- start start 2024-04-15T15:33:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20940b20b0 0x7f209412fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2094146110 0x7f2094143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f209415cbd0 0x7f20941577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2094169210 con 0x7f20940b20b0 2024-04-15T15:33:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f20940b3d70 con 0x7f2094146110 2024-04-15T15:33:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2099800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2094169390 con 0x7f209415cbd0 2024-04-15T15:33:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2092a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20940b20b0 0x7f209412fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2092a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20940b20b0 0x7f209412fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59442/0 (socket says 172.21.15.73:59442) 2024-04-15T15:33:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2092a00640 1 -- 172.21.15.73:0/1209961907 learned_addr learned my addr 172.21.15.73:0/1209961907 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2092a00640 1 -- 172.21.15.73:0/1209961907 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f209415cbd0 msgr2=0x7f20941577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f208a000640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2094146110 0x7f2094143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2092a00640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f209415cbd0 0x7f20941577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2092a00640 1 -- 172.21.15.73:0/1209961907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2094146110 msgr2=0x7f2094143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2092a00640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2094146110 0x7f2094143bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2092a00640 1 -- 172.21.15.73:0/1209961907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2094144360 con 0x7f20940b20b0 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f208a000640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2094146110 0x7f2094143bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f2092a00640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20940b20b0 0x7f209412fbd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f208400cb40 tx=0x7f208400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f208b400640 1 -- 172.21.15.73:0/1209961907 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084017070 con 0x7f20940b20b0 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f208b400640 1 -- 172.21.15.73:0/1209961907 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208400aca0 con 0x7f20940b20b0 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.533+0000 7f208b400640 1 -- 172.21.15.73:0/1209961907 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084012620 con 0x7f20940b20b0 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.537+0000 7f2099800640 1 -- 172.21.15.73:0/1209961907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2094144640 con 0x7f20940b20b0 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.537+0000 7f2099800640 1 -- 172.21.15.73:0/1209961907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2094144c00 con 0x7f20940b20b0 2024-04-15T15:33:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.537+0000 7f2099800640 1 -- 172.21.15.73:0/1209961907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2094068ab0 con 0x7f20940b20b0 2024-04-15T15:33:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.537+0000 7f208b400640 1 -- 172.21.15.73:0/1209961907 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f208401a070 con 0x7f20940b20b0 2024-04-15T15:33:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.537+0000 7f208b400640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2070068410 0x7f207006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.537+0000 7f208b400640 1 -- 172.21.15.73:0/1209961907 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f2084086910 con 0x7f20940b20b0 2024-04-15T15:33:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.537+0000 7f208a000640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2070068410 0x7f207006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.537+0000 7f208a000640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2070068410 0x7f207006a8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f207c0af000 tx=0x7f207c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:02.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.541+0000 7f208b400640 1 -- 172.21.15.73:0/1209961907 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2084056de0 con 0x7f20940b20b0 2024-04-15T15:33:02.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.697+0000 7f2099800640 1 -- 172.21.15.73:0/1209961907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2094145480 con 0x7f20940b20b0 2024-04-15T15:33:02.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.697+0000 7f208b400640 1 -- 172.21.15.73:0/1209961907 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) ==== 100+0+11 (secure 0 0 0) 0x7f20840566e0 con 0x7f20940b20b0 2024-04-15T15:33:02.699 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:33:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 -- 172.21.15.73:0/1209961907 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2070068410 msgr2=0x7f207006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2070068410 0x7f207006a8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f207c0af000 tx=0x7f207c008040 comp rx=0 tx=0).stop 2024-04-15T15:33:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 -- 172.21.15.73:0/1209961907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20940b20b0 msgr2=0x7f209412fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20940b20b0 0x7f209412fbd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f208400cb40 tx=0x7f208400a060 comp rx=0 tx=0).stop 2024-04-15T15:33:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 -- 172.21.15.73:0/1209961907 shutdown_connections 2024-04-15T15:33:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2070068410 0x7f207006a8d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f209415cbd0 0x7f20941577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2094146110 0x7f2094143bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 --2- 172.21.15.73:0/1209961907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20940b20b0 0x7f209412fbd0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 -- 172.21.15.73:0/1209961907 >> 172.21.15.73:0/1209961907 conn(0x7f2094067dd0 msgr2=0x7f209415b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 -- 172.21.15.73:0/1209961907 shutdown_connections 2024-04-15T15:33:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.701+0000 7f2099800640 1 -- 172.21.15.73:0/1209961907 wait complete. 2024-04-15T15:33:02.720 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:33:02.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3e00640 1 Processor -- start 2024-04-15T15:33:02.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3e00640 1 -- start start 2024-04-15T15:33:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcdd415c640 0x7fcdd40b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcdd40cf270 0x7fcdd40704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd415ca20 con 0x7fcdd40cede0 2024-04-15T15:33:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd40d1310 con 0x7fcdd40cf270 2024-04-15T15:33:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd40d0e80 con 0x7fcdd415c640 2024-04-15T15:33:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcdd40cf270 0x7fcdd40704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdca000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcdd40cede0 0x7fcdd406fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45004/0 (socket says 172.21.15.73:45004) 2024-04-15T15:33:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdca000640 1 -- 172.21.15.73:0/2033019489 learned_addr learned my addr 172.21.15.73:0/2033019489 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcdd40cf270 0x7fcdd40704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59448/0 (socket says 172.21.15.73:59448) 2024-04-15T15:33:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd2a00640 1 --2- 172.21.15.73:0/2033019489 >> v2:172.21.15.118:3300/0 conn(0x7fcdd415c640 0x7fcdd40b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3400640 1 -- 172.21.15.73:0/2033019489 >> v2:172.21.15.118:3300/0 conn(0x7fcdd415c640 msgr2=0x7fcdd40b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3400640 1 --2- 172.21.15.73:0/2033019489 >> v2:172.21.15.118:3300/0 conn(0x7fcdd415c640 0x7fcdd40b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3400640 1 -- 172.21.15.73:0/2033019489 >> v1:172.21.15.73:6789/0 conn(0x7fcdd40cede0 legacy=0x7fcdd406fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd3400640 1 -- 172.21.15.73:0/2033019489 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd40d0270 con 0x7fcdd40cf270 2024-04-15T15:33:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.857+0000 7fcdd2000640 1 -- 172.21.15.73:0/2033019489 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609753257 0 0) 0x7fcdd415ca20 con 0x7fcdd40cede0 2024-04-15T15:33:02.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd3400640 1 --2- 172.21.15.73:0/2033019489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 0x7fcdd40704e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40cedb0 tx=0x7fcdcc01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc86801ff27c7d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:02.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd2000640 1 -- 172.21.15.73:0/2033019489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0b2070 con 0x7fcdd40cf270 2024-04-15T15:33:02.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd2000640 1 -- 172.21.15.73:0/2033019489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdcc0a59c0 con 0x7fcdd40cf270 2024-04-15T15:33:02.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd2000640 1 -- 172.21.15.73:0/2033019489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0a5d90 con 0x7fcdd40cf270 2024-04-15T15:33:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd3e00640 1 -- 172.21.15.73:0/2033019489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 msgr2=0x7fcdd40704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd3e00640 1 --2- 172.21.15.73:0/2033019489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 0x7fcdd40704e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40cedb0 tx=0x7fcdcc01c900 comp rx=0 tx=0).stop 2024-04-15T15:33:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd3e00640 1 -- 172.21.15.73:0/2033019489 shutdown_connections 2024-04-15T15:33:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd3e00640 1 --2- 172.21.15.73:0/2033019489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 0x7fcdd40704e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd3e00640 1 --2- 172.21.15.73:0/2033019489 >> v2:172.21.15.118:3300/0 conn(0x7fcdd415c640 0x7fcdd40b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd3e00640 1 -- 172.21.15.73:0/2033019489 >> 172.21.15.73:0/2033019489 conn(0x7fcdd406ba50 msgr2=0x7fcdd406be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd3e00640 1 -- 172.21.15.73:0/2033019489 shutdown_connections 2024-04-15T15:33:02.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.861+0000 7fcdd3e00640 1 -- 172.21.15.73:0/2033019489 wait complete. 2024-04-15T15:33:02.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3e00640 1 Processor -- start 2024-04-15T15:33:02.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3e00640 1 -- start start 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdd40cede0 0x7fcdd4151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 0x7fcdd4158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd415c640 0x7fcdd4156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd40ceaa0 con 0x7fcdd40cf270 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd40cf680 con 0x7fcdd415c640 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd4159330 con 0x7fcdd40cede0 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdca000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 0x7fcdd4158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdca000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 0x7fcdd4158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59460/0 (socket says 172.21.15.73:59460) 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdca000640 1 -- 172.21.15.73:0/3608947158 learned_addr learned my addr 172.21.15.73:0/3608947158 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3400640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd415c640 0x7fcdd4156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd2a00640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdd40cede0 0x7fcdd4151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdca000640 1 -- 172.21.15.73:0/3608947158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdd40cede0 msgr2=0x7fcdd4151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdca000640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdd40cede0 0x7fcdd4151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdca000640 1 -- 172.21.15.73:0/3608947158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd415c640 msgr2=0x7fcdd4156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdca000640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd415c640 0x7fcdd4156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdca000640 1 -- 172.21.15.73:0/3608947158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd4159600 con 0x7fcdd40cf270 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd2a00640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdd40cede0 0x7fcdd4151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdca000640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 0x7fcdd4158df0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0011f0 tx=0x7fcdbc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdcb400640 1 -- 172.21.15.73:0/3608947158 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc018070 con 0x7fcdd40cf270 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdcb400640 1 -- 172.21.15.73:0/3608947158 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc0074e0 con 0x7fcdd40cf270 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdcb400640 1 -- 172.21.15.73:0/3608947158 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc004a10 con 0x7fcdd40cf270 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3e00640 1 -- 172.21.15.73:0/3608947158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd41598e0 con 0x7fcdd40cf270 2024-04-15T15:33:02.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.865+0000 7fcdd3e00640 1 -- 172.21.15.73:0/3608947158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd40ca510 con 0x7fcdd40cf270 2024-04-15T15:33:02.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.869+0000 7fcdd3e00640 1 -- 172.21.15.73:0/3608947158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd4159ab0 con 0x7fcdd40cf270 2024-04-15T15:33:02.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.869+0000 7fcdcb400640 1 -- 172.21.15.73:0/3608947158 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fcdbc004bb0 con 0x7fcdd40cf270 2024-04-15T15:33:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.869+0000 7fcdcb400640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcdb0068410 0x7fcdb006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.869+0000 7fcdcb400640 1 -- 172.21.15.73:0/3608947158 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fcdbc085f60 con 0x7fcdd40cf270 2024-04-15T15:33:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.869+0000 7fcdd2a00640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcdb0068410 0x7fcdb006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.869+0000 7fcdd2a00640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcdb0068410 0x7fcdb006a8d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009b10 tx=0x7fcdc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:02.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:02.873+0000 7fcdcb400640 1 -- 172.21.15.73:0/3608947158 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcdbc055ce0 con 0x7fcdd40cf270 2024-04-15T15:33:03.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 -- 172.21.15.73:0/3608947158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcdd404fd60 con 0x7fcdd40cf270 2024-04-15T15:33:03.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdcb400640 1 -- 172.21.15.73:0/3608947158 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7fcdbc059fe0 con 0x7fcdd40cf270 2024-04-15T15:33:03.041 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-15T15:33:03.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 -- 172.21.15.73:0/3608947158 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcdb0068410 msgr2=0x7fcdb006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:03.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcdb0068410 0x7fcdb006a8d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009b10 tx=0x7fcdc4008040 comp rx=0 tx=0).stop 2024-04-15T15:33:03.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 -- 172.21.15.73:0/3608947158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 msgr2=0x7fcdd4158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:03.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 0x7fcdd4158df0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0011f0 tx=0x7fcdbc00c9b0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 -- 172.21.15.73:0/3608947158 shutdown_connections 2024-04-15T15:33:03.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd415c640 0x7fcdd4156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd40cf270 0x7fcdd4158df0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fcdb0068410 0x7fcdb006a8d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 --2- 172.21.15.73:0/3608947158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdd40cede0 0x7fcdd4151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 -- 172.21.15.73:0/3608947158 >> 172.21.15.73:0/3608947158 conn(0x7fcdd406ba50 msgr2=0x7fcdd406be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:03.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 -- 172.21.15.73:0/3608947158 shutdown_connections 2024-04-15T15:33:03.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.041+0000 7fcdd3e00640 1 -- 172.21.15.73:0/3608947158 wait complete. 2024-04-15T15:33:03.062 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-15T15:33:03.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:03.063 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-15T15:33:03.092 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:33:03.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:03.092 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-15T15:33:03.145 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:33:03.145 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:03.154 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2940 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-15T15:33:03.154 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:33:03.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:03.154 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-15T15:33:03.207 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-15T15:33:03.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:33:03.208 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:33:03.208 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:03.218 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=447 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-15T15:33:03.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:33:03.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:03.219 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-15T15:33:03.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:33:03.259 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:33:03.272 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-15T15:33:03.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:33:03.273 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:33:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.437+0000 7fd476a00640 1 Processor -- start 2024-04-15T15:33:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.437+0000 7fd476a00640 1 -- start start 2024-04-15T15:33:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.437+0000 7fd476a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4700b27c0 0x7fd47015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.437+0000 7fd476a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd4700b3e30 0x7fd4700b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.437+0000 7fd476a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd470070160 con 0x7fd47015b5d0 2024-04-15T15:33:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.437+0000 7fd476a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd47015b9b0 con 0x7fd4700b27c0 2024-04-15T15:33:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.437+0000 7fd476a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd47015f1f0 con 0x7fd4700b3e30 2024-04-15T15:33:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4700b27c0 0x7fd47015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:03.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4700b27c0 0x7fd47015fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59474/0 (socket says 172.21.15.73:59474) 2024-04-15T15:33:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46f400640 1 -- 172.21.15.73:0/3295085634 learned_addr learned my addr 172.21.15.73:0/3295085634 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd474a00640 1 --2- 172.21.15.73:0/3295085634 >> v2:172.21.15.118:3300/0 conn(0x7fd4700b3e30 0x7fd4700b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46f400640 1 -- 172.21.15.73:0/3295085634 >> v2:172.21.15.118:3300/0 conn(0x7fd4700b3e30 msgr2=0x7fd4700b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46f400640 1 --2- 172.21.15.73:0/3295085634 >> v2:172.21.15.118:3300/0 conn(0x7fd4700b3e30 0x7fd4700b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46f400640 1 -- 172.21.15.73:0/3295085634 >> v1:172.21.15.118:6789/0 conn(0x7fd47015b5d0 legacy=0x7fd4700b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46f400640 1 -- 172.21.15.73:0/3295085634 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47006fe80 con 0x7fd4700b27c0 2024-04-15T15:33:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46f400640 1 --2- 172.21.15.73:0/3295085634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4700b27c0 0x7fd47015fc90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd4700b2fe0 tx=0x7fd45c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273cfb1a8c1fd0b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46ea00640 1 -- 172.21.15.73:0/3295085634 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0b2070 con 0x7fd4700b27c0 2024-04-15T15:33:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46ea00640 1 -- 172.21.15.73:0/3295085634 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45c0ad440 con 0x7fd4700b27c0 2024-04-15T15:33:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.441+0000 7fd46ea00640 1 -- 172.21.15.73:0/3295085634 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0ad810 con 0x7fd4700b27c0 2024-04-15T15:33:03.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 -- 172.21.15.73:0/3295085634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4700b27c0 msgr2=0x7fd47015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:03.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 --2- 172.21.15.73:0/3295085634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4700b27c0 0x7fd47015fc90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd4700b2fe0 tx=0x7fd45c01c390 comp rx=0 tx=0).stop 2024-04-15T15:33:03.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 -- 172.21.15.73:0/3295085634 shutdown_connections 2024-04-15T15:33:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 --2- 172.21.15.73:0/3295085634 >> v2:172.21.15.118:3300/0 conn(0x7fd4700b3e30 0x7fd4700b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 --2- 172.21.15.73:0/3295085634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4700b27c0 0x7fd47015fc90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 -- 172.21.15.73:0/3295085634 >> 172.21.15.73:0/3295085634 conn(0x7fd470067dd0 msgr2=0x7fd4700d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 -- 172.21.15.73:0/3295085634 shutdown_connections 2024-04-15T15:33:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 -- 172.21.15.73:0/3295085634 wait complete. 2024-04-15T15:33:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 Processor -- start 2024-04-15T15:33:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 -- start start 2024-04-15T15:33:03.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4700b27c0 0x7fd47015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:03.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4700b3e30 0x7fd47014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:03.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47015b5d0 0x7fd470167460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:03.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd47006faa0 con 0x7fd47015b5d0 2024-04-15T15:33:03.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd4700b4240 con 0x7fd4700b27c0 2024-04-15T15:33:03.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd476a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd47006fc20 con 0x7fd4700b3e30 2024-04-15T15:33:03.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd474a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47015b5d0 0x7fd470167460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:03.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd474a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47015b5d0 0x7fd470167460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59488/0 (socket says 172.21.15.73:59488) 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd474a00640 1 -- 172.21.15.73:0/153612660 learned_addr learned my addr 172.21.15.73:0/153612660 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd46fe00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4700b27c0 0x7fd47015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd46f400640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4700b3e30 0x7fd47014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd474a00640 1 -- 172.21.15.73:0/153612660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4700b3e30 msgr2=0x7fd47014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd474a00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4700b3e30 0x7fd47014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd474a00640 1 -- 172.21.15.73:0/153612660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4700b27c0 msgr2=0x7fd47015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd474a00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4700b27c0 0x7fd47015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd474a00640 1 -- 172.21.15.73:0/153612660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47015ae30 con 0x7fd47015b5d0 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.445+0000 7fd46f400640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4700b3e30 0x7fd47014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd474a00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47015b5d0 0x7fd470167460 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd46800d830 tx=0x7fd46800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd467e00640 1 -- 172.21.15.73:0/153612660 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46800b6c0 con 0x7fd47015b5d0 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd467e00640 1 -- 172.21.15.73:0/153612660 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd468019070 con 0x7fd47015b5d0 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd467e00640 1 -- 172.21.15.73:0/153612660 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46800baa0 con 0x7fd47015b5d0 2024-04-15T15:33:03.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd476a00640 1 -- 172.21.15.73:0/153612660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd47015c990 con 0x7fd47015b5d0 2024-04-15T15:33:03.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd476a00640 1 -- 172.21.15.73:0/153612660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd470155ad0 con 0x7fd47015b5d0 2024-04-15T15:33:03.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd476a00640 1 -- 172.21.15.73:0/153612660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd470068ab0 con 0x7fd47015b5d0 2024-04-15T15:33:03.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd467e00640 1 -- 172.21.15.73:0/153612660 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fd46801e460 con 0x7fd47015b5d0 2024-04-15T15:33:03.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd467e00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd450068410 0x7fd45006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:03.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd467e00640 1 -- 172.21.15.73:0/153612660 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd4680872c0 con 0x7fd47015b5d0 2024-04-15T15:33:03.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd46fe00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd450068410 0x7fd45006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:03.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.449+0000 7fd46fe00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd450068410 0x7fd45006a8d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd460005680 tx=0x7fd460003dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:03.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.453+0000 7fd467e00640 1 -- 172.21.15.73:0/153612660 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd468057600 con 0x7fd47015b5d0 2024-04-15T15:33:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.645+0000 7fd476a00640 1 -- 172.21.15.73:0/153612660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd470167240 con 0x7fd47015b5d0 2024-04-15T15:33:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.645+0000 7fd467e00640 1 -- 172.21.15.73:0/153612660 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7fd468056f00 con 0x7fd47015b5d0 2024-04-15T15:33:03.647 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-15T15:33:03.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 -- 172.21.15.73:0/153612660 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd450068410 msgr2=0x7fd45006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:03.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd450068410 0x7fd45006a8d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd460005680 tx=0x7fd460003dd0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 -- 172.21.15.73:0/153612660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47015b5d0 msgr2=0x7fd470167460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:03.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47015b5d0 0x7fd470167460 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd46800d830 tx=0x7fd46800dcf0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 -- 172.21.15.73:0/153612660 shutdown_connections 2024-04-15T15:33:03.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47015b5d0 0x7fd470167460 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd450068410 0x7fd45006a8d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4700b3e30 0x7fd47014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 --2- 172.21.15.73:0/153612660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4700b27c0 0x7fd47015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 -- 172.21.15.73:0/153612660 >> 172.21.15.73:0/153612660 conn(0x7fd470067dd0 msgr2=0x7fd470072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 -- 172.21.15.73:0/153612660 shutdown_connections 2024-04-15T15:33:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03.649+0000 7fd476a00640 1 -- 172.21.15.73:0/153612660 wait complete. 2024-04-15T15:33:03.668 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-15T15:33:03.668 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:33:03.668 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-04-15T15:33:03.669 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-15T15:33:03.669 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T15:33:03.669 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-15T15:33:03.669 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:03.669 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:33:03.669 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-15T15:33:03.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:03.669 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-04-15T15:33:03.678 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:33:03.678 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:33:03.678 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:33:03.678 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:03.678 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-04-15T15:33:03.678 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42373sec preferred_lft 42373sec 2024-04-15T15:33:03.679 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:61:e3:76:67 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-15T15:33:03.680 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:03.681 INFO:teuthology.orchestra.run.smithi073.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:33:03.681 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-15T15:33:03.681 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-15T15:33:03.681 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:03.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:03.682 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:33:03.740 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-04-15T15:33:03.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:03.743 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-04-15T15:33:03.795 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-04-15T15:33:03.795 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:33:03.795 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:33:03.795 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:33:03.795 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:33:03.795 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:33:03.795 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:33:03.795 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:03.795 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:03.796 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:03.796 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:33:03.796 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:33:03.796 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:33:03.796 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:33:03.796 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:33:03.796 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:33:03.796 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:33:03.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:33:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:33:03.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:03.929 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-15T15:33:03.939 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-15T15:33:03.939 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-15T15:33:03.939 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-15T15:33:03.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:03.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-04-15T15:33:04.003 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:33:04.003 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-15T15:33:04.051 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-15T15:33:04.051 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:33:04.052 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-15T15:33:04.107 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:04.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:04.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:33:04.199 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:33:04.199 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-15T15:33:04.199 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:33:04.215 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:33:04.215 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-15T15:33:04.215 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:33:04.215 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:33:04.215 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:33:04.224 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-15T15:33:04.224 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-15T15:33:04.224 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:33:04.225 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:33:04.225 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:33:04.225 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790" 2024-04-15T15:33:04.225 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790:/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:04.225 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a72de584-7db8-4f62-b310-5ee655143eeb" will pass to kernel 2024-04-15T15:33:04.228 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-15T15:33:04.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:04.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-15T15:33:04.251 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:33:04.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:33:04.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:33:04.359 INFO:teuthology.orchestra.run.smithi073.stdout:client5631 2024-04-15T15:33:04.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:33:04.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.493+0000 7fa072400640 1 Processor -- start 2024-04-15T15:33:04.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.493+0000 7fa072400640 1 -- start start 2024-04-15T15:33:04.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa072400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c0b27c0 0x7fa06c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:04.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa072400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa06c0b3e30 0x7fa06c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:04.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa072400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa06c070160 con 0x7fa06c15b5d0 2024-04-15T15:33:04.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa072400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa06c15b9b0 con 0x7fa06c0b3e30 2024-04-15T15:33:04.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa072400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa06c15f1f0 con 0x7fa06c0b27c0 2024-04-15T15:33:04.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa06aa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c0b27c0 0x7fa06c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:04.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa06be00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa06c0b3e30 0x7fa06c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:04.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa06b400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa06c15b5d0 0x7fa06c0b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:34534/0 (socket says 172.21.15.73:34534) 2024-04-15T15:33:04.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa06b400640 1 -- 172.21.15.73:0/3707468340 learned_addr learned my addr 172.21.15.73:0/3707468340 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:04.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa06be00640 1 -- 172.21.15.73:0/3707468340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c0b27c0 msgr2=0x7fa06c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:04.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa06be00640 1 --2- 172.21.15.73:0/3707468340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c0b27c0 0x7fa06c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:04.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa06be00640 1 -- 172.21.15.73:0/3707468340 >> v1:172.21.15.118:6789/0 conn(0x7fa06c15b5d0 legacy=0x7fa06c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:04.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa06be00640 1 -- 172.21.15.73:0/3707468340 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c06fe80 con 0x7fa06c0b3e30 2024-04-15T15:33:04.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.497+0000 7fa06aa00640 1 --2- 172.21.15.73:0/3707468340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c0b27c0 0x7fa06c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:04.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa06be00640 1 --2- 172.21.15.73:0/3707468340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa06c0b3e30 0x7fa06c0b4740 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa0640097c0 tx=0x7fa06401c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12743e9451a06902 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa06a000640 1 -- 172.21.15.73:0/3707468340 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640b0070 con 0x7fa06c0b3e30 2024-04-15T15:33:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa06a000640 1 -- 172.21.15.73:0/3707468340 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa064004030 con 0x7fa06c0b3e30 2024-04-15T15:33:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa06a000640 1 -- 172.21.15.73:0/3707468340 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064004440 con 0x7fa06c0b3e30 2024-04-15T15:33:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa072400640 1 -- 172.21.15.73:0/3707468340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa06c0b3e30 msgr2=0x7fa06c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:04.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa072400640 1 --2- 172.21.15.73:0/3707468340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa06c0b3e30 0x7fa06c0b4740 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa0640097c0 tx=0x7fa06401c350 comp rx=0 tx=0).stop 2024-04-15T15:33:04.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa072400640 1 -- 172.21.15.73:0/3707468340 shutdown_connections 2024-04-15T15:33:04.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa072400640 1 --2- 172.21.15.73:0/3707468340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa06c0b3e30 0x7fa06c0b4740 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:04.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa072400640 1 --2- 172.21.15.73:0/3707468340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c0b27c0 0x7fa06c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:04.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa072400640 1 -- 172.21.15.73:0/3707468340 >> 172.21.15.73:0/3707468340 conn(0x7fa06c067dd0 msgr2=0x7fa06c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:04.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa072400640 1 -- 172.21.15.73:0/3707468340 shutdown_connections 2024-04-15T15:33:04.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa072400640 1 -- 172.21.15.73:0/3707468340 wait complete. 2024-04-15T15:33:04.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa072400640 1 Processor -- start 2024-04-15T15:33:04.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.501+0000 7fa072400640 1 -- start start 2024-04-15T15:33:04.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa072400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa06c0b27c0 0x7fa06c156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:04.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa072400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa06c0b3e30 0x7fa06c159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:04.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa072400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c15b5d0 0x7fa06c071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:04.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa072400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c06faa0 con 0x7fa06c0b3e30 2024-04-15T15:33:04.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa072400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c0cfd00 con 0x7fa06c0b27c0 2024-04-15T15:33:04.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa072400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa06c06fc20 con 0x7fa06c15b5d0 2024-04-15T15:33:04.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa06c0b3e30 0x7fa06c159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:04.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa06c0b3e30 0x7fa06c159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59492/0 (socket says 172.21.15.73:59492) 2024-04-15T15:33:04.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06aa00640 1 -- 172.21.15.73:0/610632135 learned_addr learned my addr 172.21.15.73:0/610632135 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:04.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06b400640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa06c0b27c0 0x7fa06c156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06be00640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c15b5d0 0x7fa06c071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06aa00640 1 -- 172.21.15.73:0/610632135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c15b5d0 msgr2=0x7fa06c071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06aa00640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c15b5d0 0x7fa06c071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06aa00640 1 -- 172.21.15.73:0/610632135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa06c0b27c0 msgr2=0x7fa06c156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06aa00640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa06c0b27c0 0x7fa06c156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06aa00640 1 -- 172.21.15.73:0/610632135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c15dea0 con 0x7fa06c0b3e30 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa06aa00640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa06c0b3e30 0x7fa06c159d70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa05800e980 tx=0x7fa05800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa063400640 1 -- 172.21.15.73:0/610632135 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058017070 con 0x7fa06c0b3e30 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa063400640 1 -- 172.21.15.73:0/610632135 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05800ca00 con 0x7fa06c0b3e30 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa063400640 1 -- 172.21.15.73:0/610632135 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05800cdd0 con 0x7fa06c0b3e30 2024-04-15T15:33:04.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa072400640 1 -- 172.21.15.73:0/610632135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06c15e180 con 0x7fa06c0b3e30 2024-04-15T15:33:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa072400640 1 -- 172.21.15.73:0/610632135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06c15e740 con 0x7fa06c0b3e30 2024-04-15T15:33:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa072400640 1 -- 172.21.15.73:0/610632135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa06c068ab0 con 0x7fa06c0b3e30 2024-04-15T15:33:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.505+0000 7fa063400640 1 -- 172.21.15.73:0/610632135 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fa05801a070 con 0x7fa06c0b3e30 2024-04-15T15:33:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.509+0000 7fa063400640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa04c068410 0x7fa04c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.509+0000 7fa063400640 1 -- 172.21.15.73:0/610632135 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa058086e80 con 0x7fa06c0b3e30 2024-04-15T15:33:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.509+0000 7fa06b400640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa04c068410 0x7fa04c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.509+0000 7fa06b400640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa04c068410 0x7fa04c06a8d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0729d0 tx=0x7fa05c001a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.513+0000 7fa063400640 1 -- 172.21.15.73:0/610632135 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa058056b70 con 0x7fa06c0b3e30 2024-04-15T15:33:04.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.701+0000 7fa072400640 1 -- 172.21.15.73:0/610632135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa06c072d00 con 0x7fa06c0b3e30 2024-04-15T15:33:04.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa063400640 1 -- 172.21.15.73:0/610632135 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7fa05805ae70 con 0x7fa06c0b3e30 2024-04-15T15:33:04.704 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-15T15:33:04.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 -- 172.21.15.73:0/610632135 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa04c068410 msgr2=0x7fa04c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:04.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa04c068410 0x7fa04c06a8d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0729d0 tx=0x7fa05c001a40 comp rx=0 tx=0).stop 2024-04-15T15:33:04.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 -- 172.21.15.73:0/610632135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa06c0b3e30 msgr2=0x7fa06c159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:04.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa06c0b3e30 0x7fa06c159d70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa05800e980 tx=0x7fa05800ee40 comp rx=0 tx=0).stop 2024-04-15T15:33:04.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 -- 172.21.15.73:0/610632135 shutdown_connections 2024-04-15T15:33:04.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa04c068410 0x7fa04c06a8d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:04.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa06c15b5d0 0x7fa06c071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:04.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa06c0b3e30 0x7fa06c159d70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:04.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 --2- 172.21.15.73:0/610632135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa06c0b27c0 0x7fa06c156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:04.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 -- 172.21.15.73:0/610632135 >> 172.21.15.73:0/610632135 conn(0x7fa06c067dd0 msgr2=0x7fa06c06c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:04.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 -- 172.21.15.73:0/610632135 shutdown_connections 2024-04-15T15:33:04.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:04.705+0000 7fa072400640 1 -- 172.21.15.73:0/610632135 wait complete. 2024-04-15T15:33:04.725 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-15T15:33:04.725 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:33:04.725 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-04-15T15:33:04.725 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-15T15:33:04.725 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-15T15:33:04.725 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-15T15:33:04.725 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:04.726 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:33:04.726 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-15T15:33:04.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:04.726 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-04-15T15:33:04.736 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:33:04.736 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:33:04.737 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42383sec preferred_lft 42383sec 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 02:42:71:7b:96:37 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:04.738 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-15T15:33:04.739 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:04.739 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:33:04.739 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T15:33:04.739 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-15T15:33:04.739 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:04.739 INFO:teuthology.orchestra.run.smithi118.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:33:04.739 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-15T15:33:04.739 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-15T15:33:04.739 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:04.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:04.740 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:33:04.803 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-04-15T15:33:04.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:04.806 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-04-15T15:33:04.860 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-04-15T15:33:04.860 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:33:04.860 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:33:04.860 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:33:04.860 INFO:teuthology.orchestra.run.smithi118.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:33:04.860 INFO:teuthology.orchestra.run.smithi118.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:33:04.860 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:33:04.860 INFO:teuthology.orchestra.run.smithi118.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:04.860 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:04.860 INFO:teuthology.orchestra.run.smithi118.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:04.861 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:33:04.861 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:33:04.861 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:33:04.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:33:04.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:33:04.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:33:04.861 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:33:04.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:33:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:33:04.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:33:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:33:05.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:05.004 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-04-15T15:33:05.013 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-15T15:33:05.014 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-15T15:33:05.014 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-15T15:33:05.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:05.014 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-04-15T15:33:05.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:33:05.075 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-15T15:33:05.123 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-15T15:33:05.124 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:33:05.124 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-15T15:33:05.175 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:05.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:05.175 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:33:05.264 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:33:05.264 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-15T15:33:05.264 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:33:05.278 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:33:05.279 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-15T15:33:05.279 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:33:05.279 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:33:05.279 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:33:05.288 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-15T15:33:05.288 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-15T15:33:05.288 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:33:05.288 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:33:05.288 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:33:05.289 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790" 2024-04-15T15:33:05.289 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790:/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:05.289 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a72de584-7db8-4f62-b310-5ee655143eeb" will pass to kernel 2024-04-15T15:33:05.293 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-15T15:33:05.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:05.293 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-15T15:33:05.313 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:33:05.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:33:05.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:33:05.411 INFO:teuthology.orchestra.run.smithi118.stdout:client5401 2024-04-15T15:33:05.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:33:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcf2000640 1 Processor -- start 2024-04-15T15:33:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcf2000640 1 -- start start 2024-04-15T15:33:05.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcf2000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcec0b27c0 0x7efcec15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:05.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcf2000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efcec0b3e30 0x7efcec0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:05.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcf2000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcec070160 con 0x7efcec15b5d0 2024-04-15T15:33:05.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcf2000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7efcec15b9b0 con 0x7efcec0b3e30 2024-04-15T15:33:05.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcf2000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efcec15f1f0 con 0x7efcec0b27c0 2024-04-15T15:33:05.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efceb400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efcec15b5d0 0x7efcec0b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45014/0 (socket says 172.21.15.73:45014) 2024-04-15T15:33:05.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efceb400640 1 -- 172.21.15.73:0/2213859446 learned_addr learned my addr 172.21.15.73:0/2213859446 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcebe00640 1 --2- 172.21.15.73:0/2213859446 >> v2:172.21.15.118:3300/0 conn(0x7efcec0b3e30 0x7efcec0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efceaa00640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcec0b27c0 0x7efcec15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1126842751 0 0) 0x7efcec070160 con 0x7efcec15b5d0 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcd0003530 con 0x7efcec15b5d0 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3116907478 0 0) 0x7efcd0003530 con 0x7efcec15b5d0 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcec0b27c0 msgr2=0x7efcec15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcea000640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcec0b27c0 0x7efcec15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 >> v2:172.21.15.118:3300/0 conn(0x7efcec0b3e30 msgr2=0x7efcec0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcea000640 1 --2- 172.21.15.73:0/2213859446 >> v2:172.21.15.118:3300/0 conn(0x7efcec0b3e30 0x7efcec0b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcec06fe80 con 0x7efcec15b5d0 2024-04-15T15:33:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7efcdc001680 con 0x7efcec15b5d0 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.553+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 >> v1:172.21.15.73:6789/0 conn(0x7efcec15b5d0 legacy=0x7efcec0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcea000640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcd00039c0 0x7efcd0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcea000640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcec0b27c0 0x7efcd0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcea000640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd0004d50 0x7efcd00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efcec15f1f0 con 0x7efcd00039c0 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efcd000dc10 con 0x7efcd0004d50 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efcd000de10 con 0x7efcec0b27c0 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efceb400640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcd00039c0 0x7efcd0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efceaa00640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcec0b27c0 0x7efcd0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcebe00640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd0004d50 0x7efcd00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efceb400640 1 -- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcec0b27c0 msgr2=0x7efcd0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efceb400640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcec0b27c0 0x7efcd0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efceb400640 1 -- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd0004d50 msgr2=0x7efcd00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efceb400640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd0004d50 0x7efcd00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efceb400640 1 -- 172.21.15.73:0/2213859446 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd0003530 con 0x7efcd00039c0 2024-04-15T15:33:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcebe00640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd0004d50 0x7efcd00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efceb400640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcd00039c0 0x7efcd0003de0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c210 tx=0x7efcdc01cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d64aa5182425674 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcdc007d60 con 0x7efcd00039c0 2024-04-15T15:33:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcdc0a9020 con 0x7efcd00039c0 2024-04-15T15:33:05.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.557+0000 7efcea000640 1 -- 172.21.15.73:0/2213859446 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0058e0 con 0x7efcd00039c0 2024-04-15T15:33:05.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 -- 172.21.15.73:0/2213859446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcd00039c0 msgr2=0x7efcd0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:05.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 --2- 172.21.15.73:0/2213859446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcd00039c0 0x7efcd0003de0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c210 tx=0x7efcdc01cc70 comp rx=0 tx=0).stop 2024-04-15T15:33:05.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcebe00640 1 -- 172.21.15.73:0/2213859446 reap_dead start 2024-04-15T15:33:05.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 -- 172.21.15.73:0/2213859446 shutdown_connections 2024-04-15T15:33:05.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 -- 172.21.15.73:0/2213859446 >> 172.21.15.73:0/2213859446 conn(0x7efcec067dd0 msgr2=0x7efcec0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:05.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 -- 172.21.15.73:0/2213859446 shutdown_connections 2024-04-15T15:33:05.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 -- 172.21.15.73:0/2213859446 wait complete. 2024-04-15T15:33:05.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 Processor -- start 2024-04-15T15:33:05.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 -- start start 2024-04-15T15:33:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcd00039c0 0x7efcec1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcec15aaf0 0x7efcec0a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcec15af70 0x7efcec15ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efcec06faa0 con 0x7efcec15aaf0 2024-04-15T15:33:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efcec0b4240 con 0x7efcec15af70 2024-04-15T15:33:05.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcf2000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efcec06fc20 con 0x7efcd00039c0 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efceaa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcec15aaf0 0x7efcec0a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efceaa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcec15aaf0 0x7efcec0a94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59502/0 (socket says 172.21.15.73:59502) 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efceaa00640 1 -- 172.21.15.73:0/930492958 learned_addr learned my addr 172.21.15.73:0/930492958 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efceb400640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcd00039c0 0x7efcec1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efcebe00640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcec15af70 0x7efcec15ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efceaa00640 1 -- 172.21.15.73:0/930492958 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcd00039c0 msgr2=0x7efcec1527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efceaa00640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcd00039c0 0x7efcec1527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efceaa00640 1 -- 172.21.15.73:0/930492958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcec15af70 msgr2=0x7efcec15ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efceaa00640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcec15af70 0x7efcec15ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efceaa00640 1 -- 172.21.15.73:0/930492958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcec0cf0f0 con 0x7efcec15aaf0 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.561+0000 7efceaa00640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcec15aaf0 0x7efcec0a94c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efcd8011a00 tx=0x7efcd8011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efce3400640 1 -- 172.21.15.73:0/930492958 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd800fb50 con 0x7efcec15aaf0 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efce3400640 1 -- 172.21.15.73:0/930492958 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd800fcf0 con 0x7efcec15aaf0 2024-04-15T15:33:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efce3400640 1 -- 172.21.15.73:0/930492958 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd800fea0 con 0x7efcec15aaf0 2024-04-15T15:33:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efcf2000640 1 -- 172.21.15.73:0/930492958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcec15bd90 con 0x7efcec15aaf0 2024-04-15T15:33:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efcf2000640 1 -- 172.21.15.73:0/930492958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcec15c350 con 0x7efcec15aaf0 2024-04-15T15:33:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efcf2000640 1 -- 172.21.15.73:0/930492958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcec068ab0 con 0x7efcec15aaf0 2024-04-15T15:33:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efce3400640 1 -- 172.21.15.73:0/930492958 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7efcd8012040 con 0x7efcec15aaf0 2024-04-15T15:33:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efce3400640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efccc068410 0x7efccc06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efce3400640 1 -- 172.21.15.73:0/930492958 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7efcd8087190 con 0x7efcec15aaf0 2024-04-15T15:33:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efceb400640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efccc068410 0x7efccc06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:05.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.565+0000 7efceb400640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efccc068410 0x7efccc06a8d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0aa000 tx=0x7efcdc000ff0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:05.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.569+0000 7efce3400640 1 -- 172.21.15.73:0/930492958 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efcd8019030 con 0x7efcec15aaf0 2024-04-15T15:33:05.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 -- 172.21.15.73:0/930492958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efcec06f370 con 0x7efcec15aaf0 2024-04-15T15:33:05.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efce3400640 1 -- 172.21.15.73:0/930492958 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7efcd8056f40 con 0x7efcec15aaf0 2024-04-15T15:33:05.765 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-15T15:33:05.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 -- 172.21.15.73:0/930492958 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efccc068410 msgr2=0x7efccc06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efccc068410 0x7efccc06a8d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0aa000 tx=0x7efcdc000ff0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 -- 172.21.15.73:0/930492958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcec15aaf0 msgr2=0x7efcec0a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcec15aaf0 0x7efcec0a94c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efcd8011a00 tx=0x7efcd8011ec0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 -- 172.21.15.73:0/930492958 shutdown_connections 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcec15af70 0x7efcec15ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcec15aaf0 0x7efcec0a94c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7efccc068410 0x7efccc06a8d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 --2- 172.21.15.73:0/930492958 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcd00039c0 0x7efcec1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 -- 172.21.15.73:0/930492958 >> 172.21.15.73:0/930492958 conn(0x7efcec067dd0 msgr2=0x7efcec0ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 -- 172.21.15.73:0/930492958 shutdown_connections 2024-04-15T15:33:05.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:05.765+0000 7efcf2000640 1 -- 172.21.15.73:0/930492958 wait complete. 2024-04-15T15:33:05.786 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-15T15:33:05.786 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:33:05.787 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-04-15T15:33:05.787 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-15T15:33:05.787 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-15T15:33:05.787 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-15T15:33:05.787 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:05.787 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:33:05.787 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-15T15:33:05.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:05.787 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-04-15T15:33:05.796 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42370sec preferred_lft 42370sec 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:61:e3:76:67 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:05.797 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-15T15:33:05.798 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:05.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:05.799 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:33:05.861 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-04-15T15:33:05.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:05.863 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-04-15T15:33:05.922 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-04-15T15:33:05.922 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:33:05.922 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:33:05.922 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:33:05.922 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:33:05.922 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:33:05.922 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:33:05.922 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:05.923 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:05.923 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:05.923 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:33:05.923 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:33:05.923 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-15T15:33:05.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:33:05.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:33:05.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:33:05.923 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-15T15:33:06.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:33:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:33:06.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:06.061 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-15T15:33:06.070 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-15T15:33:06.070 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-15T15:33:06.071 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-15T15:33:06.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:06.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.1 up 2024-04-15T15:33:06.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:33:06.132 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-15T15:33:06.183 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-15T15:33:06.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:33:06.184 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-15T15:33:06.235 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:06.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:06.236 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-15T15:33:06.323 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-15T15:33:06.323 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-15T15:33:06.324 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:33:06.338 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-15T15:33:06.339 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-15T15:33:06.339 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:33:06.339 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:33:06.339 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:33:06.349 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-15T15:33:06.349 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-15T15:33:06.349 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-04-15T15:33:06.349 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:33:06.349 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:33:06.349 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790" 2024-04-15T15:33:06.349 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790:/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:06.349 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=a72de584-7db8-4f62-b310-5ee655143eeb" will pass to kernel 2024-04-15T15:33:06.353 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-15T15:33:06.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:06.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-15T15:33:06.372 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:33:06.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:33:06.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:33:06.475 INFO:teuthology.orchestra.run.smithi073.stdout:client5410 2024-04-15T15:33:06.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T15:33:06.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.609+0000 7fb6d4000640 1 Processor -- start 2024-04-15T15:33:06.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.609+0000 7fb6d4000640 1 -- start start 2024-04-15T15:33:06.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d4000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc146110 0x7fb6cc0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:06.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d4000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb6cc0b2530 0x7fb6cc072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:06.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d4000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6cc0cd3a0 con 0x7fb6cc0b20b0 2024-04-15T15:33:06.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d4000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb6cc0b29c0 con 0x7fb6cc0b2530 2024-04-15T15:33:06.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d4000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc0b5160 con 0x7fb6cc146110 2024-04-15T15:33:06.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d1600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc146110 0x7fb6cc0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:06.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d1600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc146110 0x7fb6cc0cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:35764/0 (socket says 172.21.15.73:35764) 2024-04-15T15:33:06.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d1600640 1 -- 172.21.15.73:0/315812806 learned_addr learned my addr 172.21.15.73:0/315812806 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:06.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d2000640 1 --2- 172.21.15.73:0/315812806 >> v2:172.21.15.118:3300/0 conn(0x7fb6cc0b2530 0x7fb6cc072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:06.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6cbe00640 1 -- 172.21.15.73:0/315812806 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 27028770 0 0) 0x7fb6cc0cd3a0 con 0x7fb6cc0b20b0 2024-04-15T15:33:06.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6cbe00640 1 -- 172.21.15.73:0/315812806 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6b4003530 con 0x7fb6cc0b20b0 2024-04-15T15:33:06.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d2000640 1 -- 172.21.15.73:0/315812806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc146110 msgr2=0x7fb6cc0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:06.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d2000640 1 --2- 172.21.15.73:0/315812806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc146110 0x7fb6cc0cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:06.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d2000640 1 -- 172.21.15.73:0/315812806 >> v1:172.21.15.118:6789/0 conn(0x7fb6cc0b20b0 legacy=0x7fb6cc071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:06.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d2000640 1 -- 172.21.15.73:0/315812806 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc0b40c0 con 0x7fb6cc0b2530 2024-04-15T15:33:06.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.613+0000 7fb6d1600640 1 --2- 172.21.15.73:0/315812806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc146110 0x7fb6cc0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:06.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d2000640 1 --2- 172.21.15.73:0/315812806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc0b2530 0x7fb6cc072520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40097c0 tx=0x7fb6c401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77f93a6a36f12598 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:06.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6cbe00640 1 -- 172.21.15.73:0/315812806 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40a7070 con 0x7fb6cc0b2530 2024-04-15T15:33:06.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6cbe00640 1 -- 172.21.15.73:0/315812806 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c40b0070 con 0x7fb6cc0b2530 2024-04-15T15:33:06.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6cbe00640 1 -- 172.21.15.73:0/315812806 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40ab890 con 0x7fb6cc0b2530 2024-04-15T15:33:06.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d4000640 1 -- 172.21.15.73:0/315812806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc0b2530 msgr2=0x7fb6cc072520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:06.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d4000640 1 --2- 172.21.15.73:0/315812806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc0b2530 0x7fb6cc072520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40097c0 tx=0x7fb6c401c470 comp rx=0 tx=0).stop 2024-04-15T15:33:06.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d4000640 1 -- 172.21.15.73:0/315812806 shutdown_connections 2024-04-15T15:33:06.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d4000640 1 --2- 172.21.15.73:0/315812806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc0b2530 0x7fb6cc072520 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:06.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d4000640 1 --2- 172.21.15.73:0/315812806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc146110 0x7fb6cc0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:06.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d4000640 1 -- 172.21.15.73:0/315812806 >> 172.21.15.73:0/315812806 conn(0x7fb6cc067dd0 msgr2=0x7fb6cc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:06.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d4000640 1 -- 172.21.15.73:0/315812806 shutdown_connections 2024-04-15T15:33:06.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d4000640 1 -- 172.21.15.73:0/315812806 wait complete. 2024-04-15T15:33:06.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d4000640 1 Processor -- start 2024-04-15T15:33:06.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.617+0000 7fb6d4000640 1 -- start start 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d4000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc0b20b0 0x7fb6cc06de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d4000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0b2530 0x7fb6cc162f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d4000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc146110 0x7fb6cc0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d4000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0b3d70 con 0x7fb6cc0b2530 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d4000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0b4c40 con 0x7fb6cc146110 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d4000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc0cdcf0 con 0x7fb6cc0b20b0 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d0c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0b2530 0x7fb6cc162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d1600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc0b20b0 0x7fb6cc06de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d0c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0b2530 0x7fb6cc162f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59512/0 (socket says 172.21.15.73:59512) 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d0c00640 1 -- 172.21.15.73:0/571297774 learned_addr learned my addr 172.21.15.73:0/571297774 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d2000640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc146110 0x7fb6cc0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:06.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d0c00640 1 -- 172.21.15.73:0/571297774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc0b20b0 msgr2=0x7fb6cc06de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:06.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d0c00640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc0b20b0 0x7fb6cc06de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:06.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d0c00640 1 -- 172.21.15.73:0/571297774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc146110 msgr2=0x7fb6cc0b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:06.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d0c00640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc146110 0x7fb6cc0b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:06.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d0c00640 1 -- 172.21.15.73:0/571297774 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc0af310 con 0x7fb6cc0b2530 2024-04-15T15:33:06.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d0c00640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0b2530 0x7fb6cc162f70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c530 tx=0x7fb6b800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:06.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6c9600640 1 -- 172.21.15.73:0/571297774 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80052d0 con 0x7fb6cc0b2530 2024-04-15T15:33:06.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6c9600640 1 -- 172.21.15.73:0/571297774 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b8005490 con 0x7fb6cc0b2530 2024-04-15T15:33:06.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6c9600640 1 -- 172.21.15.73:0/571297774 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8012850 con 0x7fb6cc0b2530 2024-04-15T15:33:06.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d4000640 1 -- 172.21.15.73:0/571297774 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc1fb650 con 0x7fb6cc0b2530 2024-04-15T15:33:06.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d4000640 1 -- 172.21.15.73:0/571297774 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc1fb370 con 0x7fb6cc0b2530 2024-04-15T15:33:06.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6d4000640 1 -- 172.21.15.73:0/571297774 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6cc068ab0 con 0x7fb6cc0b2530 2024-04-15T15:33:06.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.621+0000 7fb6c9600640 1 -- 172.21.15.73:0/571297774 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fb6b80129f0 con 0x7fb6cc0b2530 2024-04-15T15:33:06.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.625+0000 7fb6c9600640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb6ac068410 0x7fb6ac06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:06.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.625+0000 7fb6c9600640 1 -- 172.21.15.73:0/571297774 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb6b8086720 con 0x7fb6cc0b2530 2024-04-15T15:33:06.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.625+0000 7fb6d1600640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb6ac068410 0x7fb6ac06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:06.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.625+0000 7fb6d1600640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb6ac068410 0x7fb6ac06a8d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0b3450 tx=0x7fb6c000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:06.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.629+0000 7fb6c9600640 1 -- 172.21.15.73:0/571297774 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6cc0af310 con 0x7fb6cc0b2530 2024-04-15T15:33:06.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.821+0000 7fb6d4000640 1 -- 172.21.15.73:0/571297774 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb6cc1fb1a0 con 0x7fb6cc0b2530 2024-04-15T15:33:06.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.821+0000 7fb6c9600640 1 -- 172.21.15.73:0/571297774 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7fb6b8056420 con 0x7fb6cc0b2530 2024-04-15T15:33:06.823 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 -- 172.21.15.73:0/571297774 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb6ac068410 msgr2=0x7fb6ac06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb6ac068410 0x7fb6ac06a8d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0b3450 tx=0x7fb6c000b040 comp rx=0 tx=0).stop 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 -- 172.21.15.73:0/571297774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0b2530 msgr2=0x7fb6cc162f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0b2530 0x7fb6cc162f70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c530 tx=0x7fb6b800c9f0 comp rx=0 tx=0).stop 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 -- 172.21.15.73:0/571297774 shutdown_connections 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc146110 0x7fb6cc0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0b2530 0x7fb6cc162f70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb6ac068410 0x7fb6ac06a8d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 --2- 172.21.15.73:0/571297774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc0b20b0 0x7fb6cc06de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 -- 172.21.15.73:0/571297774 >> 172.21.15.73:0/571297774 conn(0x7fb6cc067dd0 msgr2=0x7fb6cc143680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 -- 172.21.15.73:0/571297774 shutdown_connections 2024-04-15T15:33:06.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:06.825+0000 7fb6d4000640 1 -- 172.21.15.73:0/571297774 wait complete. 2024-04-15T15:33:06.844 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-15T15:33:06.844 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T15:33:06.844 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-04-15T15:33:06.844 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-15T15:33:06.844 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-15T15:33:06.844 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-15T15:33:06.844 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:06.844 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T15:33:06.844 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-15T15:33:06.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:06.845 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-04-15T15:33:06.855 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T15:33:06.855 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T15:33:06.855 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T15:33:06.855 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:06.855 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-04-15T15:33:06.855 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42381sec preferred_lft 42381sec 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2024-04-15T15:33:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 02:42:71:7b:96:37 brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-15T15:33:06.857 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:06.858 INFO:teuthology.orchestra.run.smithi118.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-15T15:33:06.858 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-15T15:33:06.858 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-15T15:33:06.858 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-04-15T15:33:06.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:06.858 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T15:33:06.914 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-04-15T15:33:06.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:06.917 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-04-15T15:33:06.971 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-04-15T15:33:06.971 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T15:33:06.971 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-15T15:33:06.971 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T15:33:06.971 INFO:teuthology.orchestra.run.smithi118.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-15T15:33:06.971 INFO:teuthology.orchestra.run.smithi118.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-15T15:33:06.972 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T15:33:06.972 INFO:teuthology.orchestra.run.smithi118.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:06.972 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:06.972 INFO:teuthology.orchestra.run.smithi118.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-15T15:33:06.972 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T15:33:06.972 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T15:33:06.972 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-04-15T15:33:06.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T15:33:06.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T15:33:06.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T15:33:06.972 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-04-15T15:33:07.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:33:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T15:33:07.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:33:07.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:07.111 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-04-15T15:33:07.119 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-15T15:33:07.120 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-15T15:33:07.120 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-15T15:33:07.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:07.120 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.1 up 2024-04-15T15:33:07.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:33:07.184 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-15T15:33:07.235 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-15T15:33:07.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T15:33:07.236 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-15T15:33:07.286 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:07.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:07.287 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-15T15:33:07.375 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-15T15:33:07.375 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-15T15:33:07.375 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:33:07.390 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-15T15:33:07.390 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-15T15:33:07.390 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:33:07.390 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:33:07.390 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:33:07.399 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-15T15:33:07.399 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-15T15:33:07.399 INFO:teuthology.orchestra.run.smithi118.stdout:invalid new device string format 2024-04-15T15:33:07.399 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.118:3300,172.21.15.118:3301" 2024-04-15T15:33:07.399 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-15T15:33:07.399 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790" 2024-04-15T15:33:07.399 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.118:6789,172.21.15.118:6790:/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 2024-04-15T15:33:07.399 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=a72de584-7db8-4f62-b310-5ee655143eeb" will pass to kernel 2024-04-15T15:33:07.403 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-15T15:33:07.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:07.403 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-15T15:33:07.422 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-15T15:33:07.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:33:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:33:07.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-04-15T15:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:33:07.523 INFO:teuthology.orchestra.run.smithi118.stdout:client5422 2024-04-15T15:33:07.523 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'touch file') 2024-04-15T15:33:07.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T15:33:07.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T15:33:07.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:07.591 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quiesce.block -v 1 file) 2024-04-15T15:33:07.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 quiesce path /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 --wait 2024-04-15T15:33:07.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.789+0000 7f8320000640 1 Processor -- start 2024-04-15T15:33:07.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.789+0000 7f8320000640 1 -- start start 2024-04-15T15:33:07.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.789+0000 7f8320000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8318159340 0x7f831815c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.789+0000 7f8320000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f831815be20 con 0x7f83180ceb40 2024-04-15T15:33:07.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.789+0000 7f8320000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8318159720 con 0x7f831806c160 2024-04-15T15:33:07.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.789+0000 7f8320000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f83180cf6b0 con 0x7f8318159340 2024-04-15T15:33:07.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831cc00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f83180ceb40 0x7f831806ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40598/0 (socket says 172.21.15.73:40598) 2024-04-15T15:33:07.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831cc00640 1 -- 172.21.15.73:0/3052156325 learned_addr learned my addr 172.21.15.73:0/3052156325 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:07.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831d600640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8318159340 0x7f831815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2163663511 0 0) 0x7f831815be20 con 0x7f83180ceb40 2024-04-15T15:33:07.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8300003530 con 0x7f83180ceb40 2024-04-15T15:33:07.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 541636833 0 0) 0x7f8318159720 con 0x7f831806c160 2024-04-15T15:33:07.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f831815be20 con 0x7f831806c160 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2229588484 0 0) 0x7f8300003530 con 0x7f83180ceb40 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8318159340 msgr2=0x7f831815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8318159340 0x7f831815c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 >> v1:172.21.15.118:6789/0 conn(0x7f831806c160 legacy=0x7f83180b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831815c090 con 0x7f83180ceb40 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f8304001680 con 0x7f83180ceb40 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 >> v1:172.21.15.73:6789/0 conn(0x7f83180ceb40 legacy=0x7f831806ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8300003b80 0x7f8300003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8300004810 0x7f8300004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 0x7f830000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f83180cf6b0 con 0x7f83000051d0 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f830000bff0 con 0x7f8300004810 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f830000c1f0 con 0x7f8300003b80 2024-04-15T15:33:07.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831d600640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8318159340 0x7f831815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:07.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831e000640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 0x7f830000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831cc00640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8300004810 0x7f8300004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831d600640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8300003b80 0x7f8300003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831e000640 1 -- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8300003b80 msgr2=0x7f8300003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831e000640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8300003b80 0x7f8300003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831e000640 1 -- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8300004810 msgr2=0x7f8300004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831e000640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8300004810 0x7f8300004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.793+0000 7f831e000640 1 -- 172.21.15.73:0/3052156325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8300003530 con 0x7f83000051d0 2024-04-15T15:33:07.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f831e000640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 0x7f830000b9d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8310002060 tx=0x7f831001ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f43b7edd0beb61 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:07.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310001cb0 con 0x7f83000051d0 2024-04-15T15:33:07.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83100a7d30 con 0x7f83000051d0 2024-04-15T15:33:07.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8317e00640 1 -- 172.21.15.73:0/3052156325 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310003bc0 con 0x7f83000051d0 2024-04-15T15:33:07.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8320000640 1 -- 172.21.15.73:0/3052156325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 msgr2=0x7f830000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8320000640 1 --2- 172.21.15.73:0/3052156325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 0x7f830000b9d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8310002060 tx=0x7f831001ee10 comp rx=0 tx=0).stop 2024-04-15T15:33:07.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f831e000640 1 -- 172.21.15.73:0/3052156325 reap_dead start 2024-04-15T15:33:07.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8320000640 1 -- 172.21.15.73:0/3052156325 shutdown_connections 2024-04-15T15:33:07.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8320000640 1 -- 172.21.15.73:0/3052156325 >> 172.21.15.73:0/3052156325 conn(0x7f8318067e30 msgr2=0x7f83180b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:07.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8320000640 1 -- 172.21.15.73:0/3052156325 shutdown_connections 2024-04-15T15:33:07.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8320000640 1 -- 172.21.15.73:0/3052156325 wait complete. 2024-04-15T15:33:07.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8320000640 1 Processor -- start 2024-04-15T15:33:07.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.797+0000 7f8320000640 1 -- start start 2024-04-15T15:33:07.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8320000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 0x7f83181f0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8320000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f831815b0f0 0x7f83180a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8320000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f831815b550 0x7f83180a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8320000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f83180cf990 con 0x7f83000051d0 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8320000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f83180d00f0 con 0x7f831815b0f0 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8320000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f831815c890 con 0x7f831815b550 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831d600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 0x7f83181f0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831d600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 0x7f83181f0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49888/0 (socket says 172.21.15.73:49888) 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831d600640 1 -- 172.21.15.73:0/2832127771 learned_addr learned my addr 172.21.15.73:0/2832127771 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831e000640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f831815b550 0x7f83180a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831cc00640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f831815b0f0 0x7f83180a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831d600640 1 -- 172.21.15.73:0/2832127771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f831815b550 msgr2=0x7f83180a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831d600640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f831815b550 0x7f83180a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831d600640 1 -- 172.21.15.73:0/2832127771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f831815b0f0 msgr2=0x7f83180a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831d600640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f831815b0f0 0x7f83180a94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831d600640 1 -- 172.21.15.73:0/2832127771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83181f44b0 con 0x7f83000051d0 2024-04-15T15:33:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831e000640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f831815b550 0x7f83180a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831cc00640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f831815b0f0 0x7f83180a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f831d600640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 0x7f83181f0780 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f830c0119d0 tx=0x7f830c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8315600640 1 -- 172.21.15.73:0/2832127771 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c00fc10 con 0x7f83000051d0 2024-04-15T15:33:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8315600640 1 -- 172.21.15.73:0/2832127771 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c00fdb0 con 0x7f83000051d0 2024-04-15T15:33:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8315600640 1 -- 172.21.15.73:0/2832127771 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c014640 con 0x7f83000051d0 2024-04-15T15:33:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8320000640 1 -- 172.21.15.73:0/2832127771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83181f4790 con 0x7f83000051d0 2024-04-15T15:33:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.801+0000 7f8320000640 1 -- 172.21.15.73:0/2832127771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83181f4d50 con 0x7f83000051d0 2024-04-15T15:33:07.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8315600640 1 -- 172.21.15.73:0/2832127771 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f830c012040 con 0x7f83000051d0 2024-04-15T15:33:07.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8315600640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82f8068410 0x7f82f806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8315600640 1 -- 172.21.15.73:0/2832127771 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f830c0872e0 con 0x7f83000051d0 2024-04-15T15:33:07.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831cc00640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82f8068410 0x7f82f806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8323586000 1 Processor -- start 2024-04-15T15:33:07.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8323586000 1 -- start start 2024-04-15T15:33:07.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831cc00640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82f8068410 0x7f82f806a8d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83180cd670 tx=0x7f8304009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:07.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8323586000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18f8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8323586000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18f86c0 0x5643a18aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8323586000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 0x5643a18ab810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8323586000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5643a16f9800 con 0x5643a18f7da0 2024-04-15T15:33:07.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8323586000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5643a1694dd0 con 0x5643a18ab430 2024-04-15T15:33:07.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f8323586000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x5643a16f57c0 con 0x5643a18f86c0 2024-04-15T15:33:07.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831d600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831d600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18f8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49892/0 (socket says 172.21.15.73:49892) 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831d600640 1 -- 172.21.15.73:0/3689557472 learned_addr learned my addr 172.21.15.73:0/3689557472 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831e000640 1 --2- 172.21.15.73:0/3689557472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 0x5643a18ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831cc00640 1 --2- 172.21.15.73:0/3689557472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18f86c0 0x5643a18aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831d600640 1 -- 172.21.15.73:0/3689557472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18f86c0 msgr2=0x5643a18aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831d600640 1 --2- 172.21.15.73:0/3689557472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18f86c0 0x5643a18aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831d600640 1 -- 172.21.15.73:0/3689557472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 msgr2=0x5643a18ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831d600640 1 --2- 172.21.15.73:0/3689557472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 0x5643a18ab810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831d600640 1 -- 172.21.15.73:0/3689557472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a16d5d00 con 0x5643a18f7da0 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831e000640 1 --2- 172.21.15.73:0/3689557472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 0x5643a18ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f831d600640 1 --2- 172.21.15.73:0/3689557472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18f8180 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f830c0092f0 tx=0x7f830c0577b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc01b849ba39db server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f830a000640 1 -- 172.21.15.73:0/3689557472 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c022040 con 0x5643a18f7da0 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f830a000640 1 -- 172.21.15.73:0/3689557472 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c05fc90 con 0x5643a18f7da0 2024-04-15T15:33:07.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.805+0000 7f830a000640 1 -- 172.21.15.73:0/3689557472 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c05b0d0 con 0x5643a18f7da0 2024-04-15T15:33:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- 172.21.15.73:0/3689557472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 msgr2=0x5643a18f8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 --2- 172.21.15.73:0/3689557472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18f8180 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f830c0092f0 tx=0x7f830c0577b0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- 172.21.15.73:0/3689557472 shutdown_connections 2024-04-15T15:33:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 --2- 172.21.15.73:0/3689557472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 0x5643a18ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 --2- 172.21.15.73:0/3689557472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18f86c0 0x5643a18aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 --2- 172.21.15.73:0/3689557472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18f8180 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- 172.21.15.73:0/3689557472 >> 172.21.15.73:0/3689557472 conn(0x5643a16a4ee0 msgr2=0x5643a18dab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- 172.21.15.73:0/3689557472 shutdown_connections 2024-04-15T15:33:07.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- 172.21.15.73:0/3689557472 wait complete. 2024-04-15T15:33:07.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- start start 2024-04-15T15:33:07.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 Processor -- start 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 0x5643a18df240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18f7da0 0x5643a18df780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f86c0 0x5643a18dfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5643a16b55d0 con 0x5643a18f86c0 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5643a16b6a20 con 0x5643a18f7da0 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x5643a17b3b00 con 0x5643a18ab430 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 10 client.0 _ll_register_callbacks cb 0x5643a18949e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f86c0 0x5643a18dfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831d600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 0x5643a18df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831cc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18f7da0 0x5643a18df780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831d600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 0x5643a18df240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:60152/0 (socket says 172.21.15.73:60152) 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831d600640 1 -- 172.21.15.73:0/1654479987 learned_addr learned my addr 172.21.15.73:0/1654479987 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831cc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18f7da0 0x5643a18df780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:40554/0 (socket says 172.21.15.73:40554) 2024-04-15T15:33:07.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f86c0 0x5643a18dfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49894/0 (socket says 172.21.15.73:49894) 2024-04-15T15:33:07.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831d600640 1 -- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18f7da0 msgr2=0x5643a18df780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831d600640 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18f7da0 0x5643a18df780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831d600640 1 -- 172.21.15.73:0/1654479987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f86c0 msgr2=0x5643a18dfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831d600640 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f86c0 0x5643a18dfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831d600640 1 -- 172.21.15.73:0/1654479987 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5643a173d9e0 con 0x5643a18ab430 2024-04-15T15:33:07.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831e000640 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f86c0 0x5643a18dfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:07.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f831d600640 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 0x5643a18df240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f830c004780 tx=0x7f830c087050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74c257b933130822 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:07.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f82fea00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3301/0 2024-04-15T15:33:07.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f82fea00640 1 -- 172.21.15.73:0/1654479987 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c074060 con 0x5643a18ab430 2024-04-15T15:33:07.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f82fea00640 1 -- 172.21.15.73:0/1654479987 <== mon.2 v2:172.21.15.118:3301/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f830c0853b0 con 0x5643a18ab430 2024-04-15T15:33:07.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- 172.21.15.73:0/1654479987 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f830c05fc90 con 0x5643a18ab430 2024-04-15T15:33:07.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f82fea00640 1 -- 172.21.15.73:0/1654479987 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f830c07a050 con 0x5643a18ab430 2024-04-15T15:33:07.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 10 client.5087 fetch_fsmap learned FSMap version 18 2024-04-15T15:33:07.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f8323586000 1 -- 172.21.15.73:0/1654479987 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5643a16bf5f0 con 0x5643a18ab430 2024-04-15T15:33:07.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.809+0000 7f82fea00640 1 -- 172.21.15.73:0/1654479987 <== mon.2 v2:172.21.15.118:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c05fc90 con 0x5643a18ab430 2024-04-15T15:33:07.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f82fea00640 1 -- 172.21.15.73:0/1654479987 <== mon.2 v2:172.21.15.118:3301/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f830c07d020 con 0x5643a18ab430 2024-04-15T15:33:07.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 10 client.5087 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T15:33:07.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 10 client.5087 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-04-15T15:33:07.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 20 client.5087 populate_metadata read hostname 'smithi073' 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5643a18e06d0 0x5643a1909050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 4 client.5087 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 -- 172.21.15.73:0/1654479987 --> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643a16933e0 con 0x5643a18e06d0 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f831cc00640 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5643a18e06d0 0x5643a1909050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f831cc00640 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5643a18e06d0 0x5643a1909050 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dd575551abf6df1 server_cookie=dffbcc1c983f4da0 in_seq=0 out_seq=0 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f82fea00640 10 client.5087 ms_handle_connect on v2:172.21.15.118:6832/2635966606 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f82fea00640 1 -- 172.21.15.73:0/1654479987 <== mds.0 v2:172.21.15.118:6832/2635966606 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5643a16933e0 con 0x5643a18e06d0 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f82fea00640 10 client.5087 handle_command_reply: tid=0 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 client.5087 shutdown 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 -- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 msgr2=0x5643a18df240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 0x5643a18df240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f830c004780 tx=0x7f830c087050 comp rx=0 tx=0).stop 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 -- 172.21.15.73:0/1654479987 shutdown_connections 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5643a18e06d0 0x5643a1909050 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f86c0 0x5643a18dfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18f7da0 0x5643a18df780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f82fea00640 0 client.5087 ms_handle_reset on v2:172.21.15.118:6832/2635966606 2024-04-15T15:33:07.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 --2- 172.21.15.73:0/1654479987 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 0x5643a18df240 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 -- 172.21.15.73:0/1654479987 >> 172.21.15.73:0/1654479987 conn(0x5643a16a4ee0 msgr2=0x5643a18aa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:07.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 -- 172.21.15.73:0/1654479987 shutdown_connections 2024-04-15T15:33:07.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 1 -- 172.21.15.73:0/1654479987 wait complete. 2024-04-15T15:33:07.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.813+0000 7f8323586000 20 client.5087 trim_cache size 0 max 16384 2024-04-15T15:33:07.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f8323586000 1 Processor -- start 2024-04-15T15:33:07.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f8323586000 1 -- start start 2024-04-15T15:33:07.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f8323586000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a16a4ee0 0x5643a190c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f8323586000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 0x5643a18a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f8323586000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18a8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f8323586000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f83181fd680 con 0x5643a18f7da0 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f8323586000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f83181fc710 con 0x5643a16a4ee0 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f8323586000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8318153560 con 0x5643a18ab430 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f831e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f831e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18a8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49908/0 (socket says 172.21.15.73:49908) 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f831e000640 1 -- 172.21.15.73:0/2429144909 learned_addr learned my addr 172.21.15.73:0/2429144909 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f831d600640 1 --2- 172.21.15.73:0/2429144909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a16a4ee0 0x5643a190c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.829+0000 7f831cc00640 1 --2- 172.21.15.73:0/2429144909 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 0x5643a18a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831e000640 1 -- 172.21.15.73:0/2429144909 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 msgr2=0x5643a18a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831e000640 1 --2- 172.21.15.73:0/2429144909 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 0x5643a18a7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831e000640 1 -- 172.21.15.73:0/2429144909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a16a4ee0 msgr2=0x5643a190c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831e000640 1 --2- 172.21.15.73:0/2429144909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a16a4ee0 0x5643a190c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831e000640 1 -- 172.21.15.73:0/2429144909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a169d1e0 con 0x5643a18f7da0 2024-04-15T15:33:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831e000640 1 --2- 172.21.15.73:0/2429144909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18a8020 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8310025340 tx=0x7f8310001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66a863dfd7ff459 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8309600640 1 -- 172.21.15.73:0/2429144909 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310001c90 con 0x5643a18f7da0 2024-04-15T15:33:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8309600640 1 -- 172.21.15.73:0/2429144909 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8310006b60 con 0x5643a18f7da0 2024-04-15T15:33:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8309600640 1 -- 172.21.15.73:0/2429144909 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310003980 con 0x5643a18f7da0 2024-04-15T15:33:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 -- 172.21.15.73:0/2429144909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 msgr2=0x5643a18a8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 --2- 172.21.15.73:0/2429144909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18a8020 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8310025340 tx=0x7f8310001660 comp rx=0 tx=0).stop 2024-04-15T15:33:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 -- 172.21.15.73:0/2429144909 shutdown_connections 2024-04-15T15:33:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 --2- 172.21.15.73:0/2429144909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a18f7da0 0x5643a18a8020 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 --2- 172.21.15.73:0/2429144909 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18ab430 0x5643a18a7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 --2- 172.21.15.73:0/2429144909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a16a4ee0 0x5643a190c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 -- 172.21.15.73:0/2429144909 >> 172.21.15.73:0/2429144909 conn(0x5643a18f76c0 msgr2=0x5643a18ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 -- 172.21.15.73:0/2429144909 shutdown_connections 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 -- 172.21.15.73:0/2429144909 wait complete. 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 -- start start 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 Processor -- start 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a16a4ee0 0x5643a196bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 0x5643a196c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18f7da0 0x5643a19084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5643a1706a10 con 0x5643a16a4ee0 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f83180b47b0 con 0x5643a18ab430 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x5643a18a5950 con 0x5643a18f7da0 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f8323586000 10 client.0 _ll_register_callbacks cb 0x7f830c080020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:33:07.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831d600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a16a4ee0 0x5643a196bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831d600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a16a4ee0 0x5643a196bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49910/0 (socket says 172.21.15.73:49910) 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831d600640 1 -- 172.21.15.73:0/2816878197 learned_addr learned my addr 172.21.15.73:0/2816878197 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831cc00640 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 0x5643a196c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831e000640 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18f7da0 0x5643a19084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831d600640 1 -- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18f7da0 msgr2=0x5643a19084f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831d600640 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18f7da0 0x5643a19084f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831d600640 1 -- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 msgr2=0x5643a196c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831d600640 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 0x5643a196c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.833+0000 7f831d600640 1 -- 172.21.15.73:0/2816878197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a167da50 con 0x5643a16a4ee0 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f831d600640 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a16a4ee0 0x5643a196bdf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f830c055360 tx=0x7f830c0533d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbce1306bd7b748 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f82fea00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f82fea00640 1 -- 172.21.15.73:0/2816878197 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c082070 con 0x5643a16a4ee0 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f82fea00640 1 -- 172.21.15.73:0/2816878197 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f830c05fa10 con 0x5643a16a4ee0 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f8323586000 1 -- 172.21.15.73:0/2816878197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8310006b60 con 0x5643a16a4ee0 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f82fea00640 1 -- 172.21.15.73:0/2816878197 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f830c022040 con 0x5643a16a4ee0 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f8323586000 10 client.5661 fetch_fsmap learned FSMap version 18 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f8323586000 1 -- 172.21.15.73:0/2816878197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5643a13b3a00 con 0x5643a16a4ee0 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f82fea00640 1 -- 172.21.15.73:0/2816878197 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8310006b60 con 0x5643a16a4ee0 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f82fea00640 1 -- 172.21.15.73:0/2816878197 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f830c07d040 con 0x5643a16a4ee0 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f8323586000 10 client.5661 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f8323586000 10 client.5661 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f8323586000 20 client.5661 populate_metadata read hostname 'smithi073' 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f8323586000 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5643a18f86c0 0x5643a1908fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f8323586000 4 client.5661 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "quiesce path", "path": "/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5", "wait": true}] 2024-04-15T15:33:07.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f8323586000 1 -- 172.21.15.73:0/2816878197 --> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] -- command(tid 0: {"prefix": "quiesce path", "path": "/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5", "wait": true}) -- 0x5643a167f350 con 0x5643a18f86c0 2024-04-15T15:33:07.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f831cc00640 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5643a18f86c0 0x5643a1908fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:07.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f831cc00640 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5643a18f86c0 0x5643a1908fa0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3984fc09ad6ab731 server_cookie=1f23225ffabf7157 in_seq=0 out_seq=0 2024-04-15T15:33:07.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.837+0000 7f82fea00640 10 client.5661 ms_handle_connect on v2:172.21.15.118:6832/2635966606 2024-04-15T15:33:07.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f82fea00640 1 -- 172.21.15.73:0/2816878197 <== mds.0 v2:172.21.15.118:6832/2635966606 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2332 (crc 0 0 0) 0x5643a167f350 con 0x5643a18f86c0 2024-04-15T15:33:07.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f82fea00640 10 client.5661 handle_command_reply: tid=0 2024-04-15T15:33:07.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 client.5661 shutdown 2024-04-15T15:33:07.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 -- 172.21.15.73:0/2816878197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a16a4ee0 msgr2=0x5643a196bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a16a4ee0 0x5643a196bdf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f830c055360 tx=0x7f830c0533d0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 -- 172.21.15.73:0/2816878197 shutdown_connections 2024-04-15T15:33:07.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x5643a18f86c0 0x5643a1908fa0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5643a18f7da0 0x5643a19084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643a18ab430 0x5643a196c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f82fea00640 0 client.5661 ms_handle_reset on v2:172.21.15.118:6832/2635966606 2024-04-15T15:33:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 --2- 172.21.15.73:0/2816878197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643a16a4ee0 0x5643a196bdf0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 -- 172.21.15.73:0/2816878197 >> 172.21.15.73:0/2816878197 conn(0x5643a18f76c0 msgr2=0x5643a18ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 -- 172.21.15.73:0/2816878197 shutdown_connections 2024-04-15T15:33:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 1 -- 172.21.15.73:0/2816878197 wait complete. 2024-04-15T15:33:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8323586000 20 client.5661 trim_cache size 0 max 16384 2024-04-15T15:33:07.844 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:07.844 INFO:teuthology.orchestra.run.smithi073.stdout: "op": { 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "result": 0, 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "quiesce complete", 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "reqid": { 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": { 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "mds", 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 0 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "op_type": "internal_op", 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "internal_op": 5384, 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "op_name": "quiesce_path", 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-04-15T15:33:07.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.838331+0000", 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated" 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.838331+0000", 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read" 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.838331+0000", 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled" 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.838331+0000", 2024-04-15T15:33:07.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read" 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.838331+0000", 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched" 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.838413+0000", 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "acquired locks" 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.838447+0000", 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "acquired locks" 2024-04-15T15:33:07.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.838479+0000", 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "acquired locks" 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.838514+0000", 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "acquired locks" 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.842636+0000", 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "acquired locks" 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.842646+0000", 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "acquired locks" 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.842656+0000", 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "acquired locks" 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.842666+0000", 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "acquired locks" 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-04-15T15:33:07.842678+0000", 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "quiesce complete" 2024-04-15T15:33:07.849 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "locks": null 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "state": { 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 2, 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_quiesced": 1, 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_blocked": 1, 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_dropped": 0, 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: "failed": [] 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-15T15:33:07.850 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:07.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8320000640 1 -- 172.21.15.73:0/2832127771 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82f8068410 msgr2=0x7f82f806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8320000640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82f8068410 0x7f82f806a8d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83180cd670 tx=0x7f8304009040 comp rx=0 tx=0).stop 2024-04-15T15:33:07.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8320000640 1 -- 172.21.15.73:0/2832127771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 msgr2=0x7f83181f0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:07.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8320000640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 0x7f83181f0780 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f830c0119d0 tx=0x7f830c011e90 comp rx=0 tx=0).stop 2024-04-15T15:33:07.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8320000640 1 -- 172.21.15.73:0/2832127771 shutdown_connections 2024-04-15T15:33:07.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8320000640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f82f8068410 0x7f82f806a8d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8320000640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f831815b550 0x7f83180a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8320000640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f831815b0f0 0x7f83180a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8320000640 1 --2- 172.21.15.73:0/2832127771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83000051d0 0x7f83181f0780 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:07.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.841+0000 7f8320000640 1 -- 172.21.15.73:0/2832127771 >> 172.21.15.73:0/2832127771 conn(0x7f8318067e30 msgr2=0x7f831815cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:07.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.845+0000 7f8320000640 1 -- 172.21.15.73:0/2832127771 shutdown_connections 2024-04-15T15:33:07.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.845+0000 7f8320000640 1 -- 172.21.15.73:0/2832127771 wait complete. 2024-04-15T15:33:07.863 DEBUG:tasks.cephfs.test_quiesce:{'op': {'result': 0, 'flag_point': 'quiesce complete', 'reqid': {'entity': {'type': 'mds', 'num': 0}, 'tid': 1}, 'op_type': 'internal_op', 'internal_op': 5384, 'op_name': 'quiesce_path', 'events': [{'time': '2024-04-15T15:33:07.838331+0000', 'event': 'initiated'}, {'time': '2024-04-15T15:33:07.838331+0000', 'event': 'header_read'}, {'time': '2024-04-15T15:33:07.838331+0000', 'event': 'throttled'}, {'time': '2024-04-15T15:33:07.838331+0000', 'event': 'all_read'}, {'time': '2024-04-15T15:33:07.838331+0000', 'event': 'dispatched'}, {'time': '2024-04-15T15:33:07.838413+0000', 'event': 'acquired locks'}, {'time': '2024-04-15T15:33:07.838447+0000', 'event': 'acquired locks'}, {'time': '2024-04-15T15:33:07.838479+0000', 'event': 'acquired locks'}, {'time': '2024-04-15T15:33:07.838514+0000', 'event': 'acquired locks'}, {'time': '2024-04-15T15:33:07.842636+0000', 'event': 'acquired locks'}, {'time': '2024-04-15T15:33:07.842646+0000', 'event': 'acquired locks'}, {'time': '2024-04-15T15:33:07.842656+0000', 'event': 'acquired locks'}, {'time': '2024-04-15T15:33:07.842666+0000', 'event': 'acquired locks'}, {'time': '2024-04-15T15:33:07.842678+0000', 'event': 'quiesce complete'}], 'locks': None}, 'state': {'inodes': 2, 'inodes_quiesced': 1, 'inodes_blocked': 1, 'inodes_dropped': 0, 'failed': []}} 2024-04-15T15:33:07.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:33:07.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35e2600640 1 Processor -- start 2024-04-15T15:33:07.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35e2600640 1 -- start start 2024-04-15T15:33:07.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35e2600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35dc15c700 0x7f35dc0d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35e2600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc15cae0 0x7f35dc160400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35e2600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35dc09aeb0 con 0x7f35dc0d12e0 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35e2600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f35dc09b190 con 0x7f35dc15c700 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35e2600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc09b470 con 0x7f35dc15cae0 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35db400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35dc15c700 0x7f35dc0d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35db400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35dc15c700 0x7f35dc0d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49926/0 (socket says 172.21.15.73:49926) 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35db400640 1 -- 172.21.15.73:0/3744896200 learned_addr learned my addr 172.21.15.73:0/3744896200 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:07.997+0000 7f35daa00640 1 --2- 172.21.15.73:0/3744896200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc15cae0 0x7f35dc160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35db400640 1 -- 172.21.15.73:0/3744896200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc15cae0 msgr2=0x7f35dc160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35db400640 1 --2- 172.21.15.73:0/3744896200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc15cae0 0x7f35dc160400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35db400640 1 -- 172.21.15.73:0/3744896200 >> v1:172.21.15.118:6789/0 conn(0x7f35dc0d12e0 legacy=0x7f35dc0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35db400640 1 -- 172.21.15.73:0/3744896200 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc09b750 con 0x7f35dc15c700 2024-04-15T15:33:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35db400640 1 --2- 172.21.15.73:0/3744896200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35dc15c700 0x7f35dc0d0da0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009e50 tx=0x7f35cc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd78f7424ba819a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35da000640 1 -- 172.21.15.73:0/3744896200 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0a5700 con 0x7f35dc15c700 2024-04-15T15:33:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35da000640 1 -- 172.21.15.73:0/3744896200 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35cc0a58a0 con 0x7f35dc15c700 2024-04-15T15:33:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35da000640 1 -- 172.21.15.73:0/3744896200 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0a5c70 con 0x7f35dc15c700 2024-04-15T15:33:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35e2600640 1 -- 172.21.15.73:0/3744896200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35dc15c700 msgr2=0x7f35dc0d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35e2600640 1 --2- 172.21.15.73:0/3744896200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35dc15c700 0x7f35dc0d0da0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009e50 tx=0x7f35cc01ca30 comp rx=0 tx=0).stop 2024-04-15T15:33:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35e2600640 1 -- 172.21.15.73:0/3744896200 shutdown_connections 2024-04-15T15:33:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35e2600640 1 --2- 172.21.15.73:0/3744896200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc15cae0 0x7f35dc160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35e2600640 1 --2- 172.21.15.73:0/3744896200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35dc15c700 0x7f35dc0d0da0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35e2600640 1 -- 172.21.15.73:0/3744896200 >> 172.21.15.73:0/3744896200 conn(0x7f35dc0b4080 msgr2=0x7f35dc0b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.001+0000 7f35e2600640 1 -- 172.21.15.73:0/3744896200 shutdown_connections 2024-04-15T15:33:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35e2600640 1 -- 172.21.15.73:0/3744896200 wait complete. 2024-04-15T15:33:08.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35e2600640 1 Processor -- start 2024-04-15T15:33:08.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35e2600640 1 -- start start 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35e2600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc0d12e0 0x7f35dc15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35e2600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc15c700 0x7f35dc156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35e2600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35dc15cae0 0x7f35dc0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35e2600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc0b3ee0 con 0x7f35dc15cae0 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35e2600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc09ac70 con 0x7f35dc15c700 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35e2600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc0b5bf0 con 0x7f35dc0d12e0 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35dbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35dc15cae0 0x7f35dc0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35db400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc0d12e0 0x7f35dc15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35db400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc0d12e0 0x7f35dc15a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:60192/0 (socket says 172.21.15.73:60192) 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35db400640 1 -- 172.21.15.73:0/1070989485 learned_addr learned my addr 172.21.15.73:0/1070989485 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35daa00640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc15c700 0x7f35dc156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35db400640 1 -- 172.21.15.73:0/1070989485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc15c700 msgr2=0x7f35dc156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35db400640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc15c700 0x7f35dc156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35db400640 1 -- 172.21.15.73:0/1070989485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35dc15cae0 msgr2=0x7f35dc0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35db400640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35dc15cae0 0x7f35dc0c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35db400640 1 -- 172.21.15.73:0/1070989485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc1f8b30 con 0x7f35dc0d12e0 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35dbe00640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35dc15cae0 0x7f35dc0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35db400640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc0d12e0 0x7f35dc15a620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f35cc01a660 tx=0x7f35cc0197d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35d3400640 1 -- 172.21.15.73:0/1070989485 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0a5c60 con 0x7f35dc0d12e0 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35d3400640 1 -- 172.21.15.73:0/1070989485 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35cc0a5e00 con 0x7f35dc0d12e0 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35e2600640 1 -- 172.21.15.73:0/1070989485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc1f8e10 con 0x7f35dc0d12e0 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.005+0000 7f35d3400640 1 -- 172.21.15.73:0/1070989485 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0b8690 con 0x7f35dc0d12e0 2024-04-15T15:33:08.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.009+0000 7f35e2600640 1 -- 172.21.15.73:0/1070989485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1f93d0 con 0x7f35dc0d12e0 2024-04-15T15:33:08.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.009+0000 7f35e2600640 1 -- 172.21.15.73:0/1070989485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc1f9610 con 0x7f35dc0d12e0 2024-04-15T15:33:08.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.009+0000 7f35d3400640 1 -- 172.21.15.73:0/1070989485 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f35cc0c0020 con 0x7f35dc0d12e0 2024-04-15T15:33:08.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.009+0000 7f35d3400640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35bc068410 0x7f35bc06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.009+0000 7f35d3400640 1 -- 172.21.15.73:0/1070989485 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f35cc120ff0 con 0x7f35dc0d12e0 2024-04-15T15:33:08.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.009+0000 7f35daa00640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35bc068410 0x7f35bc06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.009+0000 7f35daa00640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35bc068410 0x7f35bc06a8d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0c91e0 tx=0x7f35c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:08.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.013+0000 7f35d3400640 1 -- 172.21.15.73:0/1070989485 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f35cc0c7020 con 0x7f35dc0d12e0 2024-04-15T15:33:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.205+0000 7f35e2600640 1 -- 172.21.15.73:0/1070989485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35dc068ab0 con 0x7f35dc0d12e0 2024-04-15T15:33:08.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.205+0000 7f35d3400640 1 -- 172.21.15.73:0/1070989485 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5187 (secure 0 0 0) 0x7f35cc016620 con 0x7f35dc0d12e0 2024-04-15T15:33:08.206 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:08.206 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5322,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1374015509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1374015509},{"type":"v1","addr":"172.21.15.73:6836","nonce":1374015509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:32:49.112134+0000","modified":"2024-04-15T15:32:52.124603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/2635966606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2635966606},{"type":"v1","addr":"172.21.15.118:6834","nonce":2635966606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":2}]} 2024-04-15T15:33:08.207 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 18 2024-04-15T15:33:08.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 -- 172.21.15.73:0/1070989485 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35bc068410 msgr2=0x7f35bc06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35bc068410 0x7f35bc06a8d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0c91e0 tx=0x7f35c8008040 comp rx=0 tx=0).stop 2024-04-15T15:33:08.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 -- 172.21.15.73:0/1070989485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc0d12e0 msgr2=0x7f35dc15a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc0d12e0 0x7f35dc15a620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f35cc01a660 tx=0x7f35cc0197d0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 -- 172.21.15.73:0/1070989485 shutdown_connections 2024-04-15T15:33:08.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35dc15cae0 0x7f35dc0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc15c700 0x7f35dc156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f35bc068410 0x7f35bc06a8d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 --2- 172.21.15.73:0/1070989485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35dc0d12e0 0x7f35dc15a620 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 -- 172.21.15.73:0/1070989485 >> 172.21.15.73:0/1070989485 conn(0x7f35dc0b4080 msgr2=0x7f35dc15b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:08.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 -- 172.21.15.73:0/1070989485 shutdown_connections 2024-04-15T15:33:08.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.209+0000 7f35e2600640 1 -- 172.21.15.73:0/1070989485 wait complete. 2024-04-15T15:33:08.230 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump tree /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 0 2024-04-15T15:33:08.386 INFO:teuthology.orchestra.run.smithi118.stdout:[{"ino":1099511627779,"rdev":0,"ctime":"2024-04-15T15:33:07.577055+0000","btime":"2024-04-15T15:32:59.011059+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":6,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-04-15T15:33:07.577055+0000","atime":"2024-04-15T15:32:59.011059+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-04-15T15:33:07.577055+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-15T15:33:07.597055+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-04-15T15:33:07.597055+0000"},"version":22,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":2,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"waiter":0,"authpin":1},"nref":8,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{"reqid":{"entity":{"type":"mds","num":0},"tid":2}}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5401,"pending":"pAsLsXsFs","issued":"pAsLsXsFs","wanted":"pAsLsXsFs","last_sent":8},{"client_id":5410,"pending":"pAsLsXsFs","issued":"pAsLsXsFs","wanted":"pAsLsXsFs","last_sent":8},{"client_id":5422,"pending":"pAsLsXsFs","issued":"pAsLsXsFs","wanted":"pAsLsXsFs","last_sent":8},{"client_id":5547,"pending":"pAsLsXs","issued":"pAsLsXs","wanted":"-","last_sent":9},{"client_id":5631,"pending":"pAsLsXsFs","issued":"pAsLsXsFs","wanted":"pAsLsXsFsxcral","last_sent":30}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[{"path":"/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"7","version":"7","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/pyvenv.cfg","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":false,"is_remote":false,"is_null":true,"is_new":false,"inode":0,"remote_type":"","version":1,"projected_version":0,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"authpin":0},"nref":0,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"]},{"path":"volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/file","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629282,"remote_type":"","version":6,"projected_version":6,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false}] 2024-04-15T15:33:08.387 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "2024-04-15T15:33:07.597055+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-04-15T15:32:59.011059+0000", "auth_pins": 1, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-04-15T15:32:59.011059+0000", "change_attr": 3, "client_caps": [ { "client_id": 5401, "issued": "pAsLsXsFs", "last_sent": 8, "pending": "pAsLsXsFs", "wanted": "pAsLsXsFs" }, { "client_id": 5410, "issued": "pAsLsXsFs", "last_sent": 8, "pending": "pAsLsXsFs", "wanted": "pAsLsXsFs" }, { "client_id": 5422, "issued": "pAsLsXsFs", "last_sent": 8, "pending": "pAsLsXsFs", "wanted": "pAsLsXsFs" }, { "client_id": 5547, "issued": "pAsLsXs", "last_sent": 9, "pending": "pAsLsXs", "wanted": "-" }, { "client_id": 5631, "issued": "pAsLsXsFs", "last_sent": 30, "pending": "pAsLsXsFs", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-04-15T15:33:07.577055+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 0, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": true, "is_primary": false, "is_remote": false, "lock": {}, "nref": 0, "path": "volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/pyvenv.cfg", "path_ino": 1, "pins": { "authpin": 0, "lock": 0 }, "projected_version": 0, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth" ], "version": 1, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629282, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/file", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 6, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 6, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2024-04-15T15:33:07.577055+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1099511627779, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 6, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2024-04-15T15:33:07.577055+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 8, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 2, "request": 1, "waiter": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "lock", "type": "iquiesce", "xlock_by": { "reqid": { "entity": { "num": 0, "type": "mds" }, "tid": 2 } } }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2024-04-15T15:33:07.597055+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 22, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } ] 2024-04-15T15:33:08.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 ops --flags=locks --path=/tmp/mds.0-ops 2024-04-15T15:33:08.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f137ac00640 1 Processor -- start 2024-04-15T15:33:08.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f137ac00640 1 -- start start 2024-04-15T15:33:08.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f137ac00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13740b38d0 0x7f137409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f137ac00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f13740d16c0 0x7f13741625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f137ac00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137409b140 con 0x7f1374162b20 2024-04-15T15:33:08.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f137ac00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f137409b420 con 0x7f13740d16c0 2024-04-15T15:33:08.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f137ac00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f137409b700 con 0x7f13740b38d0 2024-04-15T15:33:08.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f1373400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f13740d16c0 0x7f13741625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f1373e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13740b38d0 0x7f137409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f1373400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f13740d16c0 0x7f13741625e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:40578/0 (socket says 172.21.15.73:40578) 2024-04-15T15:33:08.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f1373400640 1 -- 172.21.15.73:0/1871724054 learned_addr learned my addr 172.21.15.73:0/1871724054 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:08.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f1373e00640 1 -- 172.21.15.73:0/1871724054 >> v2:172.21.15.118:3300/0 conn(0x7f13740d16c0 msgr2=0x7f13741625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:08.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f1373e00640 1 --2- 172.21.15.73:0/1871724054 >> v2:172.21.15.118:3300/0 conn(0x7f13740d16c0 0x7f13741625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f1373e00640 1 -- 172.21.15.73:0/1871724054 >> v1:172.21.15.118:6789/0 conn(0x7f1374162b20 legacy=0x7f137415e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f1373e00640 1 -- 172.21.15.73:0/1871724054 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137409b9e0 con 0x7f13740b38d0 2024-04-15T15:33:08.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.525+0000 7f1373400640 1 --2- 172.21.15.73:0/1871724054 >> v2:172.21.15.118:3300/0 conn(0x7f13740d16c0 0x7f13741625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f1373e00640 1 --2- 172.21.15.73:0/1871724054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13740b38d0 0x7f137409aa60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1364009d90 tx=0x7f136401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db67d1ab8c50cf9e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f1372a00640 1 -- 172.21.15.73:0/1871724054 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640b2070 con 0x7f13740b38d0 2024-04-15T15:33:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f1372a00640 1 -- 172.21.15.73:0/1871724054 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13640a5830 con 0x7f13740b38d0 2024-04-15T15:33:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f1372a00640 1 -- 172.21.15.73:0/1871724054 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640a5c00 con 0x7f13740b38d0 2024-04-15T15:33:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f137ac00640 1 -- 172.21.15.73:0/1871724054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13740b38d0 msgr2=0x7f137409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f137ac00640 1 --2- 172.21.15.73:0/1871724054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13740b38d0 0x7f137409aa60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1364009d90 tx=0x7f136401c970 comp rx=0 tx=0).stop 2024-04-15T15:33:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f137ac00640 1 -- 172.21.15.73:0/1871724054 shutdown_connections 2024-04-15T15:33:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f137ac00640 1 --2- 172.21.15.73:0/1871724054 >> v2:172.21.15.118:3300/0 conn(0x7f13740d16c0 0x7f13741625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f137ac00640 1 --2- 172.21.15.73:0/1871724054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13740b38d0 0x7f137409aa60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f137ac00640 1 -- 172.21.15.73:0/1871724054 >> 172.21.15.73:0/1871724054 conn(0x7f13740b4080 msgr2=0x7f13740b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f137ac00640 1 -- 172.21.15.73:0/1871724054 shutdown_connections 2024-04-15T15:33:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.529+0000 7f137ac00640 1 -- 172.21.15.73:0/1871724054 wait complete. 2024-04-15T15:33:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f137ac00640 1 Processor -- start 2024-04-15T15:33:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f137ac00640 1 -- start start 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f137ac00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13740b38d0 0x7f1374153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f137ac00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13740d16c0 0x7f13740c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f137ac00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1374162b20 0x7f13740c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f137ac00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f137415ef30 con 0x7f13740b38d0 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f137ac00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13740b3ec0 con 0x7f13740d16c0 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f137ac00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13740cd5a0 con 0x7f1374162b20 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1373e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13740b38d0 0x7f1374153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1373e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13740b38d0 0x7f1374153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49932/0 (socket says 172.21.15.73:49932) 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1373e00640 1 -- 172.21.15.73:0/2849303960 learned_addr learned my addr 172.21.15.73:0/2849303960 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1373400640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13740d16c0 0x7f13740c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1378c00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1374162b20 0x7f13740c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1373e00640 1 -- 172.21.15.73:0/2849303960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1374162b20 msgr2=0x7f13740c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1373e00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1374162b20 0x7f13740c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1373e00640 1 -- 172.21.15.73:0/2849303960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13740d16c0 msgr2=0x7f13740c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1373e00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13740d16c0 0x7f13740c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1373e00640 1 -- 172.21.15.73:0/2849303960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13740cbbc0 con 0x7f13740b38d0 2024-04-15T15:33:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1378c00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1374162b20 0x7f13740c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f1373e00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13740b38d0 0x7f1374153de0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f13640b0040 tx=0x7f1364019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f136be00640 1 -- 172.21.15.73:0/2849303960 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640bd020 con 0x7f13740b38d0 2024-04-15T15:33:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f136be00640 1 -- 172.21.15.73:0/2849303960 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13640b8670 con 0x7f13740b38d0 2024-04-15T15:33:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f136be00640 1 -- 172.21.15.73:0/2849303960 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640b2040 con 0x7f13740b38d0 2024-04-15T15:33:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f137ac00640 1 -- 172.21.15.73:0/2849303960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13740c6d00 con 0x7f13740b38d0 2024-04-15T15:33:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.533+0000 7f137ac00640 1 -- 172.21.15.73:0/2849303960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13740c77e0 con 0x7f13740b38d0 2024-04-15T15:33:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.537+0000 7f136be00640 1 -- 172.21.15.73:0/2849303960 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f13640c0020 con 0x7f13740b38d0 2024-04-15T15:33:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.537+0000 7f136be00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1354068410 0x7f135406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.537+0000 7f136be00640 1 -- 172.21.15.73:0/2849303960 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f1364121970 con 0x7f13740b38d0 2024-04-15T15:33:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.537+0000 7f137e0a1000 1 Processor -- start 2024-04-15T15:33:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.537+0000 7f137e0a1000 1 -- start start 2024-04-15T15:33:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.537+0000 7f1373400640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1354068410 0x7f135406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1373400640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1354068410 0x7f135406a8d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f137415b080 tx=0x7f1360009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e22750d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e2274c3630 0x55e2274c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e2273124b0 con 0x55e22750d050 2024-04-15T15:33:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55e2272b73a0 con 0x55e22750d970 2024-04-15T15:33:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55e22730e470 con 0x55e2274c3630 2024-04-15T15:33:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1373e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e22750d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1373e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e22750d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49948/0 (socket says 172.21.15.73:49948) 2024-04-15T15:33:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1373e00640 1 -- 172.21.15.73:0/3613726677 learned_addr learned my addr 172.21.15.73:0/3613726677 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1373e00640 1 -- 172.21.15.73:0/3613726677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e2274c3630 msgr2=0x55e2274c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1373e00640 1 --2- 172.21.15.73:0/3613726677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e2274c3630 0x55e2274c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1373e00640 1 -- 172.21.15.73:0/3613726677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 msgr2=0x55e2274c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1373e00640 1 --2- 172.21.15.73:0/3613726677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1373e00640 1 -- 172.21.15.73:0/3613726677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2273b8f30 con 0x55e22750d050 2024-04-15T15:33:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1373e00640 1 --2- 172.21.15.73:0/3613726677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e22750d430 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f136401a5a0 tx=0x7f1364000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263f61aefd4f741e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1368c00640 1 -- 172.21.15.73:0/3613726677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640f1740 con 0x55e22750d050 2024-04-15T15:33:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1368c00640 1 -- 172.21.15.73:0/3613726677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13640f5af0 con 0x55e22750d050 2024-04-15T15:33:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f1368c00640 1 -- 172.21.15.73:0/3613726677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640fa320 con 0x55e22750d050 2024-04-15T15:33:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 -- 172.21.15.73:0/3613726677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 msgr2=0x55e22750d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 --2- 172.21.15.73:0/3613726677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e22750d430 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f136401a5a0 tx=0x7f1364000f50 comp rx=0 tx=0).stop 2024-04-15T15:33:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 -- 172.21.15.73:0/3613726677 shutdown_connections 2024-04-15T15:33:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 --2- 172.21.15.73:0/3613726677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e2274c3630 0x55e2274c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 --2- 172.21.15.73:0/3613726677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 --2- 172.21.15.73:0/3613726677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e22750d430 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 -- 172.21.15.73:0/3613726677 >> 172.21.15.73:0/3613726677 conn(0x55e2274bf5e0 msgr2=0x55e2274c19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 -- 172.21.15.73:0/3613726677 shutdown_connections 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 -- 172.21.15.73:0/3613726677 wait complete. 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 -- start start 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 Processor -- start 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.541+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e2274c3630 0x55e2275145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e227514b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274f1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e22729bfd0 con 0x55e22750d050 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55e2272cac70 con 0x55e22750d970 2024-04-15T15:33:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55e22731f6c0 con 0x55e2274c3630 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 10 client.0 _ll_register_callbacks cb 0x55e227396ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e227514b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e227514b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49952/0 (socket says 172.21.15.73:49952) 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373400640 1 -- 172.21.15.73:0/1787899979 learned_addr learned my addr 172.21.15.73:0/1787899979 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373e00640 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e2274c3630 0x55e2275145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1378c00640 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373400640 1 -- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e2274c3630 msgr2=0x55e2275145c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373400640 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e2274c3630 0x55e2275145c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373400640 1 -- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 msgr2=0x55e2274f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373400640 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373400640 1 -- 172.21.15.73:0/1787899979 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e22738b1f0 con 0x55e22750d050 2024-04-15T15:33:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1378c00640 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373400640 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e227514b00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f13600149d0 tx=0x7f1360014a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be38d00f0ee6e34b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f135d600640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f135d600640 1 -- 172.21.15.73:0/1787899979 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360025020 con 0x55e22750d050 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f135d600640 1 -- 172.21.15.73:0/1787899979 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f13600213f0 con 0x55e22750d050 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- 172.21.15.73:0/1787899979 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13640f5af0 con 0x55e22750d050 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f135d600640 1 -- 172.21.15.73:0/1787899979 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f136001d040 con 0x55e22750d050 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 10 client.5676 fetch_fsmap learned FSMap version 18 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- 172.21.15.73:0/1787899979 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55e2272ea840 con 0x55e22750d050 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f135d600640 1 -- 172.21.15.73:0/1787899979 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13640f5af0 con 0x55e22750d050 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f135d600640 1 -- 172.21.15.73:0/1787899979 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f1360032080 con 0x55e22750d050 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 10 client.5676 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 10 client.5676 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-04-15T15:33:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 20 client.5676 populate_metadata read hostname 'smithi073' 2024-04-15T15:33:08.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x55e2274f1dd0 0x55e2274f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 4 client.5676 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:33:08.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- 172.21.15.73:0/1787899979 --> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2272abf70 con 0x55e2274f1dd0 2024-04-15T15:33:08.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373e00640 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x55e2274f1dd0 0x55e2274f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f1373e00640 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x55e2274f1dd0 0x55e2274f21b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d341b35bafcefa1 server_cookie=5a6381d98c3738af in_seq=0 out_seq=0 2024-04-15T15:33:08.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f135d600640 10 client.5676 ms_handle_connect on v2:172.21.15.118:6832/2635966606 2024-04-15T15:33:08.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f135d600640 1 -- 172.21.15.73:0/1787899979 <== mds.0 v2:172.21.15.118:6832/2635966606 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e2272abf70 con 0x55e2274f1dd0 2024-04-15T15:33:08.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f135d600640 10 client.5676 handle_command_reply: tid=0 2024-04-15T15:33:08.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 client.5676 shutdown 2024-04-15T15:33:08.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- 172.21.15.73:0/1787899979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 msgr2=0x55e227514b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e227514b00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f13600149d0 tx=0x7f1360014a00 comp rx=0 tx=0).stop 2024-04-15T15:33:08.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- 172.21.15.73:0/1787899979 shutdown_connections 2024-04-15T15:33:08.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x55e2274f1dd0 0x55e2274f21b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e22750d050 0x55e227514b00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 --2- 172.21.15.73:0/1787899979 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e2274c3630 0x55e2275145c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f135d600640 0 client.5676 ms_handle_reset on v2:172.21.15.118:6832/2635966606 2024-04-15T15:33:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- 172.21.15.73:0/1787899979 >> 172.21.15.73:0/1787899979 conn(0x55e2274bf5e0 msgr2=0x55e2274c19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- 172.21.15.73:0/1787899979 shutdown_connections 2024-04-15T15:33:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 1 -- 172.21.15.73:0/1787899979 wait complete. 2024-04-15T15:33:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.545+0000 7f137e0a1000 20 client.5676 trim_cache size 0 max 16384 2024-04-15T15:33:08.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.561+0000 7f137e0a1000 1 Processor -- start 2024-04-15T15:33:08.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.561+0000 7f137e0a1000 1 -- start start 2024-04-15T15:33:08.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.561+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.561+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e22750d050 0x55e2274c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1374204650 con 0x55e2274c3630 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1374203710 con 0x55e22750d970 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13740cb190 con 0x55e22750d050 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49960/0 (socket says 172.21.15.73:49960) 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 -- 172.21.15.73:0/2472089145 learned_addr learned my addr 172.21.15.73:0/2472089145 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373400640 1 --2- 172.21.15.73:0/2472089145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e22750d050 0x55e2274c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1378c00640 1 --2- 172.21.15.73:0/2472089145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 -- 172.21.15.73:0/2472089145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e22750d050 msgr2=0x55e2274c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 --2- 172.21.15.73:0/2472089145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e22750d050 0x55e2274c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 -- 172.21.15.73:0/2472089145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 msgr2=0x55e2274c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:08.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 --2- 172.21.15.73:0/2472089145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 -- 172.21.15.73:0/2472089145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2274f13a0 con 0x55e2274c3630 2024-04-15T15:33:08.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1378c00640 1 --2- 172.21.15.73:0/2472089145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:08.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 --2- 172.21.15.73:0/2472089145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c3010 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1364098350 tx=0x7f13640f3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4184f967fc3caed server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:08.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f135fe00640 1 -- 172.21.15.73:0/2472089145 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640eddb0 con 0x55e2274c3630 2024-04-15T15:33:08.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f135fe00640 1 -- 172.21.15.73:0/2472089145 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13640a5630 con 0x55e2274c3630 2024-04-15T15:33:08.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f135fe00640 1 -- 172.21.15.73:0/2472089145 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640edf50 con 0x55e2274c3630 2024-04-15T15:33:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- 172.21.15.73:0/2472089145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 msgr2=0x55e2274c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 --2- 172.21.15.73:0/2472089145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c3010 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1364098350 tx=0x7f13640f3000 comp rx=0 tx=0).stop 2024-04-15T15:33:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- 172.21.15.73:0/2472089145 shutdown_connections 2024-04-15T15:33:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 --2- 172.21.15.73:0/2472089145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d970 0x55e2274c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 --2- 172.21.15.73:0/2472089145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e22750d050 0x55e2274c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 --2- 172.21.15.73:0/2472089145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c3010 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- 172.21.15.73:0/2472089145 >> 172.21.15.73:0/2472089145 conn(0x55e2274bf5e0 msgr2=0x55e2274c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- 172.21.15.73:0/2472089145 shutdown_connections 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- 172.21.15.73:0/2472089145 wait complete. 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- start start 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 Processor -- start 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d050 0x55e2274c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e22750d970 0x55e22750fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e2272b5ed0 con 0x55e2274c3630 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13740cb7e0 con 0x55e22750d050 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55e2273117c0 con 0x55e22750d970 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f137e0a1000 10 client.0 _ll_register_callbacks cb 0x7f1360014650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49964/0 (socket says 172.21.15.73:49964) 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373e00640 1 -- 172.21.15.73:0/2843471725 learned_addr learned my addr 172.21.15.73:0/2843471725 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:08.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1378c00640 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e22750d970 0x55e22750fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.565+0000 7f1373400640 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d050 0x55e2274c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f1373e00640 1 -- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e22750d970 msgr2=0x55e22750fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f1373e00640 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e22750d970 0x55e22750fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f1373e00640 1 -- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d050 msgr2=0x55e2274c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f1373e00640 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d050 0x55e2274c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f1373e00640 1 -- 172.21.15.73:0/2843471725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e227357b90 con 0x55e2274c3630 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f1373e00640 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c4a60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f13640edba0 tx=0x7f1364121070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16280d00e665edb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f135d600640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f135d600640 1 -- 172.21.15.73:0/2843471725 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640eddb0 con 0x55e2274c3630 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f135d600640 1 -- 172.21.15.73:0/2843471725 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f13640f9e90 con 0x55e2274c3630 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 -- 172.21.15.73:0/2843471725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13640a5630 con 0x55e2274c3630 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f135d600640 1 -- 172.21.15.73:0/2843471725 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f13640edf50 con 0x55e2274c3630 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 10 client.5682 fetch_fsmap learned FSMap version 18 2024-04-15T15:33:08.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 -- 172.21.15.73:0/2843471725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55e227295fa0 con 0x55e2274c3630 2024-04-15T15:33:08.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f135d600640 1 -- 172.21.15.73:0/2843471725 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13640a5630 con 0x55e2274c3630 2024-04-15T15:33:08.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f135d600640 1 -- 172.21.15.73:0/2843471725 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f13640f0b90 con 0x55e2274c3630 2024-04-15T15:33:08.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 10 client.5682 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T15:33:08.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 10 client.5682 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-04-15T15:33:08.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 20 client.5682 populate_metadata read hostname 'smithi073' 2024-04-15T15:33:08.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x55e2275102a0 0x55e2275106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:08.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 4 client.5682 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/tmp/mds.0-ops"}] 2024-04-15T15:33:08.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 -- 172.21.15.73:0/2843471725 --> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/tmp/mds.0-ops"}) -- 0x55e22731fed0 con 0x55e2275102a0 2024-04-15T15:33:08.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f1373400640 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x55e2275102a0 0x55e2275106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:08.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f1373400640 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x55e2275102a0 0x55e2275106b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdda06cc1283be9c server_cookie=e187529af066a9a1 in_seq=0 out_seq=0 2024-04-15T15:33:08.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f135d600640 10 client.5682 ms_handle_connect on v2:172.21.15.118:6832/2635966606 2024-04-15T15:33:08.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f135d600640 1 -- 172.21.15.73:0/2843471725 <== mds.0 v2:172.21.15.118:6832/2635966606 1 ==== command_reply(tid 0: 0 ) ==== 8+0+33 (crc 0 0 0) 0x55e22731fed0 con 0x55e2275102a0 2024-04-15T15:33:08.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f135d600640 10 client.5682 handle_command_reply: tid=0 2024-04-15T15:33:08.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 client.5682 shutdown 2024-04-15T15:33:08.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 -- 172.21.15.73:0/2843471725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 msgr2=0x55e2274c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c4a60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f13640edba0 tx=0x7f1364121070 comp rx=0 tx=0).stop 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 -- 172.21.15.73:0/2843471725 shutdown_connections 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:6832/2635966606,v1:172.21.15.118:6834/2635966606] conn(0x55e2275102a0 0x55e2275106b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55e22750d970 0x55e22750fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e22750d050 0x55e2274c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 --2- 172.21.15.73:0/2843471725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e2274c3630 0x55e2274c4a60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f135d600640 0 client.5682 ms_handle_reset on v2:172.21.15.118:6832/2635966606 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 -- 172.21.15.73:0/2843471725 >> 172.21.15.73:0/2843471725 conn(0x55e2274bf5e0 msgr2=0x55e2274c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 -- 172.21.15.73:0/2843471725 shutdown_connections 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 1 -- 172.21.15.73:0/2843471725 wait complete. 2024-04-15T15:33:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137e0a1000 20 client.5682 trim_cache size 0 max 16384 2024-04-15T15:33:08.575 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:08.575 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/tmp/mds.0-ops" 2024-04-15T15:33:08.575 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137ac00640 1 -- 172.21.15.73:0/2849303960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1354068410 msgr2=0x7f135406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137ac00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1354068410 0x7f135406a8d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f137415b080 tx=0x7f1360009240 comp rx=0 tx=0).stop 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137ac00640 1 -- 172.21.15.73:0/2849303960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13740b38d0 msgr2=0x7f1374153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.569+0000 7f137ac00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13740b38d0 0x7f1374153de0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f13640b0040 tx=0x7f1364019710 comp rx=0 tx=0).stop 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.573+0000 7f137ac00640 1 -- 172.21.15.73:0/2849303960 shutdown_connections 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.573+0000 7f137ac00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1354068410 0x7f135406a8d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.573+0000 7f137ac00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1374162b20 0x7f13740c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.573+0000 7f137ac00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13740d16c0 0x7f13740c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.573+0000 7f137ac00640 1 --2- 172.21.15.73:0/2849303960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13740b38d0 0x7f1374153de0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.573+0000 7f137ac00640 1 -- 172.21.15.73:0/2849303960 >> 172.21.15.73:0/2849303960 conn(0x7f13740b4080 msgr2=0x7f1374161970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.573+0000 7f137ac00640 1 -- 172.21.15.73:0/2849303960 shutdown_connections 2024-04-15T15:33:08.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:08.573+0000 7f137ac00640 1 -- 172.21.15.73:0/2849303960 wait complete. 2024-04-15T15:33:08.590 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-04-15T15:33:08.598 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.9eDucb42gC 2024-04-15T15:33:08.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /tmp/mds.0-ops /tmp/tmp.9eDucb42gC 2024-04-15T15:33:08.658 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.9eDucb42gC 2024-04-15T15:33:08.772 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.9eDucb42gC is 8KB 2024-04-15T15:33:08.787 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.9eDucb42gC 2024-04-15T15:33:08.795 DEBUG:tasks.cephfs.filesystem:read 7849B of ops 2024-04-15T15:33:08.796 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump tree /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5 --path=/tmp/mds.0-cache 2024-04-15T15:33:08.992 INFO:teuthology.orchestra.run.smithi118.stdout:{"path":"/tmp/mds.0-cache"} 2024-04-15T15:33:08.992 DEBUG:tasks.cephfs.filesystem:_json_asok output { "path": "/tmp/mds.0-cache" } 2024-04-15T15:33:08.993 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-04-15T15:33:09.001 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.iRwAKlxiTf 2024-04-15T15:33:09.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /tmp/mds.0-cache /tmp/tmp.iRwAKlxiTf 2024-04-15T15:33:09.063 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.iRwAKlxiTf 2024-04-15T15:33:09.181 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.iRwAKlxiTf is 7KB 2024-04-15T15:33:09.233 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.iRwAKlxiTf 2024-04-15T15:33:09.241 DEBUG:tasks.cephfs.filesystem:read 7542B of cache 2024-04-15T15:33:09.241 INFO:tasks.cephfs.test_quiesce:qp = 1; qi = 1; qib = 1; qina = 0 2024-04-15T15:33:09.242 ERROR:tasks.cephfs.test_quiesce:inode: { "ino": 1099511627779, "rdev": 0, "ctime": "2024-04-15T15:33:07.577055+0000", "btime": "2024-04-15T15:32:59.011059+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 6, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2024-04-15T15:33:07.577055+0000", "atime": "2024-04-15T15:32:59.011059+0000", "time_warp_seq": 0, "change_attr": 3, "export_pin": -1, "export_ephemeral_random_pin": 0, "export_ephemeral_distributed_pin": false, "quiesce_block": false, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2024-04-15T15:33:07.577055+0000", "num_files": 1, "num_subdirs": 0, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 1, "rsnaps": 0, "rctime": "2024-04-15T15:33:07.597055+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 1, "rsnaps": 0, "rctime": "2024-04-15T15:33:07.597055+0000" }, "version": 22, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "request": 1, "lock": 2, "dirfrag": 1, "caps": 1, "dirtyparent": 1, "dirty": 1, "waiter": 0, "authpin": 1 }, "nref": 8, "versionlock": { "gather_set": [], "state": "lock", "type": "iversion", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "lock", "type": "inest", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "quiescelock": { "gather_set": [], "state": "lock", "type": "iquiesce", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "xlock_by": { "reqid": { "entity": { "type": "mds", "num": 0 }, "tid": 2 } } }, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 5401, "pending": "pAsLsXsFs", "issued": "pAsLsXsFs", "wanted": "pAsLsXsFs", "last_sent": 8 }, { "client_id": 5410, "pending": "pAsLsXsFs", "issued": "pAsLsXsFs", "wanted": "pAsLsXsFs", "last_sent": 8 }, { "client_id": 5422, "pending": "pAsLsXsFs", "issued": "pAsLsXsFs", "wanted": "pAsLsXsFs", "last_sent": 8 }, { "client_id": 5547, "pending": "pAsLsXs", "issued": "pAsLsXs", "wanted": "-", "last_sent": 9 }, { "client_id": 5631, "pending": "pAsLsXsFs", "issued": "pAsLsXsFs", "wanted": "pAsLsXsFsxcral", "last_sent": 30 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5", "dirfrag": "0x10000000003", "snapid_first": 2, "projected_version": "7", "version": "7", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "dirty": 1, "authpin": 0 }, "nref": 2, "dentries": [ { "path": "volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/pyvenv.cfg", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": false, "is_remote": false, "is_null": true, "is_new": false, "inode": 0, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "authpin": 0 }, "nref": 0, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "type": "dversion", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/file", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511629282, "remote_type": "", "version": 6, "projected_version": 6, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "is_frozen": false, "is_freezing": false, "pins": { "request": 0, "lock": 0, "inodepin": 1, "dirty": 1, "authpin": 0 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "type": "dversion", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] } ] } ], "is_subvolume": false } 2024-04-15T15:33:09.242 ERROR:tasks.cephfs.test_quiesce:op: { "description": "internal op quiesce_inode:mds.0:2 fp=#0x10000000003", "initiated_at": "2024-04-15T15:33:07.838546+0000", "age": 0.731976423, "duration": 0.732106506, "continuous": true, "type_data": { "result": -2147483648, "flag_point": "quiesce complete", "reqid": { "entity": { "type": "mds", "num": 0 }, "tid": 2 }, "op_type": "internal_op", "internal_op": 5385, "op_name": "quiesce_inode", "events": [ { "time": "2024-04-15T15:33:07.838546+0000", "event": "initiated" }, { "time": "2024-04-15T15:33:07.838546+0000", "event": "header_read" }, { "time": "2024-04-15T15:33:07.838546+0000", "event": "throttled" }, { "time": "2024-04-15T15:33:07.838546+0000", "event": "all_read" }, { "time": "2024-04-15T15:33:07.838546+0000", "event": "dispatched" }, { "time": "2024-04-15T15:33:07.839002+0000", "event": "failed to xlock, waiting" }, { "time": "2024-04-15T15:33:07.839490+0000", "event": "acquired locks" }, { "time": "2024-04-15T15:33:07.842618+0000", "event": "quiesce complete" } ], "locks": [ { "object": { "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "request": 1, "lock": 2, "dirfrag": 1, "caps": 1, "dirtyparent": 1, "dirty": 1, "waiter": 0, "authpin": 1 }, "nref": 8 }, "object_string": "[inode 0x10000000003 [...2,head] /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/ auth v22 ap=1 DIRTYPARENT f(v0 m2024-04-15T15:33:07.577055+0000 1=1+0) n(v0 rc2024-04-15T15:33:07.597055+0000 2=1+1) (inest lock) (iversion lock w=1) (iquiesce lock x=1 by request(mds.0:2 nref=3)) caps={5401=pAsLsXsFs/pAsLsXsFs@8,5410=pAsLsXsFs/pAsLsXsFs@8,5422=pAsLsXsFs/pAsLsXsFs@8,5547=pAsLsXs/-@9,5631=pAsLsXsFs/pAsLsXsFsxcral@30} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x55784a99d080]", "lock": { "gather_set": [], "state": "lock", "type": "iquiesce", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "xlock_by": { "reqid": { "entity": { "type": "mds", "num": 0 }, "tid": 2 } } }, "flags": 4, "wrlock_target": -1 }, { "object": { "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "request": 1, "lock": 2, "dirfrag": 1, "caps": 1, "dirtyparent": 1, "dirty": 1, "waiter": 0, "authpin": 1 }, "nref": 8 }, "object_string": "[inode 0x10000000003 [...2,head] /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/ auth v22 ap=1 DIRTYPARENT f(v0 m2024-04-15T15:33:07.577055+0000 1=1+0) n(v0 rc2024-04-15T15:33:07.597055+0000 2=1+1) (inest lock) (iversion lock w=1) (iquiesce lock x=1 by request(mds.0:2 nref=3)) caps={5401=pAsLsXsFs/pAsLsXsFs@8,5410=pAsLsXsFs/pAsLsXsFs@8,5422=pAsLsXsFs/pAsLsXsFs@8,5547=pAsLsXs/-@9,5631=pAsLsXsFs/pAsLsXsFsxcral@30} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x55784a99d080]", "lock": { "gather_set": [], "state": "lock", "type": "iversion", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "xlock_by": {} }, "flags": 2, "wrlock_target": -1 } ] } } 2024-04-15T15:33:09.243 ERROR:tasks.cephfs.test_quiesce:lock_type: iversion 2024-04-15T15:33:09.244 ERROR:tasks.cephfs.test_quiesce:cache: [ { "ino": 1099511629282, "rdev": 0, "ctime": "2024-04-15T15:33:07.597055+0000", "btime": "2024-04-15T15:33:07.577055+0000", "mode": 33204, "uid": 1000, "gid": 1271, "nlink": 1, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 6, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2024-04-15T15:33:07.581055+0000", "atime": "2024-04-15T15:33:07.581055+0000", "time_warp_seq": 2, "change_attr": 1, "export_pin": -1, "export_ephemeral_random_pin": 0, "export_ephemeral_distributed_pin": false, "quiesce_block": true, "client_ranges": [ { "client": 5631, "byte range": { "first": 0, "last": 4194304 }, "follows": 1 } ], "dirstat": { "version": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "change_attr": 0 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2024-04-15T15:33:07.597055+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 0, "rsnaps": 0, "rctime": "2024-04-15T15:33:07.597055+0000" }, "version": 6, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 4, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 1, "lock": 0, "caps": 1, "dirtyparent": 1, "dirty": 1, "waiter": 0, "authpin": 1 }, "nref": 5, "versionlock": { "gather_set": [], "state": "lock", "type": "iversion", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "authlock": { "gather_set": [], "state": "excl", "type": "iauth", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "linklock": {}, "dirfragtreelock": {}, "filelock": { "gather_set": [], "state": "excl", "type": "ifile", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "xattrlock": { "gather_set": [], "state": "excl", "type": "ixattr", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "snaplock": {}, "nestlock": { "gather_set": [], "state": "lock", "type": "inest", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "quiescelock": { "gather_set": [], "state": "lock", "type": "iquiesce", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 5631, "pending": "pAsxLsXsxFsxcrwb", "issued": "pAsxLsXsxFsxcrwb", "wanted": "pAsxXsxFxwb", "last_sent": 4 } ], "loner": 5631, "want_loner": 5631, "mds_caps_wanted": [], "dirfrags": [], "is_subvolume": false }, { "ino": 1099511627779, "rdev": 0, "ctime": "2024-04-15T15:33:07.577055+0000", "btime": "2024-04-15T15:32:59.011059+0000", "mode": 17407, "uid": 0, "gid": 0, "nlink": 1, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "layout": { "stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_id": 6, "pool_ns": "" }, "old_pools": [], "size": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "truncate_from": 0, "truncate_pending": 0, "mtime": "2024-04-15T15:33:07.577055+0000", "atime": "2024-04-15T15:32:59.011059+0000", "time_warp_seq": 0, "change_attr": 3, "export_pin": -1, "export_ephemeral_random_pin": 0, "export_ephemeral_distributed_pin": false, "quiesce_block": false, "client_ranges": [], "dirstat": { "version": 0, "mtime": "2024-04-15T15:33:07.577055+0000", "num_files": 1, "num_subdirs": 0, "change_attr": 1 }, "rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 1, "rsnaps": 0, "rctime": "2024-04-15T15:33:07.597055+0000" }, "accounted_rstat": { "version": 0, "rbytes": 0, "rfiles": 1, "rsubdirs": 1, "rsnaps": 0, "rctime": "2024-04-15T15:33:07.597055+0000" }, "version": 22, "file_data_version": 0, "xattr_version": 1, "backtrace_version": 2, "stray_prior_path": "", "max_size_ever": 0, "quota": { "max_bytes": 0, "max_files": 0 }, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "symlink": "", "xattrs": [], "dirfragtree": { "splits": [] }, "old_inodes": [], "oldest_snap": 18446744073709551614, "damage_flags": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "request": 1, "lock": 2, "dirfrag": 1, "caps": 1, "dirtyparent": 1, "dirty": 1, "waiter": 0, "authpin": 1 }, "nref": 8, "versionlock": { "gather_set": [], "state": "lock", "type": "iversion", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "xlock_by": {} }, "authlock": {}, "linklock": {}, "dirfragtreelock": {}, "filelock": {}, "xattrlock": {}, "snaplock": {}, "nestlock": { "gather_set": [], "state": "lock", "type": "inest", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "flocklock": {}, "policylock": {}, "quiescelock": { "gather_set": [], "state": "lock", "type": "iquiesce", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "xlock_by": { "reqid": { "entity": { "type": "mds", "num": 0 }, "tid": 2 } } }, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "client_caps": [ { "client_id": 5401, "pending": "pAsLsXsFs", "issued": "pAsLsXsFs", "wanted": "pAsLsXsFs", "last_sent": 8 }, { "client_id": 5410, "pending": "pAsLsXsFs", "issued": "pAsLsXsFs", "wanted": "pAsLsXsFs", "last_sent": 8 }, { "client_id": 5422, "pending": "pAsLsXsFs", "issued": "pAsLsXsFs", "wanted": "pAsLsXsFs", "last_sent": 8 }, { "client_id": 5547, "pending": "pAsLsXs", "issued": "pAsLsXs", "wanted": "-", "last_sent": 9 }, { "client_id": 5631, "pending": "pAsLsXsFs", "issued": "pAsLsXsFs", "wanted": "pAsLsXsFsxcral", "last_sent": 30 } ], "loner": -1, "want_loner": -1, "mds_caps_wanted": [], "dirfrags": [ { "path": "/volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5", "dirfrag": "0x10000000003", "snapid_first": 2, "projected_version": "7", "version": "7", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "dirty": 1, "authpin": 0 }, "nref": 2, "dentries": [ { "path": "volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/pyvenv.cfg", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": false, "is_remote": false, "is_null": true, "is_new": false, "inode": 0, "remote_type": "", "version": 1, "projected_version": 0, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "is_frozen": false, "is_freezing": false, "pins": { "lock": 0, "authpin": 0 }, "nref": 0, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "type": "dversion", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth" ] }, { "path": "volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/file", "path_ino": 1, "snap_first": 2, "snap_last": 18446744073709551614, "is_primary": true, "is_remote": false, "is_null": false, "is_new": false, "inode": 1099511629282, "remote_type": "", "version": 6, "projected_version": 6, "auth_pins": 0, "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "is_frozen": false, "is_freezing": false, "pins": { "request": 0, "lock": 0, "inodepin": 1, "dirty": 1, "authpin": 0 }, "nref": 2, "lock": {}, "versionlock": { "gather_set": [], "state": "lock", "type": "dversion", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "xlock_by": {} }, "states": [ "auth", "dirty" ] } ] } ], "is_subvolume": false } ] 2024-04-15T15:33:09.244 ERROR:tasks.cephfs.test_quiesce:ops: { "1099511627779": { "description": "internal op quiesce_inode:mds.0:2 fp=#0x10000000003", "initiated_at": "2024-04-15T15:33:07.838546+0000", "age": 0.731976423, "duration": 0.732106506, "continuous": true, "type_data": { "result": -2147483648, "flag_point": "quiesce complete", "reqid": { "entity": { "type": "mds", "num": 0 }, "tid": 2 }, "op_type": "internal_op", "internal_op": 5385, "op_name": "quiesce_inode", "events": [ { "time": "2024-04-15T15:33:07.838546+0000", "event": "initiated" }, { "time": "2024-04-15T15:33:07.838546+0000", "event": "header_read" }, { "time": "2024-04-15T15:33:07.838546+0000", "event": "throttled" }, { "time": "2024-04-15T15:33:07.838546+0000", "event": "all_read" }, { "time": "2024-04-15T15:33:07.838546+0000", "event": "dispatched" }, { "time": "2024-04-15T15:33:07.839002+0000", "event": "failed to xlock, waiting" }, { "time": "2024-04-15T15:33:07.839490+0000", "event": "acquired locks" }, { "time": "2024-04-15T15:33:07.842618+0000", "event": "quiesce complete" } ], "locks": [ { "object": { "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "request": 1, "lock": 2, "dirfrag": 1, "caps": 1, "dirtyparent": 1, "dirty": 1, "waiter": 0, "authpin": 1 }, "nref": 8 }, "object_string": "[inode 0x10000000003 [...2,head] /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/ auth v22 ap=1 DIRTYPARENT f(v0 m2024-04-15T15:33:07.577055+0000 1=1+0) n(v0 rc2024-04-15T15:33:07.597055+0000 2=1+1) (inest lock) (iversion lock w=1) (iquiesce lock x=1 by request(mds.0:2 nref=3)) caps={5401=pAsLsXsFs/pAsLsXsFs@8,5410=pAsLsXsFs/pAsLsXsFs@8,5422=pAsLsXsFs/pAsLsXsFs@8,5547=pAsLsXs/-@9,5631=pAsLsXsFs/pAsLsXsFsxcral@30} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x55784a99d080]", "lock": { "gather_set": [], "state": "lock", "type": "iquiesce", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "xlock_by": { "reqid": { "entity": { "type": "mds", "num": 0 }, "tid": 2 } } }, "flags": 4, "wrlock_target": -1 }, { "object": { "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "request": 1, "lock": 2, "dirfrag": 1, "caps": 1, "dirtyparent": 1, "dirty": 1, "waiter": 0, "authpin": 1 }, "nref": 8 }, "object_string": "[inode 0x10000000003 [...2,head] /volumes/_nogroup/subvol_quiesce/20944de7-47d5-40b0-9cbb-d4e83c66ffe5/ auth v22 ap=1 DIRTYPARENT f(v0 m2024-04-15T15:33:07.577055+0000 1=1+0) n(v0 rc2024-04-15T15:33:07.597055+0000 2=1+1) (inest lock) (iversion lock w=1) (iquiesce lock x=1 by request(mds.0:2 nref=3)) caps={5401=pAsLsXsFs/pAsLsXsFs@8,5410=pAsLsXsFs/pAsLsXsFs@8,5422=pAsLsXsFs/pAsLsXsFs@8,5547=pAsLsXs/-@9,5631=pAsLsXsFs/pAsLsXsFsxcral@30} | request=1 lock=2 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x55784a99d080]", "lock": { "gather_set": [], "state": "lock", "type": "iversion", "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "xlock_by": {} }, "flags": 2, "wrlock_target": -1 } ] } }, "1099511629282": { "description": "internal op quiesce_inode:mds.0:3 fp=#0x100000005e2", "initiated_at": "2024-04-15T15:33:07.839704+0000", "age": 0.730818157, "duration": 0.731048801, "continuous": true, "type_data": { "result": -2147483648, "flag_point": "quiesce blocked", "reqid": { "entity": { "type": "mds", "num": 0 }, "tid": 3 }, "op_type": "internal_op", "internal_op": 5385, "op_name": "quiesce_inode", "events": [ { "time": "2024-04-15T15:33:07.839704+0000", "event": "initiated" }, { "time": "2024-04-15T15:33:07.839704+0000", "event": "header_read" }, { "time": "2024-04-15T15:33:07.839704+0000", "event": "throttled" }, { "time": "2024-04-15T15:33:07.839704+0000", "event": "all_read" }, { "time": "2024-04-15T15:33:07.839704+0000", "event": "dispatched" }, { "time": "2024-04-15T15:33:07.839801+0000", "event": "failed to xlock, waiting" }, { "time": "2024-04-15T15:33:07.840356+0000", "event": "failed to xlock, waiting" }, { "time": "2024-04-15T15:33:07.842394+0000", "event": "acquired locks" }, { "time": "2024-04-15T15:33:07.842395+0000", "event": "quiesce blocked" } ], "locks": [] } } } 2024-04-15T15:33:09.244 INFO:tasks.cephfs.test_quiesce:making archive directory /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/quiesce 2024-04-15T15:33:09.247 ERROR:tasks.cephfs.test_quiesce:cache written to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/quiesce/cachetqgt8ggg 2024-04-15T15:33:09.249 ERROR:tasks.cephfs.test_quiesce:ops written to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/quiesce/opsw64vngk2 2024-04-15T15:33:09.249 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-15T15:33:09.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b8bc00640 1 Processor -- start 2024-04-15T15:33:09.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b8bc00640 1 -- start start 2024-04-15T15:33:09.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b8bc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4b840b20b0 0x7f4b840b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b8bc00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b8415cbd0 0x7f4b8415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b8bc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b840cd3a0 con 0x7f4b84146110 2024-04-15T15:33:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b8bc00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4b840b5160 con 0x7f4b8415cbd0 2024-04-15T15:33:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b8bc00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f4b840b40c0 con 0x7f4b840b20b0 2024-04-15T15:33:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b89c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b8415cbd0 0x7f4b8415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b89c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b8415cbd0 0x7f4b8415d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49968/0 (socket says 172.21.15.73:49968) 2024-04-15T15:33:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b89c00640 1 -- 172.21.15.73:0/3077677608 learned_addr learned my addr 172.21.15.73:0/3077677608 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.389+0000 7f4b83e00640 1 --2- 172.21.15.73:0/3077677608 >> v2:172.21.15.118:3300/0 conn(0x7f4b840b20b0 0x7f4b840b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b89c00640 1 -- 172.21.15.73:0/3077677608 >> v2:172.21.15.118:3300/0 conn(0x7f4b840b20b0 msgr2=0x7f4b840b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:09.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b89c00640 1 --2- 172.21.15.73:0/3077677608 >> v2:172.21.15.118:3300/0 conn(0x7f4b840b20b0 0x7f4b840b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b89c00640 1 -- 172.21.15.73:0/3077677608 >> v1:172.21.15.118:6789/0 conn(0x7f4b84146110 legacy=0x7f4b840cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:09.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b89c00640 1 -- 172.21.15.73:0/3077677608 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b840b43a0 con 0x7f4b8415cbd0 2024-04-15T15:33:09.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b83400640 1 -- 172.21.15.73:0/3077677608 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619579451 0 0) 0x7f4b840cd3a0 con 0x7f4b84146110 2024-04-15T15:33:09.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b89c00640 1 --2- 172.21.15.73:0/3077677608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8415cbd0 0x7f4b8415d020 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4b840cd570 tx=0x7f4b7c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde97f36619a793f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b83400640 1 -- 172.21.15.73:0/3077677608 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0a57a0 con 0x7f4b8415cbd0 2024-04-15T15:33:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b83400640 1 -- 172.21.15.73:0/3077677608 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0a5940 con 0x7f4b8415cbd0 2024-04-15T15:33:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b83400640 1 -- 172.21.15.73:0/3077677608 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0a5d10 con 0x7f4b8415cbd0 2024-04-15T15:33:09.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b8bc00640 1 -- 172.21.15.73:0/3077677608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8415cbd0 msgr2=0x7f4b8415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:09.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.393+0000 7f4b8bc00640 1 --2- 172.21.15.73:0/3077677608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8415cbd0 0x7f4b8415d020 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4b840cd570 tx=0x7f4b7c01c9f0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 -- 172.21.15.73:0/3077677608 shutdown_connections 2024-04-15T15:33:09.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 --2- 172.21.15.73:0/3077677608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8415cbd0 0x7f4b8415d020 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 --2- 172.21.15.73:0/3077677608 >> v2:172.21.15.118:3300/0 conn(0x7f4b840b20b0 0x7f4b840b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 -- 172.21.15.73:0/3077677608 >> 172.21.15.73:0/3077677608 conn(0x7f4b84067dd0 msgr2=0x7f4b840d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:09.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 -- 172.21.15.73:0/3077677608 shutdown_connections 2024-04-15T15:33:09.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 -- 172.21.15.73:0/3077677608 wait complete. 2024-04-15T15:33:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 Processor -- start 2024-04-15T15:33:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 -- start start 2024-04-15T15:33:09.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b840b20b0 0x7f4b840b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b84146110 0x7f4b8413dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b8415cbd0 0x7f4b841400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4b84169210 con 0x7f4b84146110 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4b840b3d70 con 0x7f4b8415cbd0 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4b84169390 con 0x7f4b840b20b0 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b83e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b84146110 0x7f4b8413dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b83e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b84146110 0x7f4b8413dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49980/0 (socket says 172.21.15.73:49980) 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b83e00640 1 -- 172.21.15.73:0/2729879801 learned_addr learned my addr 172.21.15.73:0/2729879801 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b89c00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b8415cbd0 0x7f4b841400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b89200640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b840b20b0 0x7f4b840b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b83e00640 1 -- 172.21.15.73:0/2729879801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b840b20b0 msgr2=0x7f4b840b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b83e00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b840b20b0 0x7f4b840b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b83e00640 1 -- 172.21.15.73:0/2729879801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b8415cbd0 msgr2=0x7f4b841400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b83e00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b8415cbd0 0x7f4b841400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b83e00640 1 -- 172.21.15.73:0/2729879801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8413e9a0 con 0x7f4b84146110 2024-04-15T15:33:09.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b89c00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b8415cbd0 0x7f4b841400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:09.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b83e00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b84146110 0x7f4b8413dee0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000e930 tx=0x7f4b7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:09.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b80c00640 1 -- 172.21.15.73:0/2729879801 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b70017070 con 0x7f4b84146110 2024-04-15T15:33:09.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b80c00640 1 -- 172.21.15.73:0/2729879801 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7000ca00 con 0x7f4b84146110 2024-04-15T15:33:09.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b80c00640 1 -- 172.21.15.73:0/2729879801 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000cdb0 con 0x7f4b84146110 2024-04-15T15:33:09.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 -- 172.21.15.73:0/2729879801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8413ec80 con 0x7f4b84146110 2024-04-15T15:33:09.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.397+0000 7f4b8bc00640 1 -- 172.21.15.73:0/2729879801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8413fbb0 con 0x7f4b84146110 2024-04-15T15:33:09.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.401+0000 7f4b8bc00640 1 -- 172.21.15.73:0/2729879801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b8413ee50 con 0x7f4b84146110 2024-04-15T15:33:09.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.401+0000 7f4b80c00640 1 -- 172.21.15.73:0/2729879801 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f4b7001a070 con 0x7f4b84146110 2024-04-15T15:33:09.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.401+0000 7f4b80c00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b64068410 0x7f4b6406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.401+0000 7f4b80c00640 1 -- 172.21.15.73:0/2729879801 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4b70086fb0 con 0x7f4b84146110 2024-04-15T15:33:09.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.401+0000 7f4b89200640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b64068410 0x7f4b6406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.401+0000 7f4b89200640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b64068410 0x7f4b6406a8d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4b74000f70 tx=0x7f4b74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:09.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.405+0000 7f4b80c00640 1 -- 172.21.15.73:0/2729879801 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b70057440 con 0x7f4b84146110 2024-04-15T15:33:09.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.597+0000 7f4b8bc00640 1 -- 172.21.15.73:0/2729879801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4b84068ab0 con 0x7f4b84146110 2024-04-15T15:33:09.599 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-04-15T15:33:09.597+0000 7f0e1ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T15:33:09.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.601+0000 7f4b80c00640 1 -- 172.21.15.73:0/2729879801 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f4b70056d40 con 0x7f4b84146110 2024-04-15T15:33:09.601 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-15T15:33:09.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 -- 172.21.15.73:0/2729879801 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b64068410 msgr2=0x7f4b6406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:09.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b64068410 0x7f4b6406a8d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4b74000f70 tx=0x7f4b74009040 comp rx=0 tx=0).stop 2024-04-15T15:33:09.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 -- 172.21.15.73:0/2729879801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b84146110 msgr2=0x7f4b8413dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:09.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b84146110 0x7f4b8413dee0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000e930 tx=0x7f4b7000edf0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 -- 172.21.15.73:0/2729879801 shutdown_connections 2024-04-15T15:33:09.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b8415cbd0 0x7f4b841400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b84146110 0x7f4b8413dee0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4b64068410 0x7f4b6406a8d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 --2- 172.21.15.73:0/2729879801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b840b20b0 0x7f4b840b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 -- 172.21.15.73:0/2729879801 >> 172.21.15.73:0/2729879801 conn(0x7f4b84067dd0 msgr2=0x7f4b8415c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:09.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 -- 172.21.15.73:0/2729879801 shutdown_connections 2024-04-15T15:33:09.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.605+0000 7f4b8bc00640 1 -- 172.21.15.73:0/2729879801 wait complete. 2024-04-15T15:33:09.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-15T15:33:09.667 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2024-04-15T15:33:09.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.761+0000 7f785e200640 1 Processor -- start 2024-04-15T15:33:09.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.761+0000 7f785e200640 1 -- start start 2024-04-15T15:33:09.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f785e200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f78580b2310 0x7f7858162390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f785e200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b26f0 0x7f78580ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f785e200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78580adab0 con 0x7f78580af440 2024-04-15T15:33:09.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f785e200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f78580b3770 con 0x7f78580b2310 2024-04-15T15:33:09.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f785e200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7858162a90 con 0x7f78580b26f0 2024-04-15T15:33:09.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f784ea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f78580af440 0x7f785815e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40604/0 (socket says 172.21.15.73:40604) 2024-04-15T15:33:09.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f784ea00640 1 -- 172.21.15.73:0/1928553526 learned_addr learned my addr 172.21.15.73:0/1928553526 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:09.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f7857400640 1 --2- 172.21.15.73:0/1928553526 >> v2:172.21.15.118:3300/0 conn(0x7f78580b2310 0x7f7858162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f7857e00640 1 --2- 172.21.15.73:0/1928553526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b26f0 0x7f78580ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f7856a00640 1 -- 172.21.15.73:0/1928553526 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857641899 0 0) 0x7f78580adab0 con 0x7f78580af440 2024-04-15T15:33:09.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f7856a00640 1 -- 172.21.15.73:0/1928553526 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f783c003530 con 0x7f78580af440 2024-04-15T15:33:09.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f7857e00640 1 -- 172.21.15.73:0/1928553526 >> v2:172.21.15.118:3300/0 conn(0x7f78580b2310 msgr2=0x7f7858162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:09.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f7857e00640 1 --2- 172.21.15.73:0/1928553526 >> v2:172.21.15.118:3300/0 conn(0x7f78580b2310 0x7f7858162390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f7857e00640 1 -- 172.21.15.73:0/1928553526 >> v1:172.21.15.73:6789/0 conn(0x7f78580af440 legacy=0x7f785815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:09.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.765+0000 7f7857e00640 1 -- 172.21.15.73:0/1928553526 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7858162d70 con 0x7f78580b26f0 2024-04-15T15:33:09.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f7857e00640 1 --2- 172.21.15.73:0/1928553526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b26f0 0x7f78580ae270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7850009d90 tx=0x7f785001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=799923e283a30bf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:09.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f7856a00640 1 -- 172.21.15.73:0/1928553526 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78500b2070 con 0x7f78580b26f0 2024-04-15T15:33:09.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f7856a00640 1 -- 172.21.15.73:0/1928553526 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78500a5940 con 0x7f78580b26f0 2024-04-15T15:33:09.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f7856a00640 1 -- 172.21.15.73:0/1928553526 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78500a5d10 con 0x7f78580b26f0 2024-04-15T15:33:09.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f785e200640 1 -- 172.21.15.73:0/1928553526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b26f0 msgr2=0x7f78580ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:09.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f785e200640 1 --2- 172.21.15.73:0/1928553526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b26f0 0x7f78580ae270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7850009d90 tx=0x7f785001c970 comp rx=0 tx=0).stop 2024-04-15T15:33:09.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f785e200640 1 -- 172.21.15.73:0/1928553526 shutdown_connections 2024-04-15T15:33:09.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f785e200640 1 --2- 172.21.15.73:0/1928553526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b26f0 0x7f78580ae270 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f785e200640 1 --2- 172.21.15.73:0/1928553526 >> v2:172.21.15.118:3300/0 conn(0x7f78580b2310 0x7f7858162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f785e200640 1 -- 172.21.15.73:0/1928553526 >> 172.21.15.73:0/1928553526 conn(0x7f7858067dd0 msgr2=0x7f78580d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:09.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f785e200640 1 -- 172.21.15.73:0/1928553526 shutdown_connections 2024-04-15T15:33:09.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f785e200640 1 -- 172.21.15.73:0/1928553526 wait complete. 2024-04-15T15:33:09.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f785e200640 1 Processor -- start 2024-04-15T15:33:09.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.769+0000 7f785e200640 1 -- start start 2024-04-15T15:33:09.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f785e200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78580af440 0x7f785815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f785e200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b2310 0x7f78581589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f785e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580b26f0 0x7f7858152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f785e200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f785816b6a0 con 0x7f78580af440 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f785e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f785816b520 con 0x7f78580b26f0 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f785e200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f785816b820 con 0x7f78580b2310 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f7857400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78580af440 0x7f785815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f7857400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78580af440 0x7f785815cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49982/0 (socket says 172.21.15.73:49982) 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f7857400640 1 -- 172.21.15.73:0/1777137574 learned_addr learned my addr 172.21.15.73:0/1777137574 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f784ea00640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b2310 0x7f78581589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f7857e00640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580b26f0 0x7f7858152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f7857400640 1 -- 172.21.15.73:0/1777137574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b2310 msgr2=0x7f78581589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f7857400640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b2310 0x7f78581589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f7857400640 1 -- 172.21.15.73:0/1777137574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580b26f0 msgr2=0x7f7858152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f7857400640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580b26f0 0x7f7858152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f7857400640 1 -- 172.21.15.73:0/1777137574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78581609b0 con 0x7f78580af440 2024-04-15T15:33:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f7857400640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78580af440 0x7f785815cd20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f784000e930 tx=0x7f784000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f784fe00640 1 -- 172.21.15.73:0/1777137574 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840017070 con 0x7f78580af440 2024-04-15T15:33:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f784fe00640 1 -- 172.21.15.73:0/1777137574 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784000ca00 con 0x7f78580af440 2024-04-15T15:33:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f784fe00640 1 -- 172.21.15.73:0/1777137574 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784000cdb0 con 0x7f78580af440 2024-04-15T15:33:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f785e200640 1 -- 172.21.15.73:0/1777137574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7858160c90 con 0x7f78580af440 2024-04-15T15:33:09.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f785e200640 1 -- 172.21.15.73:0/1777137574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7858161250 con 0x7f78580af440 2024-04-15T15:33:09.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f785e200640 1 -- 172.21.15.73:0/1777137574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7858068ab0 con 0x7f78580af440 2024-04-15T15:33:09.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.773+0000 7f784fe00640 1 -- 172.21.15.73:0/1777137574 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f784001a070 con 0x7f78580af440 2024-04-15T15:33:09.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.777+0000 7f784fe00640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7834068410 0x7f783406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:09.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.777+0000 7f784fe00640 1 -- 172.21.15.73:0/1777137574 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6187+0+0 (secure 0 0 0) 0x7f7840086ee0 con 0x7f78580af440 2024-04-15T15:33:09.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.777+0000 7f784ea00640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7834068410 0x7f783406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:09.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.777+0000 7f784ea00640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7834068410 0x7f783406a8d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7858075d40 tx=0x7f7848000bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:09.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.781+0000 7f784fe00640 1 -- 172.21.15.73:0/1777137574 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7840056d40 con 0x7f78580af440 2024-04-15T15:33:09.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:09.969+0000 7f785e200640 1 -- 172.21.15.73:0/1777137574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f7858161650 con 0x7f78580af440 2024-04-15T15:33:10.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.601+0000 7f784fe00640 1 -- 172.21.15.73:0/1777137574 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v20) ==== 162+0+0 (secure 0 0 0) 0x7f784005b040 con 0x7f78580af440 2024-04-15T15:33:10.603 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-15T15:33:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 -- 172.21.15.73:0/1777137574 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7834068410 msgr2=0x7f783406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7834068410 0x7f783406a8d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7858075d40 tx=0x7f7848000bd0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 -- 172.21.15.73:0/1777137574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78580af440 msgr2=0x7f785815cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78580af440 0x7f785815cd20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f784000e930 tx=0x7f784000edf0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 -- 172.21.15.73:0/1777137574 shutdown_connections 2024-04-15T15:33:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78580b26f0 0x7f7858152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7834068410 0x7f783406a8d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78580b2310 0x7f78581589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 --2- 172.21.15.73:0/1777137574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78580af440 0x7f785815cd20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 -- 172.21.15.73:0/1777137574 >> 172.21.15.73:0/1777137574 conn(0x7f7858067dd0 msgr2=0x7f78581537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 -- 172.21.15.73:0/1777137574 shutdown_connections 2024-04-15T15:33:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.605+0000 7f785e200640 1 -- 172.21.15.73:0/1777137574 wait complete. 2024-04-15T15:33:10.635 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:33:10.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37b4e00640 1 Processor -- start 2024-04-15T15:33:10.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37b4e00640 1 -- start start 2024-04-15T15:33:10.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37b4e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b00d0710 0x7f37b00b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:10.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37b4e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f37b00b23e0 0x7f37b00b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:10.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37b4e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b00cd1c0 con 0x7f37b00ccde0 2024-04-15T15:33:10.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37b4e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f37b00b2d70 con 0x7f37b00b23e0 2024-04-15T15:33:10.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37b4e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f37b00b1410 con 0x7f37b00d0710 2024-04-15T15:33:10.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ade00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f37b00ccde0 0x7f37b0162f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40612/0 (socket says 172.21.15.73:40612) 2024-04-15T15:33:10.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ade00640 1 -- 172.21.15.73:0/3206678324 learned_addr learned my addr 172.21.15.73:0/3206678324 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:10.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ae800640 1 --2- 172.21.15.73:0/3206678324 >> v2:172.21.15.118:3300/0 conn(0x7f37b00b23e0 0x7f37b00b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:10.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37a7e00640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b00d0710 0x7f37b00b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:10.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3983095038 0 0) 0x7f37b00cd1c0 con 0x7f37b00ccde0 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3794003530 con 0x7f37b00ccde0 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 463025085 0 0) 0x7f3794003530 con 0x7f37b00ccde0 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b00d0710 msgr2=0x7f37b00b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b00d0710 0x7f37b00b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 >> v2:172.21.15.118:3300/0 conn(0x7f37b00b23e0 msgr2=0x7f37b00b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 --2- 172.21.15.73:0/3206678324 >> v2:172.21.15.118:3300/0 conn(0x7f37b00b23e0 0x7f37b00b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b00d0ea0 con 0x7f37b00ccde0 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f37a0001680 con 0x7f37b00ccde0 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37a7e00640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b00d0710 0x7f37b00b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ae800640 1 --2- 172.21.15.73:0/3206678324 >> v2:172.21.15.118:3300/0 conn(0x7f37b00b23e0 0x7f37b00b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 >> v1:172.21.15.73:6789/0 conn(0x7f37b00ccde0 legacy=0x7f37b0162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37940039c0 0x7f3794003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 0x7f3794004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b00d0710 0x7f37940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f37b00b2d70 con 0x7f3794004810 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f37b00b1410 con 0x7f37940039c0 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f379400b9d0 con 0x7f37b00d0710 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37a7e00640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 0x7f3794004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.773+0000 7f37ade00640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37940039c0 0x7f3794003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37ae800640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b00d0710 0x7f37940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37a7e00640 1 -- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b00d0710 msgr2=0x7f37940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37a7e00640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b00d0710 0x7f37940051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37a7e00640 1 -- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37940039c0 msgr2=0x7f3794003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37a7e00640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37940039c0 0x7f3794003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37a7e00640 1 -- 172.21.15.73:0/3206678324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3794003530 con 0x7f3794004810 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37a7e00640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 0x7f3794004c90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3798009cb0 tx=0x7f379801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67498bcf7dcf4aac server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37980b1070 con 0x7f3794004810 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37980a4d10 con 0x7f3794004810 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37ad400640 1 -- 172.21.15.73:0/3206678324 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798009880 con 0x7f3794004810 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37b4e00640 1 -- 172.21.15.73:0/3206678324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 msgr2=0x7f3794004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37b4e00640 1 --2- 172.21.15.73:0/3206678324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 0x7f3794004c90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3798009cb0 tx=0x7f379801c8f0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.777+0000 7f37ae800640 1 -- 172.21.15.73:0/3206678324 reap_dead start 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 -- 172.21.15.73:0/3206678324 shutdown_connections 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 -- 172.21.15.73:0/3206678324 >> 172.21.15.73:0/3206678324 conn(0x7f37b009aa60 msgr2=0x7f37b00d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 -- 172.21.15.73:0/3206678324 shutdown_connections 2024-04-15T15:33:10.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 -- 172.21.15.73:0/3206678324 wait complete. 2024-04-15T15:33:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 Processor -- start 2024-04-15T15:33:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 -- start start 2024-04-15T15:33:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 0x7f37b00cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37b00c8670 0x7f37b0155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b015fbc0 0x7f37b0160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f37b00d0b50 con 0x7f3794004810 2024-04-15T15:33:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f37b00b10a0 con 0x7f37b00c8670 2024-04-15T15:33:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37b4e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f37b00b18a0 con 0x7f37b015fbc0 2024-04-15T15:33:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37ade00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 0x7f37b00cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37ade00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 0x7f37b00cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50004/0 (socket says 172.21.15.73:50004) 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37ade00640 1 -- 172.21.15.73:0/3336669999 learned_addr learned my addr 172.21.15.73:0/3336669999 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37a7e00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37b00c8670 0x7f37b0155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37ae800640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b015fbc0 0x7f37b0160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37ade00640 1 -- 172.21.15.73:0/3336669999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b015fbc0 msgr2=0x7f37b0160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37ade00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b015fbc0 0x7f37b0160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37ade00640 1 -- 172.21.15.73:0/3336669999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37b00c8670 msgr2=0x7f37b0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37ade00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37b00c8670 0x7f37b0155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37ade00640 1 -- 172.21.15.73:0/3336669999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b00c8af0 con 0x7f3794004810 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.781+0000 7f37ade00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 0x7f37b00cab90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f37a0012340 tx=0x7f37a0012800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37a6000640 1 -- 172.21.15.73:0/3336669999 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a001c070 con 0x7f3794004810 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37a6000640 1 -- 172.21.15.73:0/3336669999 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a0014810 con 0x7f3794004810 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37b4e00640 1 -- 172.21.15.73:0/3336669999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b00cb220 con 0x7f3794004810 2024-04-15T15:33:10.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37a6000640 1 -- 172.21.15.73:0/3336669999 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0014c40 con 0x7f3794004810 2024-04-15T15:33:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37b4e00640 1 -- 172.21.15.73:0/3336669999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b00cb7e0 con 0x7f3794004810 2024-04-15T15:33:10.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37b4e00640 1 -- 172.21.15.73:0/3336669999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b0068ab0 con 0x7f3794004810 2024-04-15T15:33:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37a6000640 1 -- 172.21.15.73:0/3336669999 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f37a001f070 con 0x7f3794004810 2024-04-15T15:33:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37a6000640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f378c068410 0x7f378c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37a6000640 1 -- 172.21.15.73:0/3336669999 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6187+0+0 (secure 0 0 0) 0x7f37a0089670 con 0x7f3794004810 2024-04-15T15:33:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37a7e00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f378c068410 0x7f378c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:10.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.785+0000 7f37a7e00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f378c068410 0x7f378c06a8d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f37980ae000 tx=0x7f37980046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.789+0000 7f37a6000640 1 -- 172.21.15.73:0/3336669999 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f37a0059310 con 0x7f3794004810 2024-04-15T15:33:10.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.981+0000 7f37b4e00640 1 -- 172.21.15.73:0/3336669999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37b00b74b0 con 0x7f3794004810 2024-04-15T15:33:10.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.981+0000 7f37a6000640 1 -- 172.21.15.73:0/3336669999 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5178 (secure 0 0 0) 0x7f37a005d610 con 0x7f3794004810 2024-04-15T15:33:10.983 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:10.983 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/326969724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":326969724},{"type":"v1","addr":"172.21.15.118:6834","nonce":326969724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:32:49.112134+0000","modified":"2024-04-15T15:33:10.608270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.73:6836/1374015509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1374015509},{"type":"v1","addr":"172.21.15.73:6836","nonce":1374015509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-15T15:33:10.983 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 21 2024-04-15T15:33:10.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 -- 172.21.15.73:0/3336669999 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f378c068410 msgr2=0x7f378c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:10.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f378c068410 0x7f378c06a8d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f37980ae000 tx=0x7f37980046d0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 -- 172.21.15.73:0/3336669999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 msgr2=0x7f37b00cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:10.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 0x7f37b00cab90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f37a0012340 tx=0x7f37a0012800 comp rx=0 tx=0).stop 2024-04-15T15:33:10.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 -- 172.21.15.73:0/3336669999 shutdown_connections 2024-04-15T15:33:10.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f378c068410 0x7f378c06a8d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37b015fbc0 0x7f37b0160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37b00c8670 0x7f37b0155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 --2- 172.21.15.73:0/3336669999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3794004810 0x7f37b00cab90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:10.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 -- 172.21.15.73:0/3336669999 >> 172.21.15.73:0/3336669999 conn(0x7f37b009aa60 msgr2=0x7f37b015f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:10.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 -- 172.21.15.73:0/3336669999 shutdown_connections 2024-04-15T15:33:10.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:10.985+0000 7f37b4e00640 1 -- 172.21.15.73:0/3336669999 wait complete. 2024-04-15T15:33:11.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T15:32:49.112134+0000', 'modified': '2024-04-15T15:33:10.608270+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5322': {'gid': 5322, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.73:6836/1374015509', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 1374015509}, {'type': 'v1', 'addr': '172.21.15.73:6836', 'nonce': 1374015509}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-15T15:33:11.408 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5322:up:replay 2024-04-15T15:33:12.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:33:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.552+0000 7f9bb7000640 1 Processor -- start 2024-04-15T15:33:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.552+0000 7f9bb7000640 1 -- start start 2024-04-15T15:33:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.552+0000 7f9bb7000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9bb006fc90 0x7f9bb015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.552+0000 7f9bb7000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9bb015e910 0x7f9bb015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.552+0000 7f9bb7000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb0071e10 0x7f9bb0072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.552+0000 7f9bb7000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9bb00727a0 con 0x7f9bb006fc90 2024-04-15T15:33:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.552+0000 7f9bb7000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f9bb015b9e0 con 0x7f9bb015e910 2024-04-15T15:33:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.552+0000 7f9bb7000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb006f5a0 con 0x7f9bb0071e10 2024-04-15T15:33:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.552+0000 7f9bafe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9bb006fc90 0x7f9bb015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9bafe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9bb006fc90 0x7f9bb015be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50006/0 (socket says 172.21.15.73:50006) 2024-04-15T15:33:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9bafe00640 1 -- 172.21.15.73:0/96539137 learned_addr learned my addr 172.21.15.73:0/96539137 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:12.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9baf400640 1 --2- 172.21.15.73:0/96539137 >> v2:172.21.15.118:3300/0 conn(0x7f9bb015e910 0x7f9bb015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:12.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9bb5000640 1 --2- 172.21.15.73:0/96539137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb0071e10 0x7f9bb0072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:12.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9bafe00640 1 -- 172.21.15.73:0/96539137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb0071e10 msgr2=0x7f9bb0072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:12.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9bafe00640 1 --2- 172.21.15.73:0/96539137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb0071e10 0x7f9bb0072260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9bafe00640 1 -- 172.21.15.73:0/96539137 >> v2:172.21.15.118:3300/0 conn(0x7f9bb015e910 msgr2=0x7f9bb015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:12.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9bafe00640 1 --2- 172.21.15.73:0/96539137 >> v2:172.21.15.118:3300/0 conn(0x7f9bb015e910 0x7f9bb015edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9bafe00640 1 -- 172.21.15.73:0/96539137 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb015f480 con 0x7f9bb006fc90 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9bafe00640 1 --2- 172.21.15.73:0/96539137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb006fc90 0x7f9bb015be70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0158ef0 tx=0x7f9ba001ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ba18c50c7bc729 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9baea00640 1 -- 172.21.15.73:0/96539137 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00ad070 con 0x7f9bb006fc90 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9baea00640 1 -- 172.21.15.73:0/96539137 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ba00a7bd0 con 0x7f9bb006fc90 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.556+0000 7f9baea00640 1 -- 172.21.15.73:0/96539137 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00b1400 con 0x7f9bb006fc90 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 -- 172.21.15.73:0/96539137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb006fc90 msgr2=0x7f9bb015be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 --2- 172.21.15.73:0/96539137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb006fc90 0x7f9bb015be70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0158ef0 tx=0x7f9ba001ebc0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 -- 172.21.15.73:0/96539137 shutdown_connections 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 --2- 172.21.15.73:0/96539137 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb0071e10 0x7f9bb0072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 --2- 172.21.15.73:0/96539137 >> v2:172.21.15.118:3300/0 conn(0x7f9bb015e910 0x7f9bb015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 --2- 172.21.15.73:0/96539137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb006fc90 0x7f9bb015be70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 -- 172.21.15.73:0/96539137 >> 172.21.15.73:0/96539137 conn(0x7f9bb0067dd0 msgr2=0x7f9bb00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:12.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 -- 172.21.15.73:0/96539137 shutdown_connections 2024-04-15T15:33:12.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 -- 172.21.15.73:0/96539137 wait complete. 2024-04-15T15:33:12.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 Processor -- start 2024-04-15T15:33:12.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 -- start start 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb006fc90 0x7f9bb014eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb0071e10 0x7f9bb0146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb015e910 0x7f9bb0154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb00b3e10 con 0x7f9bb015e910 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb0070070 con 0x7f9bb0071e10 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb7000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb00b3f90 con 0x7f9bb006fc90 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb5000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb015e910 0x7f9bb0154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb5000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb015e910 0x7f9bb0154e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50020/0 (socket says 172.21.15.73:50020) 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb5000640 1 -- 172.21.15.73:0/4116441741 learned_addr learned my addr 172.21.15.73:0/4116441741 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb5000640 1 -- 172.21.15.73:0/4116441741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb006fc90 msgr2=0x7f9bb014eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:12.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb5000640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb006fc90 0x7f9bb014eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb5000640 1 -- 172.21.15.73:0/4116441741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb0071e10 msgr2=0x7f9bb0146260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9baf400640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb0071e10 0x7f9bb0146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb5000640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb0071e10 0x7f9bb0146260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb5000640 1 -- 172.21.15.73:0/4116441741 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb01467a0 con 0x7f9bb015e910 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9baf400640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb0071e10 0x7f9bb0146260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.560+0000 7f9bb5000640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb015e910 0x7f9bb0154e60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800d800 tx=0x7f9ba800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9ba7e00640 1 -- 172.21.15.73:0/4116441741 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8018020 con 0x7f9bb015e910 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9ba7e00640 1 -- 172.21.15.73:0/4116441741 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ba80096c0 con 0x7f9bb015e910 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9bb7000640 1 -- 172.21.15.73:0/4116441741 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb0150320 con 0x7f9bb015e910 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9ba7e00640 1 -- 172.21.15.73:0/4116441741 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8009ab0 con 0x7f9bb015e910 2024-04-15T15:33:12.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9bb7000640 1 -- 172.21.15.73:0/4116441741 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb01508e0 con 0x7f9bb015e910 2024-04-15T15:33:12.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9bb7000640 1 -- 172.21.15.73:0/4116441741 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb0068ab0 con 0x7f9bb015e910 2024-04-15T15:33:12.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9ba7e00640 1 -- 172.21.15.73:0/4116441741 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f9ba801b020 con 0x7f9bb015e910 2024-04-15T15:33:12.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9ba7e00640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b90068410 0x7f9b9006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:12.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9ba7e00640 1 -- 172.21.15.73:0/4116441741 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6187+0+0 (secure 0 0 0) 0x7f9ba8087190 con 0x7f9bb015e910 2024-04-15T15:33:12.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9bafe00640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b90068410 0x7f9b9006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:12.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.564+0000 7f9bafe00640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b90068410 0x7f9b9006a8d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00b2000 tx=0x7f9ba0004ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:12.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.568+0000 7f9ba7e00640 1 -- 172.21.15.73:0/4116441741 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9ba8022020 con 0x7f9bb015e910 2024-04-15T15:33:12.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.768+0000 7f9bb7000640 1 -- 172.21.15.73:0/4116441741 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bb006cdf0 con 0x7f9bb015e910 2024-04-15T15:33:12.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.768+0000 7f9ba7e00640 1 -- 172.21.15.73:0/4116441741 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5179 (secure 0 0 0) 0x7f9ba8056e30 con 0x7f9bb015e910 2024-04-15T15:33:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:12.770 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/326969724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":326969724},{"type":"v1","addr":"172.21.15.118:6834","nonce":326969724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:32:49.112134+0000","modified":"2024-04-15T15:33:11.618147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.73:6836/1374015509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1374015509},{"type":"v1","addr":"172.21.15.73:6836","nonce":1374015509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-15T15:33:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 23 2024-04-15T15:33:12.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.768+0000 7f9bb7000640 1 -- 172.21.15.73:0/4116441741 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b90068410 msgr2=0x7f9b9006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:12.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.768+0000 7f9bb7000640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b90068410 0x7f9b9006a8d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00b2000 tx=0x7f9ba0004ac0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.772+0000 7f9bb7000640 1 -- 172.21.15.73:0/4116441741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb015e910 msgr2=0x7f9bb0154e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:12.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.772+0000 7f9bb7000640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb015e910 0x7f9bb0154e60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800d800 tx=0x7f9ba800dcc0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.772+0000 7f9bb7000640 1 -- 172.21.15.73:0/4116441741 shutdown_connections 2024-04-15T15:33:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.772+0000 7f9bb7000640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bb015e910 0x7f9bb0154e60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.772+0000 7f9bb7000640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bb0071e10 0x7f9bb0146260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.772+0000 7f9bb7000640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b90068410 0x7f9b9006a8d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.772+0000 7f9bb7000640 1 --2- 172.21.15.73:0/4116441741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bb006fc90 0x7f9bb014eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.772+0000 7f9bb7000640 1 -- 172.21.15.73:0/4116441741 >> 172.21.15.73:0/4116441741 conn(0x7f9bb0067dd0 msgr2=0x7f9bb00d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.772+0000 7f9bb7000640 1 -- 172.21.15.73:0/4116441741 shutdown_connections 2024-04-15T15:33:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:12.772+0000 7f9bb7000640 1 -- 172.21.15.73:0/4116441741 wait complete. 2024-04-15T15:33:13.194 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T15:32:49.112134+0000', 'modified': '2024-04-15T15:33:11.618147+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5322': {'gid': 5322, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:rejoin', 'state_seq': 10, 'addr': '172.21.15.73:6836/1374015509', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 1374015509}, {'type': 'v1', 'addr': '172.21.15.73:6836', 'nonce': 1374015509}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-15T15:33:13.194 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5322:up:rejoin 2024-04-15T15:33:14.195 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:33:14.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.336+0000 7f5157c00640 1 Processor -- start 2024-04-15T15:33:14.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.336+0000 7f5157c00640 1 -- start start 2024-04-15T15:33:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5157c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5150146110 0x7f51500cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5157c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51500b20b0 0x7f51500b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5157c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51500cd3a0 con 0x7f5150071e10 2024-04-15T15:33:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5157c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f51500b5160 con 0x7f5150146110 2024-04-15T15:33:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5157c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f51500b40c0 con 0x7f51500b20b0 2024-04-15T15:33:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5155200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5150146110 0x7f51500cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5155200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5150146110 0x7f51500cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50024/0 (socket says 172.21.15.73:50024) 2024-04-15T15:33:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5155200640 1 -- 172.21.15.73:0/913089787 learned_addr learned my addr 172.21.15.73:0/913089787 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5155c00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5150071e10 0x7f51500722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40614/0 (socket says 172.21.15.73:40614) 2024-04-15T15:33:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5147e00640 1 --2- 172.21.15.73:0/913089787 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51500b20b0 0x7f51500b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5155200640 1 -- 172.21.15.73:0/913089787 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51500b20b0 msgr2=0x7f51500b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5155200640 1 --2- 172.21.15.73:0/913089787 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51500b20b0 0x7f51500b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5155200640 1 -- 172.21.15.73:0/913089787 >> v1:172.21.15.73:6789/0 conn(0x7f5150071e10 legacy=0x7f51500722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5155200640 1 -- 172.21.15.73:0/913089787 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51500b43a0 con 0x7f5150146110 2024-04-15T15:33:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f514fe00640 1 -- 172.21.15.73:0/913089787 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991599795 0 0) 0x7f51500cd3a0 con 0x7f5150071e10 2024-04-15T15:33:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.340+0000 7f5147e00640 1 --2- 172.21.15.73:0/913089787 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51500b20b0 0x7f51500b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5155200640 1 --2- 172.21.15.73:0/913089787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150146110 0x7f51500cd7b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5140009870 tx=0x7f514001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e303de3c99ee6b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f514fe00640 1 -- 172.21.15.73:0/913089787 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400ab650 con 0x7f5150146110 2024-04-15T15:33:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f514fe00640 1 -- 172.21.15.73:0/913089787 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51400b0070 con 0x7f5150146110 2024-04-15T15:33:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f514fe00640 1 -- 172.21.15.73:0/913089787 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400aba10 con 0x7f5150146110 2024-04-15T15:33:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5157c00640 1 -- 172.21.15.73:0/913089787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150146110 msgr2=0x7f51500cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5157c00640 1 --2- 172.21.15.73:0/913089787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150146110 0x7f51500cd7b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5140009870 tx=0x7f514001c560 comp rx=0 tx=0).stop 2024-04-15T15:33:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5157c00640 1 -- 172.21.15.73:0/913089787 shutdown_connections 2024-04-15T15:33:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5157c00640 1 --2- 172.21.15.73:0/913089787 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51500b20b0 0x7f51500b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5157c00640 1 --2- 172.21.15.73:0/913089787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150146110 0x7f51500cd7b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5157c00640 1 -- 172.21.15.73:0/913089787 >> 172.21.15.73:0/913089787 conn(0x7f5150067dd0 msgr2=0x7f51500d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5157c00640 1 -- 172.21.15.73:0/913089787 shutdown_connections 2024-04-15T15:33:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5157c00640 1 -- 172.21.15.73:0/913089787 wait complete. 2024-04-15T15:33:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5157c00640 1 Processor -- start 2024-04-15T15:33:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.344+0000 7f5157c00640 1 -- start start 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5157c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150071e10 0x7f515015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5157c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51500b20b0 0x7f515013b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5157c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5150146110 0x7f515015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5157c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f51500cdcf0 con 0x7f5150071e10 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5157c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f51500b3d70 con 0x7f51500b20b0 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5157c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f515015dbe0 con 0x7f5150146110 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5155200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150071e10 0x7f515015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5155200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150071e10 0x7f515015cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50036/0 (socket says 172.21.15.73:50036) 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5155200640 1 -- 172.21.15.73:0/307253461 learned_addr learned my addr 172.21.15.73:0/307253461 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5147e00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51500b20b0 0x7f515013b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5155c00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5150146110 0x7f515015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5155200640 1 -- 172.21.15.73:0/307253461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5150146110 msgr2=0x7f515015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5155200640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5150146110 0x7f515015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:14.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5155200640 1 -- 172.21.15.73:0/307253461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51500b20b0 msgr2=0x7f515013b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:14.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5155200640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51500b20b0 0x7f515013b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:14.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5155200640 1 -- 172.21.15.73:0/307253461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515013dc20 con 0x7f5150071e10 2024-04-15T15:33:14.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5147e00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51500b20b0 0x7f515013b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:14.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5155200640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150071e10 0x7f515015cf50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f514001a190 tx=0x7f514001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:14.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f514d600640 1 -- 172.21.15.73:0/307253461 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400be5f0 con 0x7f5150071e10 2024-04-15T15:33:14.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f514d600640 1 -- 172.21.15.73:0/307253461 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51400be7b0 con 0x7f5150071e10 2024-04-15T15:33:14.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f514d600640 1 -- 172.21.15.73:0/307253461 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400beba0 con 0x7f5150071e10 2024-04-15T15:33:14.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5157c00640 1 -- 172.21.15.73:0/307253461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515015d530 con 0x7f5150071e10 2024-04-15T15:33:14.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5157c00640 1 -- 172.21.15.73:0/307253461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f515013e1c0 con 0x7f5150071e10 2024-04-15T15:33:14.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f5157c00640 1 -- 172.21.15.73:0/307253461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5150068ab0 con 0x7f5150071e10 2024-04-15T15:33:14.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.348+0000 7f514d600640 1 -- 172.21.15.73:0/307253461 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f51400b43f0 con 0x7f5150071e10 2024-04-15T15:33:14.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.352+0000 7f514d600640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f512c068410 0x7f512c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:14.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.352+0000 7f514d600640 1 -- 172.21.15.73:0/307253461 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6216+0+0 (secure 0 0 0) 0x7f51401217b0 con 0x7f5150071e10 2024-04-15T15:33:14.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.352+0000 7f5147e00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f512c068410 0x7f512c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:14.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.352+0000 7f5147e00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f512c068410 0x7f512c06a8d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f51500a9690 tx=0x7f5138008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:14.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.356+0000 7f514d600640 1 -- 172.21.15.73:0/307253461 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5140016150 con 0x7f5150071e10 2024-04-15T15:33:14.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 -- 172.21.15.73:0/307253461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51500cc610 con 0x7f5150071e10 2024-04-15T15:33:14.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f514d600640 1 -- 172.21.15.73:0/307253461 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5186 (secure 0 0 0) 0x7f51400f1430 con 0x7f5150071e10 2024-04-15T15:33:14.549 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:14.549 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/326969724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":326969724},{"type":"v1","addr":"172.21.15.118:6834","nonce":326969724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:32:49.112134+0000","modified":"2024-04-15T15:33:13.617001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.73:6836/1374015509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1374015509},{"type":"v1","addr":"172.21.15.73:6836","nonce":1374015509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":2}]} 2024-04-15T15:33:14.549 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-04-15T15:33:14.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 -- 172.21.15.73:0/307253461 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f512c068410 msgr2=0x7f512c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:14.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f512c068410 0x7f512c06a8d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f51500a9690 tx=0x7f5138008040 comp rx=0 tx=0).stop 2024-04-15T15:33:14.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 -- 172.21.15.73:0/307253461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150071e10 msgr2=0x7f515015cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:14.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150071e10 0x7f515015cf50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f514001a190 tx=0x7f514001ada0 comp rx=0 tx=0).stop 2024-04-15T15:33:14.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 -- 172.21.15.73:0/307253461 shutdown_connections 2024-04-15T15:33:14.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f512c068410 0x7f512c06a8d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:14.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5150146110 0x7f515015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:14.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51500b20b0 0x7f515013b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:14.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 --2- 172.21.15.73:0/307253461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5150071e10 0x7f515015cf50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:14.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 -- 172.21.15.73:0/307253461 >> 172.21.15.73:0/307253461 conn(0x7f5150067dd0 msgr2=0x7f51500b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:14.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 -- 172.21.15.73:0/307253461 shutdown_connections 2024-04-15T15:33:14.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:14.548+0000 7f5157c00640 1 -- 172.21.15.73:0/307253461 wait complete. 2024-04-15T15:33:14.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T15:32:49.112134+0000', 'modified': '2024-04-15T15:33:13.617001+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5322': {'gid': 5322, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.73:6836/1374015509', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 1374015509}, {'type': 'v1', 'addr': '172.21.15.73:6836', 'nonce': 1374015509}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5322, 'qdb_cluster': [5322]} 2024-04-15T15:33:14.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-15T15:33:14.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-15T15:33:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f82600640 1 Processor -- start 2024-04-15T15:33:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f82600640 1 -- start start 2024-04-15T15:33:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f82600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c0b2530 0x7f9f7c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f82600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f7c0cd3a0 con 0x7f9f7c0b20b0 2024-04-15T15:33:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f82600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f7c0b29c0 con 0x7f9f7c146110 2024-04-15T15:33:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f82600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7c0b5160 con 0x7f9f7c0b2530 2024-04-15T15:33:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7aa00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9f7c0b20b0 0x7f9f7c15cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40628/0 (socket says 172.21.15.73:40628) 2024-04-15T15:33:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7aa00640 1 -- 172.21.15.73:0/1422137314 learned_addr learned my addr 172.21.15.73:0/1422137314 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7be00640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c0b2530 0x7f9f7c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26385056 0 0) 0x7f9f7c0cd3a0 con 0x7f9f7c0b20b0 2024-04-15T15:33:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f60003530 con 0x7f9f7c0b20b0 2024-04-15T15:33:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1138477612 0 0) 0x7f9f60003530 con 0x7f9f7c0b20b0 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c0b2530 msgr2=0x7f9f7c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c0b2530 0x7f9f7c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 >> v1:172.21.15.118:6789/0 conn(0x7f9f7c146110 legacy=0x7f9f7c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c0b40c0 con 0x7f9f7c0b20b0 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f9f68001680 con 0x7f9f7c0b20b0 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 >> v1:172.21.15.73:6789/0 conn(0x7f9f7c0b20b0 legacy=0x7f9f7c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f600039f0 0x7f9f60003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f60004810 0x7f9f60004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c0b2530 0x7f9f600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c0b5160 con 0x7f9f60004810 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6000ba80 con 0x7f9f600039f0 2024-04-15T15:33:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6000bc80 con 0x7f9f7c0b2530 2024-04-15T15:33:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f60004810 0x7f9f60004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7b400640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f600039f0 0x7f9f60003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7be00640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c0b2530 0x7f9f600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7aa00640 1 -- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c0b2530 msgr2=0x7f9f600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c0b2530 0x7f9f600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7aa00640 1 -- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f600039f0 msgr2=0x7f9f60003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f600039f0 0x7f9f60003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7aa00640 1 -- 172.21.15.73:0/1422137314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f60003530 con 0x7f9f60004810 2024-04-15T15:33:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.112+0000 7f9f7be00640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c0b2530 0x7f9f600051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:15.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f60004810 0x7f9f60004c90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9f68001ec0 tx=0x7f9f6801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a122f0b8f54ab14e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68007d40 con 0x7f9f60004810 2024-04-15T15:33:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f68005b00 con 0x7f9f60004810 2024-04-15T15:33:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f7a000640 1 -- 172.21.15.73:0/1422137314 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68007070 con 0x7f9f60004810 2024-04-15T15:33:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f82600640 1 -- 172.21.15.73:0/1422137314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f60004810 msgr2=0x7f9f60004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f82600640 1 --2- 172.21.15.73:0/1422137314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f60004810 0x7f9f60004c90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9f68001ec0 tx=0x7f9f6801f3b0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f7be00640 1 -- 172.21.15.73:0/1422137314 reap_dead start 2024-04-15T15:33:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f82600640 1 -- 172.21.15.73:0/1422137314 shutdown_connections 2024-04-15T15:33:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f82600640 1 -- 172.21.15.73:0/1422137314 >> 172.21.15.73:0/1422137314 conn(0x7f9f7c067dd0 msgr2=0x7f9f7c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f82600640 1 -- 172.21.15.73:0/1422137314 shutdown_connections 2024-04-15T15:33:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.116+0000 7f9f82600640 1 -- 172.21.15.73:0/1422137314 wait complete. 2024-04-15T15:33:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f82600640 1 Processor -- start 2024-04-15T15:33:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f82600640 1 -- start start 2024-04-15T15:33:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f82600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f60004810 0x7f9f7c1f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f82600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c1f1f30 0x7f9f7c1e41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f82600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c1e46e0 0x7f9f7c1e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f82600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c0b4960 con 0x7f9f7c1f1f30 2024-04-15T15:33:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f82600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c0b4680 con 0x7f9f60004810 2024-04-15T15:33:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f82600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7c0b4c40 con 0x7f9f7c1e46e0 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c1f1f30 0x7f9f7c1e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c1f1f30 0x7f9f7c1e41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50056/0 (socket says 172.21.15.73:50056) 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7aa00640 1 -- 172.21.15.73:0/3805501286 learned_addr learned my addr 172.21.15.73:0/3805501286 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7be00640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c1e46e0 0x7f9f7c1e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7b400640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f60004810 0x7f9f7c1f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7aa00640 1 -- 172.21.15.73:0/3805501286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c1e46e0 msgr2=0x7f9f7c1e22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c1e46e0 0x7f9f7c1e22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7aa00640 1 -- 172.21.15.73:0/3805501286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f60004810 msgr2=0x7f9f7c1f19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f60004810 0x7f9f7c1f19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7aa00640 1 -- 172.21.15.73:0/3805501286 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c1e2ee0 con 0x7f9f7c1f1f30 2024-04-15T15:33:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c1f1f30 0x7f9f7c1e41a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9f6801f1e0 tx=0x7f9f60005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.120+0000 7f9f73400640 1 -- 172.21.15.73:0/3805501286 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68007d20 con 0x7f9f7c1f1f30 2024-04-15T15:33:15.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f73400640 1 -- 172.21.15.73:0/3805501286 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f680b6040 con 0x7f9f7c1f1f30 2024-04-15T15:33:15.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f73400640 1 -- 172.21.15.73:0/3805501286 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f680049f0 con 0x7f9f7c1f1f30 2024-04-15T15:33:15.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f82600640 1 -- 172.21.15.73:0/3805501286 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7c1e31c0 con 0x7f9f7c1f1f30 2024-04-15T15:33:15.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f82600640 1 -- 172.21.15.73:0/3805501286 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f7c1e3780 con 0x7f9f7c1f1f30 2024-04-15T15:33:15.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f73400640 1 -- 172.21.15.73:0/3805501286 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f9f68004b90 con 0x7f9f7c1f1f30 2024-04-15T15:33:15.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f73400640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f5c068440 0x7f9f5c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f73400640 1 -- 172.21.15.73:0/3805501286 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f9f68123c80 con 0x7f9f7c1f1f30 2024-04-15T15:33:15.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f7b400640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f5c068440 0x7f9f5c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f85a3c000 1 Processor -- start 2024-04-15T15:33:15.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f85a3c000 1 -- start start 2024-04-15T15:33:15.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.124+0000 7f9f7b400640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f5c068440 0x7f9f5c06a900 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c007fd0 tx=0x7f9f6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e9088e0 0x55ce9e908cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e909200 0x55ce9e8bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e8bc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ce9e70d290 con 0x55ce9e9088e0 2024-04-15T15:33:15.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55ce9e6a8bd0 con 0x55ce9e909200 2024-04-15T15:33:15.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55ce9e709250 con 0x55ce9e8bc5e0 2024-04-15T15:33:15.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e9088e0 0x55ce9e908cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e9088e0 0x55ce9e908cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50068/0 (socket says 172.21.15.73:50068) 2024-04-15T15:33:15.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7b400640 1 -- 172.21.15.73:0/1665717928 learned_addr learned my addr 172.21.15.73:0/1665717928 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/1665717928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e909200 0x55ce9e8bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7be00640 1 --2- 172.21.15.73:0/1665717928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e8bc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7b400640 1 -- 172.21.15.73:0/1665717928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 msgr2=0x55ce9e8bc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7b400640 1 --2- 172.21.15.73:0/1665717928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e8bc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7b400640 1 -- 172.21.15.73:0/1665717928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e909200 msgr2=0x55ce9e8bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7b400640 1 --2- 172.21.15.73:0/1665717928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e909200 0x55ce9e8bc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7b400640 1 -- 172.21.15.73:0/1665717928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce9e752520 con 0x55ce9e9088e0 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f7b400640 1 --2- 172.21.15.73:0/1665717928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e9088e0 0x55ce9e908cc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c012c30 tx=0x7f9f6c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1053a44b85697a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f67e00640 1 -- 172.21.15.73:0/1665717928 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c028070 con 0x55ce9e9088e0 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f67e00640 1 -- 172.21.15.73:0/1665717928 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6c007670 con 0x55ce9e9088e0 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f67e00640 1 -- 172.21.15.73:0/1665717928 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0069e0 con 0x55ce9e9088e0 2024-04-15T15:33:15.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1665717928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e9088e0 msgr2=0x55ce9e908cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/1665717928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e9088e0 0x55ce9e908cc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c012c30 tx=0x7f9f6c015000 comp rx=0 tx=0).stop 2024-04-15T15:33:15.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1665717928 shutdown_connections 2024-04-15T15:33:15.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/1665717928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e8bc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/1665717928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e909200 0x55ce9e8bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/1665717928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e9088e0 0x55ce9e908cc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1665717928 >> 172.21.15.73:0/1665717928 conn(0x55ce9e7a6510 msgr2=0x55ce9e8eb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:15.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1665717928 shutdown_connections 2024-04-15T15:33:15.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1665717928 wait complete. 2024-04-15T15:33:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 -- start start 2024-04-15T15:33:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.128+0000 7f9f85a3c000 1 Processor -- start 2024-04-15T15:33:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e8bc5e0 0x55ce9e90fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e9088e0 0x55ce9e910180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e8c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ce9e6c9530 con 0x55ce9e909200 2024-04-15T15:33:15.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55ce9e8c7a30 con 0x55ce9e8bc5e0 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55ce9e70c5a0 con 0x55ce9e9088e0 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 10 client.0 _ll_register_callbacks cb 0x55ce9e8a9fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e8c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e8c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50074/0 (socket says 172.21.15.73:50074) 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7be00640 1 -- 172.21.15.73:0/2397515047 learned_addr learned my addr 172.21.15.73:0/2397515047 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7be00640 1 -- 172.21.15.73:0/2397515047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e9088e0 msgr2=0x55ce9e910180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e9088e0 0x55ce9e910180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7b400640 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e8bc5e0 0x55ce9e90fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7be00640 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e9088e0 0x55ce9e910180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7be00640 1 -- 172.21.15.73:0/2397515047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e8bc5e0 msgr2=0x55ce9e90fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7be00640 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e8bc5e0 0x55ce9e90fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7be00640 1 -- 172.21.15.73:0/2397515047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce9e6b0940 con 0x55ce9e909200 2024-04-15T15:33:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e9088e0 0x55ce9e910180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7b400640 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e8bc5e0 0x55ce9e90fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7be00640 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e8c9270 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9f74004340 tx=0x7f9f74004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66eee0eafe26f6c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f64c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f64c00640 1 -- 172.21.15.73:0/2397515047 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7401b070 con 0x55ce9e909200 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f64c00640 1 -- 172.21.15.73:0/2397515047 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f9f74015e20 con 0x55ce9e909200 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 -- 172.21.15.73:0/2397515047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f6c007670 con 0x55ce9e909200 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f64c00640 1 -- 172.21.15.73:0/2397515047 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9f74028050 con 0x55ce9e909200 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 10 client.5730 fetch_fsmap learned FSMap version 24 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 -- 172.21.15.73:0/2397515047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55ce9e693e80 con 0x55ce9e909200 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f64c00640 1 -- 172.21.15.73:0/2397515047 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6c007670 con 0x55ce9e909200 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f64c00640 1 -- 172.21.15.73:0/2397515047 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 3494+0+0 (secure 0 0 0) 0x7f9f7402b020 con 0x55ce9e909200 2024-04-15T15:33:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 10 client.5730 fetch_fsmap finished waiting for FSMap version 24 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 10 client.5730 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 20 client.5730 populate_metadata read hostname 'smithi073' 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.73:6834/1374015509,v1:172.21.15.73:6836/1374015509] conn(0x55ce9e8ca010 0x55ce9e8ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 4 client.5730 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 -- 172.21.15.73:0/2397515047 --> [v2:172.21.15.73:6834/1374015509,v1:172.21.15.73:6836/1374015509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce9e6a6bc0 con 0x55ce9e8ca010 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7b400640 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.73:6834/1374015509,v1:172.21.15.73:6836/1374015509] conn(0x55ce9e8ca010 0x55ce9e8ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f7b400640 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.73:6834/1374015509,v1:172.21.15.73:6836/1374015509] conn(0x55ce9e8ca010 0x55ce9e8ca3f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=941598105b10c9b6 server_cookie=3ae3be2810242f44 in_seq=0 out_seq=0 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f64c00640 10 client.5730 ms_handle_connect on v2:172.21.15.73:6834/1374015509 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f64c00640 1 -- 172.21.15.73:0/2397515047 <== mds.0 v2:172.21.15.73:6834/1374015509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ce9e6a6bc0 con 0x55ce9e8ca010 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f64c00640 10 client.5730 handle_command_reply: tid=0 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 client.5730 shutdown 2024-04-15T15:33:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 -- 172.21.15.73:0/2397515047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 msgr2=0x55ce9e8c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e8c9270 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9f74004340 tx=0x7f9f74004800 comp rx=0 tx=0).stop 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 -- 172.21.15.73:0/2397515047 shutdown_connections 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.73:6834/1374015509,v1:172.21.15.73:6836/1374015509] conn(0x55ce9e8ca010 0x55ce9e8ca3f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e8c9270 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e9088e0 0x55ce9e910180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f64c00640 0 client.5730 ms_handle_reset on v2:172.21.15.73:6834/1374015509 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/2397515047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e8bc5e0 0x55ce9e90fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.132+0000 7f9f85a3c000 1 -- 172.21.15.73:0/2397515047 >> 172.21.15.73:0/2397515047 conn(0x55ce9e7a6510 msgr2=0x55ce9e8bb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.136+0000 7f9f85a3c000 1 -- 172.21.15.73:0/2397515047 shutdown_connections 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.136+0000 7f9f85a3c000 1 -- 172.21.15.73:0/2397515047 wait complete. 2024-04-15T15:33:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.136+0000 7f9f85a3c000 20 client.5730 trim_cache size 0 max 16384 2024-04-15T15:33:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 Processor -- start 2024-04-15T15:33:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 -- start start 2024-04-15T15:33:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e9747f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e9088e0 0x55ce9e974d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e975270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c1ffb70 con 0x55ce9e909200 2024-04-15T15:33:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c1fec00 con 0x55ce9e9088e0 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7c1f3080 con 0x55ce9e8bc5e0 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e975270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e975270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50084/0 (socket says 172.21.15.73:50084) 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7be00640 1 -- 172.21.15.73:0/4246435722 learned_addr learned my addr 172.21.15.73:0/4246435722 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/4246435722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e9088e0 0x55ce9e974d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7b400640 1 --2- 172.21.15.73:0/4246435722 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e9747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7be00640 1 -- 172.21.15.73:0/4246435722 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 msgr2=0x55ce9e9747f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7be00640 1 --2- 172.21.15.73:0/4246435722 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e9747f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7be00640 1 -- 172.21.15.73:0/4246435722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e9088e0 msgr2=0x55ce9e974d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7be00640 1 --2- 172.21.15.73:0/4246435722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e9088e0 0x55ce9e974d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7be00640 1 -- 172.21.15.73:0/4246435722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce9e8c4900 con 0x55ce9e909200 2024-04-15T15:33:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7b400640 1 --2- 172.21.15.73:0/4246435722 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e9747f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f7be00640 1 --2- 172.21.15.73:0/4246435722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e975270 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400b010 tx=0x7f9f7400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac44bcdcf8866cc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f67400640 1 -- 172.21.15.73:0/4246435722 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7401b070 con 0x55ce9e909200 2024-04-15T15:33:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f67400640 1 -- 172.21.15.73:0/4246435722 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f74031070 con 0x55ce9e909200 2024-04-15T15:33:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f67400640 1 -- 172.21.15.73:0/4246435722 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f74020760 con 0x55ce9e909200 2024-04-15T15:33:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 -- 172.21.15.73:0/4246435722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 msgr2=0x55ce9e975270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/4246435722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e975270 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400b010 tx=0x7f9f7400e000 comp rx=0 tx=0).stop 2024-04-15T15:33:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 -- 172.21.15.73:0/4246435722 shutdown_connections 2024-04-15T15:33:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/4246435722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e975270 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.152+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/4246435722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e9088e0 0x55ce9e974d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/4246435722 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e9747f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 -- 172.21.15.73:0/4246435722 >> 172.21.15.73:0/4246435722 conn(0x55ce9e7a6510 msgr2=0x55ce9e8bb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 -- 172.21.15.73:0/4246435722 shutdown_connections 2024-04-15T15:33:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 -- 172.21.15.73:0/4246435722 wait complete. 2024-04-15T15:33:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 -- start start 2024-04-15T15:33:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 Processor -- start 2024-04-15T15:33:15.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e978660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e9088e0 0x55ce9e978ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e90c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ce9e70a220 con 0x55ce9e909200 2024-04-15T15:33:15.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c1f36d0 con 0x55ce9e9088e0 2024-04-15T15:33:15.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55ce9e6acff0 con 0x55ce9e8bc5e0 2024-04-15T15:33:15.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 10 client.0 _ll_register_callbacks cb 0x7f9f74009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T15:33:15.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e90c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e90c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50092/0 (socket says 172.21.15.73:50092) 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7be00640 1 -- 172.21.15.73:0/1793244807 learned_addr learned my addr 172.21.15.73:0/1793244807 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7b400640 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e978660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7aa00640 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e9088e0 0x55ce9e978ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7be00640 1 -- 172.21.15.73:0/1793244807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 msgr2=0x55ce9e978660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7be00640 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e978660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7be00640 1 -- 172.21.15.73:0/1793244807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e9088e0 msgr2=0x55ce9e978ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7be00640 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e9088e0 0x55ce9e978ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7be00640 1 -- 172.21.15.73:0/1793244807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce9e78e5d0 con 0x55ce9e909200 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7be00640 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e90c640 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55ce9e7bc750 tx=0x7f9f74004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d896cc03c620c39 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f64c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-04-15T15:33:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f64c00640 1 -- 172.21.15.73:0/1793244807 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7401b040 con 0x55ce9e909200 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f64c00640 1 -- 172.21.15.73:0/1793244807 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f9f74020cf0 con 0x55ce9e909200 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1793244807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f74031070 con 0x55ce9e909200 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f64c00640 1 -- 172.21.15.73:0/1793244807 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9f74043050 con 0x55ce9e909200 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 10 client.5736 fetch_fsmap learned FSMap version 24 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1793244807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55ce9e7656e0 con 0x55ce9e909200 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f64c00640 1 -- 172.21.15.73:0/1793244807 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f74031070 con 0x55ce9e909200 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f64c00640 1 -- 172.21.15.73:0/1793244807 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 3494+0+0 (secure 0 0 0) 0x7f9f74046020 con 0x55ce9e909200 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 10 client.5736 fetch_fsmap finished waiting for FSMap version 24 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 10 client.5736 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 20 client.5736 populate_metadata read hostname 'smithi073' 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.73:6834/1374015509,v1:172.21.15.73:6836/1374015509] conn(0x55ce9e90cfa0 0x55ce9e90d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 4 client.5736 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1793244807 --> [v2:172.21.15.73:6834/1374015509,v1:172.21.15.73:6836/1374015509] -- command(tid 0: {"prefix": "status"}) -- 0x55ce9e71acb0 con 0x55ce9e90cfa0 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.156+0000 7f9f7b400640 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.73:6834/1374015509,v1:172.21.15.73:6836/1374015509] conn(0x55ce9e90cfa0 0x55ce9e90d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f7b400640 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.73:6834/1374015509,v1:172.21.15.73:6836/1374015509] conn(0x55ce9e90cfa0 0x55ce9e90d380 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5447efe72cbb831 server_cookie=6a9e0c7cb2150718 in_seq=0 out_seq=0 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f64c00640 10 client.5736 ms_handle_connect on v2:172.21.15.73:6834/1374015509 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f64c00640 1 -- 172.21.15.73:0/1793244807 <== mds.0 v2:172.21.15.73:6834/1374015509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ce9e71acb0 con 0x55ce9e90cfa0 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f64c00640 10 client.5736 handle_command_reply: tid=0 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 client.5736 shutdown 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1793244807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 msgr2=0x55ce9e90c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e90c640 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55ce9e7bc750 tx=0x7f9f74004ac0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1793244807 shutdown_connections 2024-04-15T15:33:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.73:6834/1374015509,v1:172.21.15.73:6836/1374015509] conn(0x55ce9e90cfa0 0x55ce9e90d380 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ce9e909200 0x55ce9e90c640 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce9e9088e0 0x55ce9e978ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f64c00640 0 client.5736 ms_handle_reset on v2:172.21.15.73:6834/1374015509 2024-04-15T15:33:15.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 --2- 172.21.15.73:0/1793244807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55ce9e8bc5e0 0x55ce9e978660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1793244807 >> 172.21.15.73:0/1793244807 conn(0x55ce9e7a6510 msgr2=0x55ce9e8bb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:15.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1793244807 shutdown_connections 2024-04-15T15:33:15.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 1 -- 172.21.15.73:0/1793244807 wait complete. 2024-04-15T15:33:15.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f85a3c000 20 client.5736 trim_cache size 0 max 16384 2024-04-15T15:33:15.167 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "a72de584-7db8-4f62-b310-5ee655143eeb", 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5322, 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 4.5528461240000002, 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 24, 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 42, 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 40, 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 33.296579686999998 2024-04-15T15:33:15.168 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:15.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 -- 172.21.15.73:0/3805501286 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f5c068440 msgr2=0x7f9f5c06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f5c068440 0x7f9f5c06a900 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c007fd0 tx=0x7f9f6c009040 comp rx=0 tx=0).stop 2024-04-15T15:33:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 -- 172.21.15.73:0/3805501286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c1f1f30 msgr2=0x7f9f7c1e41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c1f1f30 0x7f9f7c1e41a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9f6801f1e0 tx=0x7f9f60005840 comp rx=0 tx=0).stop 2024-04-15T15:33:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 -- 172.21.15.73:0/3805501286 shutdown_connections 2024-04-15T15:33:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9f5c068440 0x7f9f5c06a900 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f7c1e46e0 0x7f9f7c1e22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c1f1f30 0x7f9f7c1e41a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 --2- 172.21.15.73:0/3805501286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f60004810 0x7f9f7c1f19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 -- 172.21.15.73:0/3805501286 >> 172.21.15.73:0/3805501286 conn(0x7f9f7c067dd0 msgr2=0x7f9f7c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 -- 172.21.15.73:0/3805501286 shutdown_connections 2024-04-15T15:33:15.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.160+0000 7f9f82600640 1 -- 172.21.15.73:0/3805501286 wait complete. 2024-04-15T15:33:15.181 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-15T15:33:15.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-15T15:33:15.278 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-15T15:33:15.371 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-15T15:33:15.371 INFO:tasks.cephfs.mount:Terminating background process 2024-04-15T15:33:15.371 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:33:15.371 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:15.380 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:33:15.380 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:15.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:33:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68fc000640 1 Processor -- start 2024-04-15T15:33:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68fc000640 1 -- start start 2024-04-15T15:33:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68fc000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68f40b20b0 0x7f68f40b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68fc000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f68f415cbd0 0x7f68f415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68fc000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f40cd3a0 con 0x7f68f4146110 2024-04-15T15:33:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68fc000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f68f40b5160 con 0x7f68f40b20b0 2024-04-15T15:33:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68fc000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f68f40b40c0 con 0x7f68f415cbd0 2024-04-15T15:33:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68f8c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68f40b20b0 0x7f68f40b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68f8c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68f40b20b0 0x7f68f40b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50108/0 (socket says 172.21.15.73:50108) 2024-04-15T15:33:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68f8c00640 1 -- 172.21.15.73:0/3259128378 learned_addr learned my addr 172.21.15.73:0/3259128378 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.608+0000 7f68fa000640 1 --2- 172.21.15.73:0/3259128378 >> v2:172.21.15.118:3300/0 conn(0x7f68f415cbd0 0x7f68f415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68f8c00640 1 -- 172.21.15.73:0/3259128378 >> v2:172.21.15.118:3300/0 conn(0x7f68f415cbd0 msgr2=0x7f68f415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68f8c00640 1 --2- 172.21.15.73:0/3259128378 >> v2:172.21.15.118:3300/0 conn(0x7f68f415cbd0 0x7f68f415d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68f8c00640 1 -- 172.21.15.73:0/3259128378 >> v1:172.21.15.118:6789/0 conn(0x7f68f4146110 legacy=0x7f68f40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68f8c00640 1 -- 172.21.15.73:0/3259128378 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f40b43a0 con 0x7f68f40b20b0 2024-04-15T15:33:15.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68fa000640 1 --2- 172.21.15.73:0/3259128378 >> v2:172.21.15.118:3300/0 conn(0x7f68f415cbd0 0x7f68f415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68f8c00640 1 --2- 172.21.15.73:0/3259128378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f40b20b0 0x7f68f40b2530 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f68f40cd570 tx=0x7f68e001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a379f464a952c76d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68f3e00640 1 -- 172.21.15.73:0/3259128378 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e00ab610 con 0x7f68f40b20b0 2024-04-15T15:33:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68f3e00640 1 -- 172.21.15.73:0/3259128378 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e00b0070 con 0x7f68f40b20b0 2024-04-15T15:33:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68f3e00640 1 -- 172.21.15.73:0/3259128378 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e00ab9d0 con 0x7f68f40b20b0 2024-04-15T15:33:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68fc000640 1 -- 172.21.15.73:0/3259128378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f40b20b0 msgr2=0x7f68f40b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68fc000640 1 --2- 172.21.15.73:0/3259128378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f40b20b0 0x7f68f40b2530 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f68f40cd570 tx=0x7f68e001c520 comp rx=0 tx=0).stop 2024-04-15T15:33:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68fc000640 1 -- 172.21.15.73:0/3259128378 shutdown_connections 2024-04-15T15:33:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68fc000640 1 --2- 172.21.15.73:0/3259128378 >> v2:172.21.15.118:3300/0 conn(0x7f68f415cbd0 0x7f68f415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68fc000640 1 --2- 172.21.15.73:0/3259128378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f40b20b0 0x7f68f40b2530 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68fc000640 1 -- 172.21.15.73:0/3259128378 >> 172.21.15.73:0/3259128378 conn(0x7f68f4067dd0 msgr2=0x7f68f40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.612+0000 7f68fc000640 1 -- 172.21.15.73:0/3259128378 shutdown_connections 2024-04-15T15:33:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 -- 172.21.15.73:0/3259128378 wait complete. 2024-04-15T15:33:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 Processor -- start 2024-04-15T15:33:15.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 -- start start 2024-04-15T15:33:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f40b20b0 0x7f68f4141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f4146110 0x7f68f406f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f415cbd0 0x7f68f4157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f68f4169210 con 0x7f68f415cbd0 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f68f40b3d70 con 0x7f68f4146110 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f68f4169390 con 0x7f68f40b20b0 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fa000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f415cbd0 0x7f68f4157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fa000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f415cbd0 0x7f68f4157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50118/0 (socket says 172.21.15.73:50118) 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fa000640 1 -- 172.21.15.73:0/2290081243 learned_addr learned my addr 172.21.15.73:0/2290081243 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68f8c00640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f4146110 0x7f68f406f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68f9600640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f40b20b0 0x7f68f4141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fa000640 1 -- 172.21.15.73:0/2290081243 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f40b20b0 msgr2=0x7f68f4141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fa000640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f40b20b0 0x7f68f4141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fa000640 1 -- 172.21.15.73:0/2290081243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f4146110 msgr2=0x7f68f406f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fa000640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f4146110 0x7f68f406f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fa000640 1 -- 172.21.15.73:0/2290081243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f413a460 con 0x7f68f415cbd0 2024-04-15T15:33:15.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fa000640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f415cbd0 0x7f68f4157080 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00d830 tx=0x7f68ec00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68f1600640 1 -- 172.21.15.73:0/2290081243 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec007e10 con 0x7f68f415cbd0 2024-04-15T15:33:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68f1600640 1 -- 172.21.15.73:0/2290081243 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ec019070 con 0x7f68f415cbd0 2024-04-15T15:33:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 -- 172.21.15.73:0/2290081243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f406fbd0 con 0x7f68f415cbd0 2024-04-15T15:33:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68f1600640 1 -- 172.21.15.73:0/2290081243 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00bb10 con 0x7f68f415cbd0 2024-04-15T15:33:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.616+0000 7f68fc000640 1 -- 172.21.15.73:0/2290081243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f406f8b0 con 0x7f68f415cbd0 2024-04-15T15:33:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.620+0000 7f68fc000640 1 -- 172.21.15.73:0/2290081243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f406e820 con 0x7f68f415cbd0 2024-04-15T15:33:15.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.620+0000 7f68f1600640 1 -- 172.21.15.73:0/2290081243 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f68ec00bcb0 con 0x7f68f415cbd0 2024-04-15T15:33:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.620+0000 7f68f1600640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f68d4068410 0x7f68d406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.620+0000 7f68f1600640 1 -- 172.21.15.73:0/2290081243 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f68ec086f60 con 0x7f68f415cbd0 2024-04-15T15:33:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.620+0000 7f68f9600640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f68d4068410 0x7f68d406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.620+0000 7f68f9600640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f68d4068410 0x7f68d406a8d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f68e8001ea0 tx=0x7f68e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.624+0000 7f68f1600640 1 -- 172.21.15.73:0/2290081243 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f68f406e820 con 0x7f68f415cbd0 2024-04-15T15:33:15.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.784+0000 7f68fc000640 1 -- 172.21.15.73:0/2290081243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68f4068ab0 con 0x7f68f415cbd0 2024-04-15T15:33:15.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68f1600640 1 -- 172.21.15.73:0/2290081243 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17041 (secure 0 0 0) 0x7f68f4068ab0 con 0x7f68f415cbd0 2024-04-15T15:33:15.789 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:15.789 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":42,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:33:14.628670+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6834/2635966606":"2024-04-16T15:33:09.602425+0000","172.21.15.118:6832/2635966606":"2024-04-16T15:33:09.602425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:33:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 -- 172.21.15.73:0/2290081243 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f68d4068410 msgr2=0x7f68d406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f68d4068410 0x7f68d406a8d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f68e8001ea0 tx=0x7f68e8009040 comp rx=0 tx=0).stop 2024-04-15T15:33:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 -- 172.21.15.73:0/2290081243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f415cbd0 msgr2=0x7f68f4157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f415cbd0 0x7f68f4157080 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00d830 tx=0x7f68ec00dcf0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 -- 172.21.15.73:0/2290081243 shutdown_connections 2024-04-15T15:33:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68f415cbd0 0x7f68f4157080 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f4146110 0x7f68f406f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f68d4068410 0x7f68d406a8d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 --2- 172.21.15.73:0/2290081243 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f40b20b0 0x7f68f4141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 -- 172.21.15.73:0/2290081243 >> 172.21.15.73:0/2290081243 conn(0x7f68f4067dd0 msgr2=0x7f68f41580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:15.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 -- 172.21.15.73:0/2290081243 shutdown_connections 2024-04-15T15:33:15.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.788+0000 7f68fc000640 1 -- 172.21.15.73:0/2290081243 wait complete. 2024-04-15T15:33:15.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:32:46.793984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:32:48.072270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T15:33:15.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:33:15.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.948+0000 7f2844e00640 1 Processor -- start 2024-04-15T15:33:15.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.948+0000 7f2844e00640 1 -- start start 2024-04-15T15:33:15.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.948+0000 7f2844e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840146110 0x7f28400cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.948+0000 7f2844e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28400b20b0 0x7f28400b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.948+0000 7f2844e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28400cd3a0 con 0x7f2840071e10 2024-04-15T15:33:15.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.948+0000 7f2844e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f28400b5160 con 0x7f28400b20b0 2024-04-15T15:33:15.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.948+0000 7f2844e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f28400b40c0 con 0x7f2840146110 2024-04-15T15:33:15.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.948+0000 7f2837e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28400b20b0 0x7f28400b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f2837e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28400b20b0 0x7f28400b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50122/0 (socket says 172.21.15.73:50122) 2024-04-15T15:33:15.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f2837e00640 1 -- 172.21.15.73:0/2858637604 learned_addr learned my addr 172.21.15.73:0/2858637604 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:15.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f283e800640 1 --1- 172.21.15.73:0/2858637604 >> v1:172.21.15.73:6789/0 conn(0x7f2840071e10 0x7f28400722a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40640/0 (socket says 172.21.15.73:40640) 2024-04-15T15:33:15.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f2837e00640 1 -- 172.21.15.73:0/2858637604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840146110 msgr2=0x7f28400cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:15.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f283de00640 1 --2- 172.21.15.73:0/2858637604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840146110 0x7f28400cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f2837e00640 1 --2- 172.21.15.73:0/2858637604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840146110 0x7f28400cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f283d400640 1 -- 172.21.15.73:0/2858637604 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600504273 0 0) 0x7f28400cd3a0 con 0x7f2840071e10 2024-04-15T15:33:15.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f2837e00640 1 -- 172.21.15.73:0/2858637604 >> v1:172.21.15.73:6789/0 conn(0x7f2840071e10 legacy=0x7f28400722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f2837e00640 1 -- 172.21.15.73:0/2858637604 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28400b43a0 con 0x7f28400b20b0 2024-04-15T15:33:15.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f283de00640 1 --2- 172.21.15.73:0/2858637604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840146110 0x7f28400cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:15.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f2837e00640 1 --2- 172.21.15.73:0/2858637604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28400b20b0 0x7f28400b2530 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2828009870 tx=0x7f282801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f09d99de3361958 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f283d400640 1 -- 172.21.15.73:0/2858637604 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28280ab650 con 0x7f28400b20b0 2024-04-15T15:33:15.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f283d400640 1 -- 172.21.15.73:0/2858637604 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28280b0070 con 0x7f28400b20b0 2024-04-15T15:33:15.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.952+0000 7f283d400640 1 -- 172.21.15.73:0/2858637604 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28280aba10 con 0x7f28400b20b0 2024-04-15T15:33:15.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 -- 172.21.15.73:0/2858637604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28400b20b0 msgr2=0x7f28400b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 --2- 172.21.15.73:0/2858637604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28400b20b0 0x7f28400b2530 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2828009870 tx=0x7f282801c560 comp rx=0 tx=0).stop 2024-04-15T15:33:15.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 -- 172.21.15.73:0/2858637604 shutdown_connections 2024-04-15T15:33:15.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 --2- 172.21.15.73:0/2858637604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28400b20b0 0x7f28400b2530 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 --2- 172.21.15.73:0/2858637604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840146110 0x7f28400cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 -- 172.21.15.73:0/2858637604 >> 172.21.15.73:0/2858637604 conn(0x7f2840067dd0 msgr2=0x7f28400d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:15.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 -- 172.21.15.73:0/2858637604 shutdown_connections 2024-04-15T15:33:15.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 -- 172.21.15.73:0/2858637604 wait complete. 2024-04-15T15:33:15.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 Processor -- start 2024-04-15T15:33:15.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 -- start start 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840071e10 0x7f284015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28400b20b0 0x7f28400c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2840146110 0x7f28400c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f28400cdcf0 con 0x7f2840146110 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f28400b3d70 con 0x7f28400b20b0 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2844e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f284015dbe0 con 0x7f2840071e10 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f283e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2840146110 0x7f28400c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f283e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2840146110 0x7f28400c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50130/0 (socket says 172.21.15.73:50130) 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f283e800640 1 -- 172.21.15.73:0/1823254761 learned_addr learned my addr 172.21.15.73:0/1823254761 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f283de00640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840071e10 0x7f284015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f2837e00640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28400b20b0 0x7f28400c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f283e800640 1 -- 172.21.15.73:0/1823254761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840071e10 msgr2=0x7f284015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f283e800640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840071e10 0x7f284015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f283e800640 1 -- 172.21.15.73:0/1823254761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28400b20b0 msgr2=0x7f28400c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f283e800640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28400b20b0 0x7f28400c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f283e800640 1 -- 172.21.15.73:0/1823254761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284013f340 con 0x7f2840146110 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.956+0000 7f283e800640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2840146110 0x7f28400c58d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f283800c7a0 tx=0x7f283800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f2836000640 1 -- 172.21.15.73:0/1823254761 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838018070 con 0x7f2840146110 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f2836000640 1 -- 172.21.15.73:0/1823254761 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283800a640 con 0x7f2840146110 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f2844e00640 1 -- 172.21.15.73:0/1823254761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284013f620 con 0x7f2840146110 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f2836000640 1 -- 172.21.15.73:0/1823254761 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283800aab0 con 0x7f2840146110 2024-04-15T15:33:15.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f2844e00640 1 -- 172.21.15.73:0/1823254761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f284013fbe0 con 0x7f2840146110 2024-04-15T15:33:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f2844e00640 1 -- 172.21.15.73:0/1823254761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f284013fde0 con 0x7f2840146110 2024-04-15T15:33:15.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f2836000640 1 -- 172.21.15.73:0/1823254761 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f283801b070 con 0x7f2840146110 2024-04-15T15:33:15.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f2836000640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f281c068410 0x7f281c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:15.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f2836000640 1 -- 172.21.15.73:0/1823254761 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f2838086180 con 0x7f2840146110 2024-04-15T15:33:15.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f283de00640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f281c068410 0x7f281c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:15.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.960+0000 7f283de00640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f281c068410 0x7f281c06a8d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2830006fd0 tx=0x7f2830008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:15.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:15.964+0000 7f2836000640 1 -- 172.21.15.73:0/1823254761 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f284013fde0 con 0x7f2840146110 2024-04-15T15:33:16.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.120+0000 7f2844e00640 1 -- 172.21.15.73:0/1823254761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2840068ab0 con 0x7f2840146110 2024-04-15T15:33:16.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.120+0000 7f2836000640 1 -- 172.21.15.73:0/1823254761 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f2838055f00 con 0x7f2840146110 2024-04-15T15:33:16.123 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:33:16.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 -- 172.21.15.73:0/1823254761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f281c068410 msgr2=0x7f281c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f281c068410 0x7f281c06a8d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2830006fd0 tx=0x7f2830008040 comp rx=0 tx=0).stop 2024-04-15T15:33:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 -- 172.21.15.73:0/1823254761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2840146110 msgr2=0x7f28400c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2840146110 0x7f28400c58d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f283800c7a0 tx=0x7f283800cc60 comp rx=0 tx=0).stop 2024-04-15T15:33:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 -- 172.21.15.73:0/1823254761 shutdown_connections 2024-04-15T15:33:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2840146110 0x7f28400c58d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28400b20b0 0x7f28400c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f281c068410 0x7f281c06a8d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 --2- 172.21.15.73:0/1823254761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2840071e10 0x7f284015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 -- 172.21.15.73:0/1823254761 >> 172.21.15.73:0/1823254761 conn(0x7f2840067dd0 msgr2=0x7f28401420b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 -- 172.21.15.73:0/1823254761 shutdown_connections 2024-04-15T15:33:16.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.124+0000 7f2844e00640 1 -- 172.21.15.73:0/1823254761 wait complete. 2024-04-15T15:33:16.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:33:16.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.280+0000 7f7043000640 1 Processor -- start 2024-04-15T15:33:16.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.280+0000 7f7043000640 1 -- start start 2024-04-15T15:33:16.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.280+0000 7f7043000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f703c15b5d0 0x7f703c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.280+0000 7f7043000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b27c0 0x7f703c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.280+0000 7f7043000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f703c070160 con 0x7f703c0b3e30 2024-04-15T15:33:16.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.280+0000 7f7043000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f703c15b9b0 con 0x7f703c15b5d0 2024-04-15T15:33:16.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.280+0000 7f7043000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f703c15f1f0 con 0x7f703c0b27c0 2024-04-15T15:33:16.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.280+0000 7f703be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f703c15b5d0 0x7f703c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.280+0000 7f7033400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f703c0b3e30 0x7f703c0b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40650/0 (socket says 172.21.15.73:40650) 2024-04-15T15:33:16.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.280+0000 7f7033400640 1 -- 172.21.15.73:0/2282744322 learned_addr learned my addr 172.21.15.73:0/2282744322 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:16.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.284+0000 7f7041000640 1 --2- 172.21.15.73:0/2282744322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b27c0 0x7f703c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.284+0000 7f703be00640 1 -- 172.21.15.73:0/2282744322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b27c0 msgr2=0x7f703c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:16.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.284+0000 7f703be00640 1 --2- 172.21.15.73:0/2282744322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b27c0 0x7f703c0b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.284+0000 7f703be00640 1 -- 172.21.15.73:0/2282744322 >> v1:172.21.15.73:6789/0 conn(0x7f703c0b3e30 legacy=0x7f703c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.284+0000 7f703be00640 1 -- 172.21.15.73:0/2282744322 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c06fe80 con 0x7f703c15b5d0 2024-04-15T15:33:16.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.284+0000 7f703b400640 1 -- 172.21.15.73:0/2282744322 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798516152 0 0) 0x7f703c070160 con 0x7f703c0b3e30 2024-04-15T15:33:16.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.284+0000 7f703be00640 1 --2- 172.21.15.73:0/2282744322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c15b5d0 0x7f703c15fc90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f702c009dc0 tx=0x7f702c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fe095a3c3bcf0c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:16.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.284+0000 7f703b400640 1 -- 172.21.15.73:0/2282744322 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0b2070 con 0x7f703c15b5d0 2024-04-15T15:33:16.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.284+0000 7f703b400640 1 -- 172.21.15.73:0/2282744322 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702c0a56c0 con 0x7f703c15b5d0 2024-04-15T15:33:16.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.284+0000 7f703b400640 1 -- 172.21.15.73:0/2282744322 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0a5a90 con 0x7f703c15b5d0 2024-04-15T15:33:16.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 -- 172.21.15.73:0/2282744322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c15b5d0 msgr2=0x7f703c15fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 --2- 172.21.15.73:0/2282744322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c15b5d0 0x7f703c15fc90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f702c009dc0 tx=0x7f702c01c800 comp rx=0 tx=0).stop 2024-04-15T15:33:16.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 -- 172.21.15.73:0/2282744322 shutdown_connections 2024-04-15T15:33:16.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 --2- 172.21.15.73:0/2282744322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b27c0 0x7f703c0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 --2- 172.21.15.73:0/2282744322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c15b5d0 0x7f703c15fc90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 -- 172.21.15.73:0/2282744322 >> 172.21.15.73:0/2282744322 conn(0x7f703c067dd0 msgr2=0x7f703c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:16.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 -- 172.21.15.73:0/2282744322 shutdown_connections 2024-04-15T15:33:16.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 -- 172.21.15.73:0/2282744322 wait complete. 2024-04-15T15:33:16.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 Processor -- start 2024-04-15T15:33:16.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 -- start start 2024-04-15T15:33:16.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c0b27c0 0x7f703c1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b3e30 0x7f703c0b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f703c15b5d0 0x7f703c1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f703c06faa0 con 0x7f703c0b27c0 2024-04-15T15:33:16.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f703c0cfd00 con 0x7f703c15b5d0 2024-04-15T15:33:16.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7043000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f703c06fc20 con 0x7f703c0b3e30 2024-04-15T15:33:16.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f703be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c0b27c0 0x7f703c1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f703be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c0b27c0 0x7f703c1587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50144/0 (socket says 172.21.15.73:50144) 2024-04-15T15:33:16.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f703be00640 1 -- 172.21.15.73:0/3011807242 learned_addr learned my addr 172.21.15.73:0/3011807242 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7041000640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f703c15b5d0 0x7f703c1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7033400640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b3e30 0x7f703c0b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f703be00640 1 -- 172.21.15.73:0/3011807242 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b3e30 msgr2=0x7f703c0b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f703be00640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b3e30 0x7f703c0b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f703be00640 1 -- 172.21.15.73:0/3011807242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f703c15b5d0 msgr2=0x7f703c1562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f703be00640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f703c15b5d0 0x7f703c1562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f703be00640 1 -- 172.21.15.73:0/3011807242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c0aaab0 con 0x7f703c0b27c0 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f7033400640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b3e30 0x7f703c0b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.288+0000 7f703be00640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c0b27c0 0x7f703c1587c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f702c009d60 tx=0x7f702c0195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7038c00640 1 -- 172.21.15.73:0/3011807242 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0bd030 con 0x7f703c0b27c0 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7038c00640 1 -- 172.21.15.73:0/3011807242 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702c0b8470 con 0x7f703c0b27c0 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7038c00640 1 -- 172.21.15.73:0/3011807242 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0b2040 con 0x7f703c0b27c0 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7043000640 1 -- 172.21.15.73:0/3011807242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703c0adc00 con 0x7f703c0b27c0 2024-04-15T15:33:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7043000640 1 -- 172.21.15.73:0/3011807242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f703c0ae1c0 con 0x7f703c0b27c0 2024-04-15T15:33:16.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7043000640 1 -- 172.21.15.73:0/3011807242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f703c068ab0 con 0x7f703c0b27c0 2024-04-15T15:33:16.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7038c00640 1 -- 172.21.15.73:0/3011807242 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f702c0c0070 con 0x7f703c0b27c0 2024-04-15T15:33:16.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7038c00640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7018068410 0x7f701806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7038c00640 1 -- 172.21.15.73:0/3011807242 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f702c121b90 con 0x7f703c0b27c0 2024-04-15T15:33:16.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7033400640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7018068410 0x7f701806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.292+0000 7f7033400640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7018068410 0x7f701806a8d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7024007fd0 tx=0x7f7024009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:16.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.296+0000 7f7038c00640 1 -- 172.21.15.73:0/3011807242 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f702c016540 con 0x7f703c0b27c0 2024-04-15T15:33:16.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.456+0000 7f7043000640 1 -- 172.21.15.73:0/3011807242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f703c15eda0 con 0x7f703c0b27c0 2024-04-15T15:33:16.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.456+0000 7f7038c00640 1 -- 172.21.15.73:0/3011807242 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) ==== 104+0+11 (secure 0 0 0) 0x7f702c0f1f60 con 0x7f703c0b27c0 2024-04-15T15:33:16.458 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.456+0000 7f7043000640 1 -- 172.21.15.73:0/3011807242 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7018068410 msgr2=0x7f701806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.456+0000 7f7043000640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7018068410 0x7f701806a8d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7024007fd0 tx=0x7f7024009040 comp rx=0 tx=0).stop 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.456+0000 7f7043000640 1 -- 172.21.15.73:0/3011807242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c0b27c0 msgr2=0x7f703c1587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.456+0000 7f7043000640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c0b27c0 0x7f703c1587c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f702c009d60 tx=0x7f702c0195a0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.460+0000 7f7043000640 1 -- 172.21.15.73:0/3011807242 shutdown_connections 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.460+0000 7f7043000640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f703c15b5d0 0x7f703c1562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.460+0000 7f7043000640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7018068410 0x7f701806a8d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.460+0000 7f7043000640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f703c0b3e30 0x7f703c0b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.460+0000 7f7043000640 1 --2- 172.21.15.73:0/3011807242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f703c0b27c0 0x7f703c1587c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.460+0000 7f7043000640 1 -- 172.21.15.73:0/3011807242 >> 172.21.15.73:0/3011807242 conn(0x7f703c067dd0 msgr2=0x7f703c071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:16.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.460+0000 7f7043000640 1 -- 172.21.15.73:0/3011807242 shutdown_connections 2024-04-15T15:33:16.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.460+0000 7f7043000640 1 -- 172.21.15.73:0/3011807242 wait complete. 2024-04-15T15:33:16.478 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:33:16.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169ee00640 1 Processor -- start 2024-04-15T15:33:16.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169ee00640 1 -- start start 2024-04-15T15:33:16.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169ee00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980cede0 0x7f16980cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169ee00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16980b4e20 con 0x7f16980c5e90 2024-04-15T15:33:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169ee00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f169815ca20 con 0x7f169815c640 2024-04-15T15:33:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169ee00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f16980d1310 con 0x7f16980cede0 2024-04-15T15:33:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169e400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f16980c5e90 0x7f16980c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40652/0 (socket says 172.21.15.73:40652) 2024-04-15T15:33:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169e400640 1 -- 172.21.15.73:0/2068727534 learned_addr learned my addr 172.21.15.73:0/2068727534 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169d000640 1 --2- 172.21.15.73:0/2068727534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980cede0 0x7f16980cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f1697e00640 1 -- 172.21.15.73:0/2068727534 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197374072 0 0) 0x7f16980b4e20 con 0x7f16980c5e90 2024-04-15T15:33:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f1697e00640 1 -- 172.21.15.73:0/2068727534 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1680003530 con 0x7f16980c5e90 2024-04-15T15:33:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f1697e00640 1 -- 172.21.15.73:0/2068727534 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844214837 0 0) 0x7f169815ca20 con 0x7f169815c640 2024-04-15T15:33:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f1697e00640 1 -- 172.21.15.73:0/2068727534 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16980b4e20 con 0x7f169815c640 2024-04-15T15:33:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169d000640 1 -- 172.21.15.73:0/2068727534 >> v1:172.21.15.118:6789/0 conn(0x7f169815c640 legacy=0x7f16980b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169d000640 1 -- 172.21.15.73:0/2068727534 >> v1:172.21.15.73:6789/0 conn(0x7f16980c5e90 legacy=0x7f16980c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.616+0000 7f169d000640 1 -- 172.21.15.73:0/2068727534 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16980d0270 con 0x7f16980cede0 2024-04-15T15:33:16.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f169d000640 1 --2- 172.21.15.73:0/2068727534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980cede0 0x7f16980cf240 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16840097f0 tx=0x7f168401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d797ddd5086d8c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:16.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f1697e00640 1 -- 172.21.15.73:0/2068727534 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16840b0070 con 0x7f16980cede0 2024-04-15T15:33:16.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f1697e00640 1 -- 172.21.15.73:0/2068727534 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16840ab600 con 0x7f16980cede0 2024-04-15T15:33:16.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f1697e00640 1 -- 172.21.15.73:0/2068727534 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16840ab9d0 con 0x7f16980cede0 2024-04-15T15:33:16.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f169ee00640 1 -- 172.21.15.73:0/2068727534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980cede0 msgr2=0x7f16980cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f169ee00640 1 --2- 172.21.15.73:0/2068727534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980cede0 0x7f16980cf240 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16840097f0 tx=0x7f168401c4e0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f169ee00640 1 -- 172.21.15.73:0/2068727534 shutdown_connections 2024-04-15T15:33:16.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f169ee00640 1 --2- 172.21.15.73:0/2068727534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980cede0 0x7f16980cf240 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f169ee00640 1 -- 172.21.15.73:0/2068727534 >> 172.21.15.73:0/2068727534 conn(0x7f169806ba50 msgr2=0x7f169806be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:16.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f169ee00640 1 -- 172.21.15.73:0/2068727534 shutdown_connections 2024-04-15T15:33:16.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.620+0000 7f169ee00640 1 -- 172.21.15.73:0/2068727534 wait complete. 2024-04-15T15:33:16.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169ee00640 1 Processor -- start 2024-04-15T15:33:16.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169ee00640 1 -- start start 2024-04-15T15:33:16.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169ee00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980c5e90 0x7f169806e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169ee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16980cede0 0x7f1698154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169ee00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169815c640 0x7f16980b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169ee00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f16980ceaa0 con 0x7f169815c640 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169ee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f16980c6e40 con 0x7f16980cede0 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169ee00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f16980b68e0 con 0x7f16980c5e90 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169e400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169815c640 0x7f16980b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169e400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169815c640 0x7f16980b5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50146/0 (socket says 172.21.15.73:50146) 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169e400640 1 -- 172.21.15.73:0/3377066866 learned_addr learned my addr 172.21.15.73:0/3377066866 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169da00640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980c5e90 0x7f169806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169d000640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16980cede0 0x7f1698154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169e400640 1 -- 172.21.15.73:0/3377066866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980c5e90 msgr2=0x7f169806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169e400640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980c5e90 0x7f169806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169e400640 1 -- 172.21.15.73:0/3377066866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16980cede0 msgr2=0x7f1698154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169e400640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16980cede0 0x7f1698154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169e400640 1 -- 172.21.15.73:0/3377066866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16980b6bc0 con 0x7f169815c640 2024-04-15T15:33:16.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169da00640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980c5e90 0x7f169806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:16.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169e400640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169815c640 0x7f16980b5f90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f169000c3f0 tx=0x7f169000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:16.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f1695600640 1 -- 172.21.15.73:0/3377066866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690017070 con 0x7f169815c640 2024-04-15T15:33:16.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f1695600640 1 -- 172.21.15.73:0/3377066866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1690005db0 con 0x7f169815c640 2024-04-15T15:33:16.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f1695600640 1 -- 172.21.15.73:0/3377066866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690007310 con 0x7f169815c640 2024-04-15T15:33:16.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169ee00640 1 -- 172.21.15.73:0/3377066866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16980b6ea0 con 0x7f169815c640 2024-04-15T15:33:16.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.624+0000 7f169ee00640 1 -- 172.21.15.73:0/3377066866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16980b7460 con 0x7f169815c640 2024-04-15T15:33:16.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.628+0000 7f169ee00640 1 -- 172.21.15.73:0/3377066866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169804fd60 con 0x7f169815c640 2024-04-15T15:33:16.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.628+0000 7f1695600640 1 -- 172.21.15.73:0/3377066866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f169001a070 con 0x7f169815c640 2024-04-15T15:33:16.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.628+0000 7f1695600640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1678068410 0x7f167806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.628+0000 7f1695600640 1 -- 172.21.15.73:0/3377066866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f1690086060 con 0x7f169815c640 2024-04-15T15:33:16.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.628+0000 7f169da00640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1678068410 0x7f167806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.628+0000 7f169da00640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1678068410 0x7f167806a8d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f168c001570 tx=0x7f168c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:16.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.632+0000 7f1695600640 1 -- 172.21.15.73:0/3377066866 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1690055ce0 con 0x7f169815c640 2024-04-15T15:33:16.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.788+0000 7f169ee00640 1 -- 172.21.15.73:0/3377066866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f16980c5620 con 0x7f169815c640 2024-04-15T15:33:16.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.788+0000 7f1695600640 1 -- 172.21.15.73:0/3377066866 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) ==== 100+0+11 (secure 0 0 0) 0x7f1690059fe0 con 0x7f169815c640 2024-04-15T15:33:16.792 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:33:16.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 -- 172.21.15.73:0/3377066866 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1678068410 msgr2=0x7f167806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1678068410 0x7f167806a8d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f168c001570 tx=0x7f168c009040 comp rx=0 tx=0).stop 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 -- 172.21.15.73:0/3377066866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169815c640 msgr2=0x7f16980b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169815c640 0x7f16980b5f90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f169000c3f0 tx=0x7f169000c8b0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 -- 172.21.15.73:0/3377066866 shutdown_connections 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f169815c640 0x7f16980b5f90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16980cede0 0x7f1698154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1678068410 0x7f167806a8d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 --2- 172.21.15.73:0/3377066866 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16980c5e90 0x7f169806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 -- 172.21.15.73:0/3377066866 >> 172.21.15.73:0/3377066866 conn(0x7f169806ba50 msgr2=0x7f16980b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 -- 172.21.15.73:0/3377066866 shutdown_connections 2024-04-15T15:33:16.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.792+0000 7f169ee00640 1 -- 172.21.15.73:0/3377066866 wait complete. 2024-04-15T15:33:16.813 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:33:16.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.948+0000 7fd129000640 1 Processor -- start 2024-04-15T15:33:16.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.948+0000 7fd129000640 1 -- start start 2024-04-15T15:33:16.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd129000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd12415b5d0 0x7fd12415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd129000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd1240b3e30 0x7fd1240b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd129000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1240b25f0 0x7fd1240b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd129000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd12415b9b0 con 0x7fd12415b5d0 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd129000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd124070160 con 0x7fd1240b3e30 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd129000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd12415f1f0 con 0x7fd1240b25f0 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd121e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd12415b5d0 0x7fd12415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd121e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd12415b5d0 0x7fd12415fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50152/0 (socket says 172.21.15.73:50152) 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd121e00640 1 -- 172.21.15.73:0/2618500201 learned_addr learned my addr 172.21.15.73:0/2618500201 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd121400640 1 --2- 172.21.15.73:0/2618500201 >> v2:172.21.15.118:3300/0 conn(0x7fd1240b3e30 0x7fd1240b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd122800640 1 --2- 172.21.15.73:0/2618500201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1240b25f0 0x7fd1240b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd121e00640 1 -- 172.21.15.73:0/2618500201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1240b25f0 msgr2=0x7fd1240b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd121e00640 1 --2- 172.21.15.73:0/2618500201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1240b25f0 0x7fd1240b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd121e00640 1 -- 172.21.15.73:0/2618500201 >> v2:172.21.15.118:3300/0 conn(0x7fd1240b3e30 msgr2=0x7fd1240b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd121e00640 1 --2- 172.21.15.73:0/2618500201 >> v2:172.21.15.118:3300/0 conn(0x7fd1240b3e30 0x7fd1240b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd121e00640 1 -- 172.21.15.73:0/2618500201 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12406fe80 con 0x7fd12415b5d0 2024-04-15T15:33:16.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.952+0000 7fd121400640 1 --2- 172.21.15.73:0/2618500201 >> v2:172.21.15.118:3300/0 conn(0x7fd1240b3e30 0x7fd1240b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd121e00640 1 --2- 172.21.15.73:0/2618500201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd12415b5d0 0x7fd12415fc90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd11400d150 tx=0x7fd11401ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb1f8573d88aa02 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:16.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd120a00640 1 -- 172.21.15.73:0/2618500201 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11400b0d0 con 0x7fd12415b5d0 2024-04-15T15:33:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd120a00640 1 -- 172.21.15.73:0/2618500201 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11400b270 con 0x7fd12415b5d0 2024-04-15T15:33:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd120a00640 1 -- 172.21.15.73:0/2618500201 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1140a7850 con 0x7fd12415b5d0 2024-04-15T15:33:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 -- 172.21.15.73:0/2618500201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd12415b5d0 msgr2=0x7fd12415fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 --2- 172.21.15.73:0/2618500201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd12415b5d0 0x7fd12415fc90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd11400d150 tx=0x7fd11401ead0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 -- 172.21.15.73:0/2618500201 shutdown_connections 2024-04-15T15:33:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 --2- 172.21.15.73:0/2618500201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1240b25f0 0x7fd1240b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 --2- 172.21.15.73:0/2618500201 >> v2:172.21.15.118:3300/0 conn(0x7fd1240b3e30 0x7fd1240b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 --2- 172.21.15.73:0/2618500201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd12415b5d0 0x7fd12415fc90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 -- 172.21.15.73:0/2618500201 >> 172.21.15.73:0/2618500201 conn(0x7fd124067dd0 msgr2=0x7fd1240d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 -- 172.21.15.73:0/2618500201 shutdown_connections 2024-04-15T15:33:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 -- 172.21.15.73:0/2618500201 wait complete. 2024-04-15T15:33:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 Processor -- start 2024-04-15T15:33:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.956+0000 7fd129000640 1 -- start start 2024-04-15T15:33:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd129000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1240b25f0 0x7fd12414e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd129000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1240b3e30 0x7fd1241f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd129000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd12415b5d0 0x7fd1241f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd129000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd12406faa0 con 0x7fd1240b25f0 2024-04-15T15:33:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd129000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd1240b4240 con 0x7fd1240b3e30 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd129000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd12406fc20 con 0x7fd12415b5d0 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd121e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1240b25f0 0x7fd12414e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd121e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1240b25f0 0x7fd12414e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50158/0 (socket says 172.21.15.73:50158) 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd121e00640 1 -- 172.21.15.73:0/1570523690 learned_addr learned my addr 172.21.15.73:0/1570523690 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd121400640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1240b3e30 0x7fd1241f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd122800640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd12415b5d0 0x7fd1241f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd121e00640 1 -- 172.21.15.73:0/1570523690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd12415b5d0 msgr2=0x7fd1241f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd121e00640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd12415b5d0 0x7fd1241f6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd121e00640 1 -- 172.21.15.73:0/1570523690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1240b3e30 msgr2=0x7fd1241f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd121e00640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1240b3e30 0x7fd1241f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd121e00640 1 -- 172.21.15.73:0/1570523690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12415c3d0 con 0x7fd1240b25f0 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd122800640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd12415b5d0 0x7fd1241f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:16.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd121e00640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1240b25f0 0x7fd12414e220 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd11401f370 tx=0x7fd11401b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:16.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd11a000640 1 -- 172.21.15.73:0/1570523690 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1140be020 con 0x7fd1240b25f0 2024-04-15T15:33:16.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd11a000640 1 -- 172.21.15.73:0/1570523690 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd114009810 con 0x7fd1240b25f0 2024-04-15T15:33:16.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd11a000640 1 -- 172.21.15.73:0/1570523690 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11400b0d0 con 0x7fd1240b25f0 2024-04-15T15:33:16.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd129000640 1 -- 172.21.15.73:0/1570523690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1241592a0 con 0x7fd1240b25f0 2024-04-15T15:33:16.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd129000640 1 -- 172.21.15.73:0/1570523690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd124159860 con 0x7fd1240b25f0 2024-04-15T15:33:16.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd129000640 1 -- 172.21.15.73:0/1570523690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd124159020 con 0x7fd1240b25f0 2024-04-15T15:33:16.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.960+0000 7fd11a000640 1 -- 172.21.15.73:0/1570523690 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fd1140c1020 con 0x7fd1240b25f0 2024-04-15T15:33:16.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.964+0000 7fd11a000640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd104068410 0x7fd10406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:16.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.964+0000 7fd11a000640 1 -- 172.21.15.73:0/1570523690 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7fd114123d10 con 0x7fd1240b25f0 2024-04-15T15:33:16.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.964+0000 7fd121400640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd104068410 0x7fd10406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:16.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.964+0000 7fd121400640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd104068410 0x7fd10406a8d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd12414a930 tx=0x7fd110008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:16.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:16.968+0000 7fd11a000640 1 -- 172.21.15.73:0/1570523690 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd124159020 con 0x7fd1240b25f0 2024-04-15T15:33:17.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.132+0000 7fd129000640 1 -- 172.21.15.73:0/1570523690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd124068ab0 con 0x7fd1240b25f0 2024-04-15T15:33:17.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.132+0000 7fd11a000640 1 -- 172.21.15.73:0/1570523690 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v42) ==== 80+0+124 (secure 0 0 0) 0x7fd114129020 con 0x7fd1240b25f0 2024-04-15T15:33:17.135 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.118:6834/2635966606 2024-04-16T15:33:09.602425+0000 2024-04-15T15:33:17.136 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.118:6832/2635966606 2024-04-16T15:33:09.602425+0000 2024-04-15T15:33:17.136 INFO:teuthology.orchestra.run.smithi073.stderr:listed 2 entries 2024-04-15T15:33:17.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 -- 172.21.15.73:0/1570523690 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd104068410 msgr2=0x7fd10406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd104068410 0x7fd10406a8d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd12414a930 tx=0x7fd110008040 comp rx=0 tx=0).stop 2024-04-15T15:33:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 -- 172.21.15.73:0/1570523690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1240b25f0 msgr2=0x7fd12414e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1240b25f0 0x7fd12414e220 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd11401f370 tx=0x7fd11401b870 comp rx=0 tx=0).stop 2024-04-15T15:33:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 -- 172.21.15.73:0/1570523690 shutdown_connections 2024-04-15T15:33:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd104068410 0x7fd10406a8d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd12415b5d0 0x7fd1241f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1240b3e30 0x7fd1241f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 --2- 172.21.15.73:0/1570523690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1240b25f0 0x7fd12414e220 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 -- 172.21.15.73:0/1570523690 >> 172.21.15.73:0/1570523690 conn(0x7fd124067dd0 msgr2=0x7fd1240b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:17.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 -- 172.21.15.73:0/1570523690 shutdown_connections 2024-04-15T15:33:17.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.136+0000 7fd129000640 1 -- 172.21.15.73:0/1570523690 wait complete. 2024-04-15T15:33:17.157 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-15T15:33:17.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:17.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-15T15:33:17.183 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:33:17.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:17.184 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-15T15:33:17.236 INFO:tasks.cephfs.mount:Terminating background process 2024-04-15T15:33:17.236 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:33:17.236 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:17.246 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:33:17.246 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:17.296 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:33:17.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fef000640 1 Processor -- start 2024-04-15T15:33:17.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fef000640 1 -- start start 2024-04-15T15:33:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fef000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0fe80b18e0 0x7f0fe80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fef000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fe80cbb20 con 0x7f0fe806ba50 2024-04-15T15:33:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fef000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fe80cbe00 con 0x7f0fe80d0dd0 2024-04-15T15:33:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fef000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0fe80cc0e0 con 0x7f0fe80b18e0 2024-04-15T15:33:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fedc00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0fe80b18e0 0x7f0fe80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fed200640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0fe806ba50 0x7f0fe80d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49754/0 (socket says 172.21.15.73:49754) 2024-04-15T15:33:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fed200640 1 -- 172.21.15.73:0/2558270444 learned_addr learned my addr 172.21.15.73:0/2558270444 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fedc00640 1 -- 172.21.15.73:0/2558270444 >> v1:172.21.15.118:6789/0 conn(0x7f0fe80d0dd0 legacy=0x7f0fe80cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fedc00640 1 -- 172.21.15.73:0/2558270444 >> v1:172.21.15.73:6789/0 conn(0x7f0fe806ba50 legacy=0x7f0fe80d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fedc00640 1 -- 172.21.15.73:0/2558270444 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe80cc3c0 con 0x7f0fe80b18e0 2024-04-15T15:33:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.432+0000 7f0fe7e00640 1 -- 172.21.15.73:0/2558270444 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454573077 0 0) 0x7f0fe80cbb20 con 0x7f0fe806ba50 2024-04-15T15:33:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fedc00640 1 --2- 172.21.15.73:0/2558270444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 0x7f0fe80ccbc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0097c0 tx=0x7f0fdc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a30ec731b3ba9c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fe7e00640 1 -- 172.21.15.73:0/2558270444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0b0070 con 0x7f0fe80b18e0 2024-04-15T15:33:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fe7e00640 1 -- 172.21.15.73:0/2558270444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fdc0ab600 con 0x7f0fe80b18e0 2024-04-15T15:33:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fe7e00640 1 -- 172.21.15.73:0/2558270444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0ab9d0 con 0x7f0fe80b18e0 2024-04-15T15:33:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fef000640 1 -- 172.21.15.73:0/2558270444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 msgr2=0x7f0fe80ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fef000640 1 --2- 172.21.15.73:0/2558270444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 0x7f0fe80ccbc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0097c0 tx=0x7f0fdc01c460 comp rx=0 tx=0).stop 2024-04-15T15:33:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fef000640 1 -- 172.21.15.73:0/2558270444 shutdown_connections 2024-04-15T15:33:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fef000640 1 --2- 172.21.15.73:0/2558270444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 0x7f0fe80ccbc0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fef000640 1 -- 172.21.15.73:0/2558270444 >> 172.21.15.73:0/2558270444 conn(0x7f0fe80b2e90 msgr2=0x7f0fe80b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fef000640 1 -- 172.21.15.73:0/2558270444 shutdown_connections 2024-04-15T15:33:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fef000640 1 -- 172.21.15.73:0/2558270444 wait complete. 2024-04-15T15:33:17.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fef000640 1 Processor -- start 2024-04-15T15:33:17.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.436+0000 7f0fef000640 1 -- start start 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fef000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fe806ba50 0x7f0fe81500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fef000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 0x7f0fe814fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fef000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe80d0dd0 0x7f0fe806fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fef000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe80b1e40 con 0x7f0fe80b18e0 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fef000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe80b1cc0 con 0x7f0fe80d0dd0 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fef000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0fe815e750 con 0x7f0fe806ba50 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fed200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 0x7f0fe814fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fed200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 0x7f0fe814fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51472/0 (socket says 172.21.15.73:51472) 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fed200640 1 -- 172.21.15.73:0/1084852439 learned_addr learned my addr 172.21.15.73:0/1084852439 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fedc00640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fe806ba50 0x7f0fe81500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fee600640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe80d0dd0 0x7f0fe806fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fed200640 1 -- 172.21.15.73:0/1084852439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fe806ba50 msgr2=0x7f0fe81500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fed200640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fe806ba50 0x7f0fe81500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fed200640 1 -- 172.21.15.73:0/1084852439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe80d0dd0 msgr2=0x7f0fe806fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fed200640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe80d0dd0 0x7f0fe806fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fed200640 1 -- 172.21.15.73:0/1084852439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe8155fc0 con 0x7f0fe80b18e0 2024-04-15T15:33:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fed200640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 0x7f0fe814fa50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40011f0 tx=0x7f0fd400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fe5600640 1 -- 172.21.15.73:0/1084852439 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4018070 con 0x7f0fe80b18e0 2024-04-15T15:33:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fe5600640 1 -- 172.21.15.73:0/1084852439 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd40074e0 con 0x7f0fe80b18e0 2024-04-15T15:33:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fef000640 1 -- 172.21.15.73:0/1084852439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe81562a0 con 0x7f0fe80b18e0 2024-04-15T15:33:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fe5600640 1 -- 172.21.15.73:0/1084852439 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4004a10 con 0x7f0fe80b18e0 2024-04-15T15:33:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fef000640 1 -- 172.21.15.73:0/1084852439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe80c7f00 con 0x7f0fe80b18e0 2024-04-15T15:33:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fef000640 1 -- 172.21.15.73:0/1084852439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe804fd60 con 0x7f0fe80b18e0 2024-04-15T15:33:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.440+0000 7f0fe5600640 1 -- 172.21.15.73:0/1084852439 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f0fd401b070 con 0x7f0fe80b18e0 2024-04-15T15:33:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.444+0000 7f0fe5600640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0fc8068440 0x7f0fc806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.444+0000 7f0fe5600640 1 -- 172.21.15.73:0/1084852439 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f0fd4085f30 con 0x7f0fe80b18e0 2024-04-15T15:33:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.444+0000 7f0fedc00640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0fc8068440 0x7f0fc806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.444+0000 7f0fedc00640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0fc8068440 0x7f0fc806a900 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0ad000 tx=0x7f0fdc0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:17.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.448+0000 7f0fe5600640 1 -- 172.21.15.73:0/1084852439 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0fd4056290 con 0x7f0fe80b18e0 2024-04-15T15:33:17.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.608+0000 7f0fef000640 1 -- 172.21.15.73:0/1084852439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0fe8159910 con 0x7f0fe80b18e0 2024-04-15T15:33:17.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.608+0000 7f0fe5600640 1 -- 172.21.15.73:0/1084852439 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17041 (secure 0 0 0) 0x7f0fd4055b90 con 0x7f0fe80b18e0 2024-04-15T15:33:17.611 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:17.611 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":42,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:33:14.628670+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6834/2635966606":"2024-04-16T15:33:09.602425+0000","172.21.15.118:6832/2635966606":"2024-04-16T15:33:09.602425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:33:17.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 -- 172.21.15.73:0/1084852439 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0fc8068440 msgr2=0x7f0fc806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0fc8068440 0x7f0fc806a900 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0ad000 tx=0x7f0fdc0a6000 comp rx=0 tx=0).stop 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 -- 172.21.15.73:0/1084852439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 msgr2=0x7f0fe814fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 0x7f0fe814fa50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40011f0 tx=0x7f0fd400c9b0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 -- 172.21.15.73:0/1084852439 shutdown_connections 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe80d0dd0 0x7f0fe806fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe80b18e0 0x7f0fe814fa50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f0fc8068440 0x7f0fc806a900 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 --2- 172.21.15.73:0/1084852439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fe806ba50 0x7f0fe81500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 -- 172.21.15.73:0/1084852439 >> 172.21.15.73:0/1084852439 conn(0x7f0fe80b2e90 msgr2=0x7f0fe8158560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 -- 172.21.15.73:0/1084852439 shutdown_connections 2024-04-15T15:33:17.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.612+0000 7f0fef000640 1 -- 172.21.15.73:0/1084852439 wait complete. 2024-04-15T15:33:17.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:32:46.793984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:32:48.072270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T15:33:17.633 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:33:17.695 INFO:tasks.ceph.mds.a.smithi073.stderr:2024-04-15T15:33:17.692+0000 7f8109c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-15T15:33:17.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758d600640 1 Processor -- start 2024-04-15T15:33:17.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758d600640 1 -- start start 2024-04-15T15:33:17.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758d600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f758815fa60 0x7f75880b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758d600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75880b3250 0x7f75880cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758d600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75880ccfe0 con 0x7f758815fe40 2024-04-15T15:33:17.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758d600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f75880d09f0 con 0x7f75880b3250 2024-04-15T15:33:17.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758d600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f75880d0cd0 con 0x7f758815fa60 2024-04-15T15:33:17.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7587400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f758815fe40 0x7f75880cd4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49756/0 (socket says 172.21.15.73:49756) 2024-04-15T15:33:17.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7587400640 1 -- 172.21.15.73:0/1959056267 learned_addr learned my addr 172.21.15.73:0/1959056267 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7587e00640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f758815fa60 0x7f75880b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758cc00640 1 --2- 172.21.15.73:0/1959056267 >> v2:172.21.15.118:3300/0 conn(0x7f75880b3250 0x7f75880cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352805315 0 0) 0x7f75880ccfe0 con 0x7f758815fe40 2024-04-15T15:33:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f756c003530 con 0x7f758815fe40 2024-04-15T15:33:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 988395686 0 0) 0x7f756c003530 con 0x7f758815fe40 2024-04-15T15:33:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f758815fa60 msgr2=0x7f75880b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f758815fa60 0x7f75880b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 >> v2:172.21.15.118:3300/0 conn(0x7f75880b3250 msgr2=0x7f75880cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 --2- 172.21.15.73:0/1959056267 >> v2:172.21.15.118:3300/0 conn(0x7f75880b3250 0x7f75880cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75880d0fb0 con 0x7f758815fe40 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f7574001680 con 0x7f758815fe40 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 >> v1:172.21.15.73:6789/0 conn(0x7f758815fe40 legacy=0x7f75880cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f758815fa60 0x7f756c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f756c003fb0 0x7f756c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 0x7f756c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f75880d09f0 con 0x7f756c004d50 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f75880d0cd0 con 0x7f756c003fb0 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f756c00ba00 con 0x7f758815fa60 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758cc00640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 0x7f756c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7587e00640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f758815fa60 0x7f756c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7587400640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f756c003fb0 0x7f756c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758cc00640 1 -- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f758815fa60 msgr2=0x7f756c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:17.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758cc00640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f758815fa60 0x7f756c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758cc00640 1 -- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f756c003fb0 msgr2=0x7f756c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:17.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758cc00640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f756c003fb0 0x7f756c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f758cc00640 1 -- 172.21.15.73:0/1959056267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c003530 con 0x7f756c004d50 2024-04-15T15:33:17.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.772+0000 7f7587400640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f756c003fb0 0x7f756c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f758cc00640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 0x7f756c0051d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7580009fc0 tx=0x7f758001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e640a155a4ca5d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75800b2070 con 0x7f756c004d50 2024-04-15T15:33:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75800a5cd0 con 0x7f756c004d50 2024-04-15T15:33:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f7586a00640 1 -- 172.21.15.73:0/1959056267 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7580009c10 con 0x7f756c004d50 2024-04-15T15:33:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f758d600640 1 -- 172.21.15.73:0/1959056267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 msgr2=0x7f756c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f758d600640 1 --2- 172.21.15.73:0/1959056267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 0x7f756c0051d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7580009fc0 tx=0x7f758001ccc0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f758cc00640 1 -- 172.21.15.73:0/1959056267 reap_dead start 2024-04-15T15:33:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f758d600640 1 -- 172.21.15.73:0/1959056267 shutdown_connections 2024-04-15T15:33:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f758d600640 1 -- 172.21.15.73:0/1959056267 >> 172.21.15.73:0/1959056267 conn(0x7f75880b3e60 msgr2=0x7f75880b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f758d600640 1 -- 172.21.15.73:0/1959056267 shutdown_connections 2024-04-15T15:33:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.776+0000 7f758d600640 1 -- 172.21.15.73:0/1959056267 wait complete. 2024-04-15T15:33:17.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758d600640 1 Processor -- start 2024-04-15T15:33:17.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758d600640 1 -- start start 2024-04-15T15:33:17.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758d600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 0x7f75880c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758d600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7588156630 0x7f75880cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758d600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75880cbc50 0x7f75880cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758d600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f75880ce110 con 0x7f756c004d50 2024-04-15T15:33:17.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758d600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f758809bc90 con 0x7f7588156630 2024-04-15T15:33:17.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758d600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f75880ce290 con 0x7f75880cbc50 2024-04-15T15:33:17.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f7587e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 0x7f75880c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f7587e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 0x7f75880c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51498/0 (socket says 172.21.15.73:51498) 2024-04-15T15:33:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f7587e00640 1 -- 172.21.15.73:0/3345603588 learned_addr learned my addr 172.21.15.73:0/3345603588 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758cc00640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75880cbc50 0x7f75880cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f7587400640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7588156630 0x7f75880cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f7587e00640 1 -- 172.21.15.73:0/3345603588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75880cbc50 msgr2=0x7f75880cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f7587e00640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75880cbc50 0x7f75880cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f7587e00640 1 -- 172.21.15.73:0/3345603588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7588156630 msgr2=0x7f75880cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f7587e00640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7588156630 0x7f75880cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f7587e00640 1 -- 172.21.15.73:0/3345603588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7588157b40 con 0x7f756c004d50 2024-04-15T15:33:17.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f7587e00640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 0x7f75880c9950 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f75780119d0 tx=0x7f7578011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:17.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f757fe00640 1 -- 172.21.15.73:0/3345603588 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757800fb50 con 0x7f756c004d50 2024-04-15T15:33:17.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f757fe00640 1 -- 172.21.15.73:0/3345603588 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757800fcf0 con 0x7f756c004d50 2024-04-15T15:33:17.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f757fe00640 1 -- 172.21.15.73:0/3345603588 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757800fea0 con 0x7f756c004d50 2024-04-15T15:33:17.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758d600640 1 -- 172.21.15.73:0/3345603588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7588157010 con 0x7f756c004d50 2024-04-15T15:33:17.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.780+0000 7f758d600640 1 -- 172.21.15.73:0/3345603588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75881580c0 con 0x7f756c004d50 2024-04-15T15:33:17.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.784+0000 7f758d600640 1 -- 172.21.15.73:0/3345603588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f758804fd60 con 0x7f756c004d50 2024-04-15T15:33:17.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.784+0000 7f757fe00640 1 -- 172.21.15.73:0/3345603588 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f7578012040 con 0x7f756c004d50 2024-04-15T15:33:17.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.784+0000 7f757fe00640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7568068440 0x7f756806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:17.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.784+0000 7f757fe00640 1 -- 172.21.15.73:0/3345603588 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f7578087360 con 0x7f756c004d50 2024-04-15T15:33:17.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.784+0000 7f7587400640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7568068440 0x7f756806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:17.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.784+0000 7f7587400640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7568068440 0x7f756806a900 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f75880cde10 tx=0x7f7574009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:17.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.788+0000 7f757fe00640 1 -- 172.21.15.73:0/3345603588 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7578019030 con 0x7f756c004d50 2024-04-15T15:33:17.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 -- 172.21.15.73:0/3345603588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f75880ce7d0 con 0x7f756c004d50 2024-04-15T15:33:17.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f757fe00640 1 -- 172.21.15.73:0/3345603588 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f75780576f0 con 0x7f756c004d50 2024-04-15T15:33:17.949 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:33:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 -- 172.21.15.73:0/3345603588 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7568068440 msgr2=0x7f756806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7568068440 0x7f756806a900 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f75880cde10 tx=0x7f7574009040 comp rx=0 tx=0).stop 2024-04-15T15:33:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 -- 172.21.15.73:0/3345603588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 msgr2=0x7f75880c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 0x7f75880c9950 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f75780119d0 tx=0x7f7578011e90 comp rx=0 tx=0).stop 2024-04-15T15:33:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 -- 172.21.15.73:0/3345603588 shutdown_connections 2024-04-15T15:33:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7568068440 0x7f756806a900 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75880cbc50 0x7f75880cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7588156630 0x7f75880cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 --2- 172.21.15.73:0/3345603588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c004d50 0x7f75880c9950 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 -- 172.21.15.73:0/3345603588 >> 172.21.15.73:0/3345603588 conn(0x7f75880b3e60 msgr2=0x7f75880715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 -- 172.21.15.73:0/3345603588 shutdown_connections 2024-04-15T15:33:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:17.948+0000 7f758d600640 1 -- 172.21.15.73:0/3345603588 wait complete. 2024-04-15T15:33:17.970 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:33:18.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.104+0000 7fad12800640 1 Processor -- start 2024-04-15T15:33:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.104+0000 7fad12800640 1 -- start start 2024-04-15T15:33:18.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad12800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 0x7fad0c070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad12800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad0c09be00 con 0x7fad0c0d0b20 2024-04-15T15:33:18.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad12800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad0c09b5a0 con 0x7fad0c15c860 2024-04-15T15:33:18.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad12800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fad0c15cc40 con 0x7fad0c0d0fa0 2024-04-15T15:33:18.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad0aa00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fad0c0d0b20 0x7fad0c0704d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49762/0 (socket says 172.21.15.73:49762) 2024-04-15T15:33:18.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad0aa00640 1 -- 172.21.15.73:0/1138641253 learned_addr learned my addr 172.21.15.73:0/1138641253 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:18.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad0be00640 1 --2- 172.21.15.73:0/1138641253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 0x7fad0c070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad0a000640 1 -- 172.21.15.73:0/1138641253 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1318052122 0 0) 0x7fad0c09be00 con 0x7fad0c0d0b20 2024-04-15T15:33:18.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad0a000640 1 -- 172.21.15.73:0/1138641253 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf0003530 con 0x7fad0c0d0b20 2024-04-15T15:33:18.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad0a000640 1 -- 172.21.15.73:0/1138641253 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231304168 0 0) 0x7fad0c09b5a0 con 0x7fad0c15c860 2024-04-15T15:33:18.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad0be00640 1 -- 172.21.15.73:0/1138641253 >> v1:172.21.15.118:6789/0 conn(0x7fad0c15c860 legacy=0x7fad0c0d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad0be00640 1 -- 172.21.15.73:0/1138641253 >> v1:172.21.15.73:6789/0 conn(0x7fad0c0d0b20 legacy=0x7fad0c0704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.108+0000 7fad0be00640 1 -- 172.21.15.73:0/1138641253 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c0d1430 con 0x7fad0c0d0fa0 2024-04-15T15:33:18.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad0be00640 1 --2- 172.21.15.73:0/1138641253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 0x7fad0c070be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad040097f0 tx=0x7fad0401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=863d1e821449acd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:18.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad0a000640 1 -- 172.21.15.73:0/1138641253 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad040b0070 con 0x7fad0c0d0fa0 2024-04-15T15:33:18.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad0a000640 1 -- 172.21.15.73:0/1138641253 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad040ab600 con 0x7fad0c0d0fa0 2024-04-15T15:33:18.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad0a000640 1 -- 172.21.15.73:0/1138641253 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad040ab9d0 con 0x7fad0c0d0fa0 2024-04-15T15:33:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad12800640 1 -- 172.21.15.73:0/1138641253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 msgr2=0x7fad0c070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad12800640 1 --2- 172.21.15.73:0/1138641253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 0x7fad0c070be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad040097f0 tx=0x7fad0401c450 comp rx=0 tx=0).stop 2024-04-15T15:33:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad12800640 1 -- 172.21.15.73:0/1138641253 shutdown_connections 2024-04-15T15:33:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad12800640 1 --2- 172.21.15.73:0/1138641253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 0x7fad0c070be0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad12800640 1 -- 172.21.15.73:0/1138641253 >> 172.21.15.73:0/1138641253 conn(0x7fad0c0b4050 msgr2=0x7fad0c0b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad12800640 1 -- 172.21.15.73:0/1138641253 shutdown_connections 2024-04-15T15:33:18.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad12800640 1 -- 172.21.15.73:0/1138641253 wait complete. 2024-04-15T15:33:18.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad12800640 1 Processor -- start 2024-04-15T15:33:18.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.112+0000 7fad12800640 1 -- start start 2024-04-15T15:33:18.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad12800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad0c0d0b20 0x7fad0c0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad12800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 0x7fad0c15cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad12800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0c15c860 0x7fad0c0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad12800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c16a330 con 0x7fad0c0d0b20 2024-04-15T15:33:18.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad12800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c0d0840 con 0x7fad0c15c860 2024-04-15T15:33:18.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad12800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fad0c16a4b0 con 0x7fad0c0d0fa0 2024-04-15T15:33:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad0c0d0b20 0x7fad0c0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad0c0d0b20 0x7fad0c0c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51510/0 (socket says 172.21.15.73:51510) 2024-04-15T15:33:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0b400640 1 -- 172.21.15.73:0/31680019 learned_addr learned my addr 172.21.15.73:0/31680019 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0be00640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0c15c860 0x7fad0c0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0aa00640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 0x7fad0c15cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0b400640 1 -- 172.21.15.73:0/31680019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 msgr2=0x7fad0c15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0b400640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 0x7fad0c15cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0b400640 1 -- 172.21.15.73:0/31680019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0c15c860 msgr2=0x7fad0c0cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0b400640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0c15c860 0x7fad0c0cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0b400640 1 -- 172.21.15.73:0/31680019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c0c6340 con 0x7fad0c0d0b20 2024-04-15T15:33:18.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0aa00640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 0x7fad0c15cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:18.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad0b400640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad0c0d0b20 0x7fad0c0c7450 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c790 tx=0x7facfc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:18.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad03400640 1 -- 172.21.15.73:0/31680019 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc003db0 con 0x7fad0c0d0b20 2024-04-15T15:33:18.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad03400640 1 -- 172.21.15.73:0/31680019 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facfc005070 con 0x7fad0c0d0b20 2024-04-15T15:33:18.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad03400640 1 -- 172.21.15.73:0/31680019 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc005460 con 0x7fad0c0d0b20 2024-04-15T15:33:18.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad12800640 1 -- 172.21.15.73:0/31680019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c0c5dc0 con 0x7fad0c0d0b20 2024-04-15T15:33:18.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad12800640 1 -- 172.21.15.73:0/31680019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c06d3f0 con 0x7fad0c0d0b20 2024-04-15T15:33:18.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad12800640 1 -- 172.21.15.73:0/31680019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0c068ab0 con 0x7fad0c0d0b20 2024-04-15T15:33:18.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.116+0000 7fad03400640 1 -- 172.21.15.73:0/31680019 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7facfc005600 con 0x7fad0c0d0b20 2024-04-15T15:33:18.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.120+0000 7fad03400640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7facec068440 0x7facec06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.120+0000 7fad03400640 1 -- 172.21.15.73:0/31680019 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7facfc086b80 con 0x7fad0c0d0b20 2024-04-15T15:33:18.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.120+0000 7fad0aa00640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7facec068440 0x7facec06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.120+0000 7fad0aa00640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7facec068440 0x7facec06a900 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad0c1682f0 tx=0x7facf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:18.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.124+0000 7fad03400640 1 -- 172.21.15.73:0/31680019 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7facfc056dd0 con 0x7fad0c0d0b20 2024-04-15T15:33:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 -- 172.21.15.73:0/31680019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fad0c15d310 con 0x7fad0c0d0b20 2024-04-15T15:33:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad03400640 1 -- 172.21.15.73:0/31680019 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) ==== 104+0+11 (secure 0 0 0) 0x7facfc0566d0 con 0x7fad0c0d0b20 2024-04-15T15:33:18.280 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:33:18.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 -- 172.21.15.73:0/31680019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7facec068440 msgr2=0x7facec06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7facec068440 0x7facec06a900 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad0c1682f0 tx=0x7facf8009040 comp rx=0 tx=0).stop 2024-04-15T15:33:18.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 -- 172.21.15.73:0/31680019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad0c0d0b20 msgr2=0x7fad0c0c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad0c0d0b20 0x7fad0c0c7450 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c790 tx=0x7facfc00cc50 comp rx=0 tx=0).stop 2024-04-15T15:33:18.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 -- 172.21.15.73:0/31680019 shutdown_connections 2024-04-15T15:33:18.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0c15c860 0x7fad0c0cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7facec068440 0x7facec06a900 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad0c0d0fa0 0x7fad0c15cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 --2- 172.21.15.73:0/31680019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad0c0d0b20 0x7fad0c0c7450 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 -- 172.21.15.73:0/31680019 >> 172.21.15.73:0/31680019 conn(0x7fad0c0b4050 msgr2=0x7fad0c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:18.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 -- 172.21.15.73:0/31680019 shutdown_connections 2024-04-15T15:33:18.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.280+0000 7fad12800640 1 -- 172.21.15.73:0/31680019 wait complete. 2024-04-15T15:33:18.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:33:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.436+0000 7f2f85c00640 1 Processor -- start 2024-04-15T15:33:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.436+0000 7f2f85c00640 1 -- start start 2024-04-15T15:33:18.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f85c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f80146110 0x7f2f800cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f85c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2f800b20b0 0x7f2f800b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f85c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f80071e10 0x7f2f800722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f85c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2f800cd3a0 con 0x7f2f800b20b0 2024-04-15T15:33:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f85c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f2f800b5160 con 0x7f2f80146110 2024-04-15T15:33:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f85c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2f800b40c0 con 0x7f2f80071e10 2024-04-15T15:33:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f7e000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2f800b20b0 0x7f2f800b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f7e000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2f800b20b0 0x7f2f800b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51516/0 (socket says 172.21.15.73:51516) 2024-04-15T15:33:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f7e000640 1 -- 172.21.15.73:0/1411307341 learned_addr learned my addr 172.21.15.73:0/1411307341 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f7f400640 1 --2- 172.21.15.73:0/1411307341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f80071e10 0x7f2f800722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f7ea00640 1 --2- 172.21.15.73:0/1411307341 >> v2:172.21.15.118:3300/0 conn(0x7f2f80146110 0x7f2f800cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f7e000640 1 -- 172.21.15.73:0/1411307341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f80071e10 msgr2=0x7f2f800722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:18.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f7e000640 1 --2- 172.21.15.73:0/1411307341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f80071e10 0x7f2f800722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f7e000640 1 -- 172.21.15.73:0/1411307341 >> v2:172.21.15.118:3300/0 conn(0x7f2f80146110 msgr2=0x7f2f800cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:18.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f7e000640 1 --2- 172.21.15.73:0/1411307341 >> v2:172.21.15.118:3300/0 conn(0x7f2f80146110 0x7f2f800cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.440+0000 7f2f7e000640 1 -- 172.21.15.73:0/1411307341 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f800b43a0 con 0x7f2f800b20b0 2024-04-15T15:33:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f7e000640 1 --2- 172.21.15.73:0/1411307341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f800b20b0 0x7f2f800b2530 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2f800d0fa0 tx=0x7f2f6c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71420a9188813efa server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f7d600640 1 -- 172.21.15.73:0/1411307341 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c0b1070 con 0x7f2f800b20b0 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f7d600640 1 -- 172.21.15.73:0/1411307341 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6c0ac630 con 0x7f2f800b20b0 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f7d600640 1 -- 172.21.15.73:0/1411307341 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c0a8050 con 0x7f2f800b20b0 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 -- 172.21.15.73:0/1411307341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f800b20b0 msgr2=0x7f2f800b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 --2- 172.21.15.73:0/1411307341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f800b20b0 0x7f2f800b2530 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2f800d0fa0 tx=0x7f2f6c01c520 comp rx=0 tx=0).stop 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 -- 172.21.15.73:0/1411307341 shutdown_connections 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 --2- 172.21.15.73:0/1411307341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f80071e10 0x7f2f800722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 --2- 172.21.15.73:0/1411307341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f800b20b0 0x7f2f800b2530 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 --2- 172.21.15.73:0/1411307341 >> v2:172.21.15.118:3300/0 conn(0x7f2f80146110 0x7f2f800cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 -- 172.21.15.73:0/1411307341 >> 172.21.15.73:0/1411307341 conn(0x7f2f80067dd0 msgr2=0x7f2f800d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 -- 172.21.15.73:0/1411307341 shutdown_connections 2024-04-15T15:33:18.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 -- 172.21.15.73:0/1411307341 wait complete. 2024-04-15T15:33:18.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 Processor -- start 2024-04-15T15:33:18.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 -- start start 2024-04-15T15:33:18.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.444+0000 7f2f85c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f80071e10 0x7f2f800cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f85c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800b20b0 0x7f2f80142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f85c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f80146110 0x7f2f801faf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f85c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2f800b3d70 con 0x7f2f80146110 2024-04-15T15:33:18.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f85c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2f800b4c40 con 0x7f2f800b20b0 2024-04-15T15:33:18.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f85c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2f800cdcf0 con 0x7f2f80071e10 2024-04-15T15:33:18.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f80146110 0x7f2f801faf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f80146110 0x7f2f801faf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51528/0 (socket says 172.21.15.73:51528) 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7f400640 1 -- 172.21.15.73:0/3438787013 learned_addr learned my addr 172.21.15.73:0/3438787013 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7ea00640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f80071e10 0x7f2f800cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7e000640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800b20b0 0x7f2f80142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7f400640 1 -- 172.21.15.73:0/3438787013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f80071e10 msgr2=0x7f2f800cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7f400640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f80071e10 0x7f2f800cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7f400640 1 -- 172.21.15.73:0/3438787013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800b20b0 msgr2=0x7f2f80142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7f400640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800b20b0 0x7f2f80142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7f400640 1 -- 172.21.15.73:0/3438787013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f80143500 con 0x7f2f80146110 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7e000640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800b20b0 0x7f2f80142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f7f400640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f80146110 0x7f2f801faf60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800e820 tx=0x7f2f7800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f76a00640 1 -- 172.21.15.73:0/3438787013 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78017070 con 0x7f2f80146110 2024-04-15T15:33:18.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f76a00640 1 -- 172.21.15.73:0/3438787013 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7800c940 con 0x7f2f80146110 2024-04-15T15:33:18.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f85c00640 1 -- 172.21.15.73:0/3438787013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f801437e0 con 0x7f2f80146110 2024-04-15T15:33:18.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f76a00640 1 -- 172.21.15.73:0/3438787013 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800cd10 con 0x7f2f80146110 2024-04-15T15:33:18.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f85c00640 1 -- 172.21.15.73:0/3438787013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8013de90 con 0x7f2f80146110 2024-04-15T15:33:18.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f85c00640 1 -- 172.21.15.73:0/3438787013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f80068ab0 con 0x7f2f80146110 2024-04-15T15:33:18.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.448+0000 7f2f76a00640 1 -- 172.21.15.73:0/3438787013 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f2f7801a070 con 0x7f2f80146110 2024-04-15T15:33:18.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.452+0000 7f2f76a00640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2f60068410 0x7f2f6006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.452+0000 7f2f76a00640 1 -- 172.21.15.73:0/3438787013 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f2f78086f10 con 0x7f2f80146110 2024-04-15T15:33:18.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.452+0000 7f2f7ea00640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2f60068410 0x7f2f6006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.452+0000 7f2f7ea00640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2f60068410 0x7f2f6006a8d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2f8015ba00 tx=0x7f2f7000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:18.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.456+0000 7f2f76a00640 1 -- 172.21.15.73:0/3438787013 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2f780571e0 con 0x7f2f80146110 2024-04-15T15:33:18.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 -- 172.21.15.73:0/3438787013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2f800af190 con 0x7f2f80146110 2024-04-15T15:33:18.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f76a00640 1 -- 172.21.15.73:0/3438787013 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) ==== 100+0+11 (secure 0 0 0) 0x7f2f78056ae0 con 0x7f2f80146110 2024-04-15T15:33:18.613 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:33:18.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 -- 172.21.15.73:0/3438787013 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2f60068410 msgr2=0x7f2f6006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2f60068410 0x7f2f6006a8d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2f8015ba00 tx=0x7f2f7000b040 comp rx=0 tx=0).stop 2024-04-15T15:33:18.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 -- 172.21.15.73:0/3438787013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f80146110 msgr2=0x7f2f801faf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f80146110 0x7f2f801faf60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800e820 tx=0x7f2f7800ece0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 -- 172.21.15.73:0/3438787013 shutdown_connections 2024-04-15T15:33:18.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f80146110 0x7f2f801faf60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800b20b0 0x7f2f80142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2f60068410 0x7f2f6006a8d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 --2- 172.21.15.73:0/3438787013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f80071e10 0x7f2f800cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 -- 172.21.15.73:0/3438787013 >> 172.21.15.73:0/3438787013 conn(0x7f2f80067dd0 msgr2=0x7f2f8015ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:18.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 -- 172.21.15.73:0/3438787013 shutdown_connections 2024-04-15T15:33:18.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.612+0000 7f2f85c00640 1 -- 172.21.15.73:0/3438787013 wait complete. 2024-04-15T15:33:18.634 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:33:18.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.768+0000 7f3004000640 1 Processor -- start 2024-04-15T15:33:18.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.768+0000 7f3004000640 1 -- start start 2024-04-15T15:33:18.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3004000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ffc146110 0x7f2ffc0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3004000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2ffc0b20b0 0x7f2ffc0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3004000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc0cd3a0 con 0x7f2ffc071e10 2024-04-15T15:33:18.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3004000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2ffc0b5160 con 0x7f2ffc146110 2024-04-15T15:33:18.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3004000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f2ffc0b40c0 con 0x7f2ffc0b20b0 2024-04-15T15:33:18.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3001600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ffc146110 0x7f2ffc0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3002000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2ffc071e10 0x7f2ffc072260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49772/0 (socket says 172.21.15.73:49772) 2024-04-15T15:33:18.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3002000640 1 -- 172.21.15.73:0/177357753 learned_addr learned my addr 172.21.15.73:0/177357753 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:18.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3000c00640 1 --2- 172.21.15.73:0/177357753 >> v2:172.21.15.118:3300/0 conn(0x7f2ffc0b20b0 0x7f2ffc0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3001600640 1 -- 172.21.15.73:0/177357753 >> v2:172.21.15.118:3300/0 conn(0x7f2ffc0b20b0 msgr2=0x7f2ffc0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:18.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3001600640 1 --2- 172.21.15.73:0/177357753 >> v2:172.21.15.118:3300/0 conn(0x7f2ffc0b20b0 0x7f2ffc0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3001600640 1 -- 172.21.15.73:0/177357753 >> v1:172.21.15.73:6789/0 conn(0x7f2ffc071e10 legacy=0x7f2ffc072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3001600640 1 -- 172.21.15.73:0/177357753 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc0b43a0 con 0x7f2ffc146110 2024-04-15T15:33:18.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f2ffbe00640 1 -- 172.21.15.73:0/177357753 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693026185 0 0) 0x7f2ffc0cd3a0 con 0x7f2ffc071e10 2024-04-15T15:33:18.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.772+0000 7f3001600640 1 --2- 172.21.15.73:0/177357753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 0x7f2ffc0cd7b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0cd570 tx=0x7f2ff001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e12291fbc4c0638 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:18.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f2ffbe00640 1 -- 172.21.15.73:0/177357753 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00b0070 con 0x7f2ffc146110 2024-04-15T15:33:18.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f2ffbe00640 1 -- 172.21.15.73:0/177357753 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff0004230 con 0x7f2ffc146110 2024-04-15T15:33:18.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f2ffbe00640 1 -- 172.21.15.73:0/177357753 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0003620 con 0x7f2ffc146110 2024-04-15T15:33:18.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 -- 172.21.15.73:0/177357753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 msgr2=0x7f2ffc0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 --2- 172.21.15.73:0/177357753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 0x7f2ffc0cd7b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0cd570 tx=0x7f2ff001c460 comp rx=0 tx=0).stop 2024-04-15T15:33:18.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 -- 172.21.15.73:0/177357753 shutdown_connections 2024-04-15T15:33:18.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 --2- 172.21.15.73:0/177357753 >> v2:172.21.15.118:3300/0 conn(0x7f2ffc0b20b0 0x7f2ffc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 --2- 172.21.15.73:0/177357753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 0x7f2ffc0cd7b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 -- 172.21.15.73:0/177357753 >> 172.21.15.73:0/177357753 conn(0x7f2ffc067dd0 msgr2=0x7f2ffc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:18.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 -- 172.21.15.73:0/177357753 shutdown_connections 2024-04-15T15:33:18.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 -- 172.21.15.73:0/177357753 wait complete. 2024-04-15T15:33:18.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 Processor -- start 2024-04-15T15:33:18.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 -- start start 2024-04-15T15:33:18.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ffc071e10 0x7f2ffc143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ffc0b20b0 0x7f2ffc13ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 0x7f2ffc13b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ffc0cdcf0 con 0x7f2ffc146110 2024-04-15T15:33:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2ffc0b3d70 con 0x7f2ffc0b20b0 2024-04-15T15:33:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3004000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2ffc15dbe0 con 0x7f2ffc071e10 2024-04-15T15:33:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3002000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 0x7f2ffc13b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3002000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 0x7f2ffc13b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51544/0 (socket says 172.21.15.73:51544) 2024-04-15T15:33:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3002000640 1 -- 172.21.15.73:0/1166725503 learned_addr learned my addr 172.21.15.73:0/1166725503 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3001600640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ffc071e10 0x7f2ffc143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.776+0000 7f3000c00640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ffc0b20b0 0x7f2ffc13ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f3002000640 1 -- 172.21.15.73:0/1166725503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ffc071e10 msgr2=0x7f2ffc143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f3002000640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ffc071e10 0x7f2ffc143ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f3002000640 1 -- 172.21.15.73:0/1166725503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ffc0b20b0 msgr2=0x7f2ffc13ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f3002000640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ffc0b20b0 0x7f2ffc13ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f3002000640 1 -- 172.21.15.73:0/1166725503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc1449e0 con 0x7f2ffc146110 2024-04-15T15:33:18.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f3002000640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 0x7f2ffc13b240 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400c730 tx=0x7f2ff400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:18.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f2ff9600640 1 -- 172.21.15.73:0/1166725503 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4018070 con 0x7f2ffc146110 2024-04-15T15:33:18.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f2ff9600640 1 -- 172.21.15.73:0/1166725503 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff400ce40 con 0x7f2ffc146110 2024-04-15T15:33:18.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f2ff9600640 1 -- 172.21.15.73:0/1166725503 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400a860 con 0x7f2ffc146110 2024-04-15T15:33:18.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f3004000640 1 -- 172.21.15.73:0/1166725503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ffc144cc0 con 0x7f2ffc146110 2024-04-15T15:33:18.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f3004000640 1 -- 172.21.15.73:0/1166725503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ffc145280 con 0x7f2ffc146110 2024-04-15T15:33:18.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f3004000640 1 -- 172.21.15.73:0/1166725503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ffc068ab0 con 0x7f2ffc146110 2024-04-15T15:33:18.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f2ff9600640 1 -- 172.21.15.73:0/1166725503 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f2ff401b070 con 0x7f2ffc146110 2024-04-15T15:33:18.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f2ff9600640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2fdc068410 0x7f2fdc06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:18.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f2ff9600640 1 -- 172.21.15.73:0/1166725503 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f2ff4086140 con 0x7f2ffc146110 2024-04-15T15:33:18.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.780+0000 7f3001600640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2fdc068410 0x7f2fdc06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:18.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.784+0000 7f3001600640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2fdc068410 0x7f2fdc06a8d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00ad000 tx=0x7f2ff0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:18.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.784+0000 7f2ff9600640 1 -- 172.21.15.73:0/1166725503 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2ff4055e50 con 0x7f2ffc146110 2024-04-15T15:33:18.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.956+0000 7f3004000640 1 -- 172.21.15.73:0/1166725503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2ffc0b2ff0 con 0x7f2ffc146110 2024-04-15T15:33:18.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.956+0000 7f2ff9600640 1 -- 172.21.15.73:0/1166725503 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v42) ==== 80+0+124 (secure 0 0 0) 0x7f2ff405a150 con 0x7f2ffc146110 2024-04-15T15:33:18.958 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.118:6834/2635966606 2024-04-16T15:33:09.602425+0000 2024-04-15T15:33:18.958 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.118:6832/2635966606 2024-04-16T15:33:09.602425+0000 2024-04-15T15:33:18.958 INFO:teuthology.orchestra.run.smithi073.stderr:listed 2 entries 2024-04-15T15:33:18.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 -- 172.21.15.73:0/1166725503 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2fdc068410 msgr2=0x7f2fdc06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2fdc068410 0x7f2fdc06a8d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00ad000 tx=0x7f2ff0008040 comp rx=0 tx=0).stop 2024-04-15T15:33:18.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 -- 172.21.15.73:0/1166725503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 msgr2=0x7f2ffc13b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:18.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 0x7f2ffc13b240 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400c730 tx=0x7f2ff400cbf0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 -- 172.21.15.73:0/1166725503 shutdown_connections 2024-04-15T15:33:18.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc146110 0x7f2ffc13b240 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ffc0b20b0 0x7f2ffc13ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2fdc068410 0x7f2fdc06a8d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 --2- 172.21.15.73:0/1166725503 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ffc071e10 0x7f2ffc143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:18.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 -- 172.21.15.73:0/1166725503 >> 172.21.15.73:0/1166725503 conn(0x7f2ffc067dd0 msgr2=0x7f2ffc0cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:18.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 -- 172.21.15.73:0/1166725503 shutdown_connections 2024-04-15T15:33:18.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:18.960+0000 7f3004000640 1 -- 172.21.15.73:0/1166725503 wait complete. 2024-04-15T15:33:18.978 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-15T15:33:18.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:18.979 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-15T15:33:19.010 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:33:19.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:19.010 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-15T15:33:19.061 INFO:tasks.cephfs.mount:Terminating background process 2024-04-15T15:33:19.061 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:33:19.062 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:19.071 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:33:19.071 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:19.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:33:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.296+0000 7fb4bb200640 1 Processor -- start 2024-04-15T15:33:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.296+0000 7fb4bb200640 1 -- start start 2024-04-15T15:33:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4bb200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb4b40b27c0 0x7fb4b415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4bb200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4b40b3e30 0x7fb4b40b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4bb200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4b4070160 con 0x7fb4b415b5d0 2024-04-15T15:33:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4bb200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb4b415b9b0 con 0x7fb4b40b27c0 2024-04-15T15:33:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4bb200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb4b415f1f0 con 0x7fb4b40b3e30 2024-04-15T15:33:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4ab400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb4b40b27c0 0x7fb4b415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4b3e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb4b415b5d0 0x7fb4b40b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49780/0 (socket says 172.21.15.73:49780) 2024-04-15T15:33:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4b3e00640 1 -- 172.21.15.73:0/1084099677 learned_addr learned my addr 172.21.15.73:0/1084099677 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4b9200640 1 --2- 172.21.15.73:0/1084099677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4b40b3e30 0x7fb4b40b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4ab400640 1 -- 172.21.15.73:0/1084099677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4b40b3e30 msgr2=0x7fb4b40b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4ab400640 1 --2- 172.21.15.73:0/1084099677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4b40b3e30 0x7fb4b40b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4ab400640 1 -- 172.21.15.73:0/1084099677 >> v1:172.21.15.73:6789/0 conn(0x7fb4b415b5d0 legacy=0x7fb4b40b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4ab400640 1 -- 172.21.15.73:0/1084099677 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b406fe80 con 0x7fb4b40b27c0 2024-04-15T15:33:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.300+0000 7fb4b3400640 1 -- 172.21.15.73:0/1084099677 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147655584 0 0) 0x7fb4b4070160 con 0x7fb4b415b5d0 2024-04-15T15:33:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4ab400640 1 --2- 172.21.15.73:0/1084099677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b27c0 0x7fb4b415fc90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009d90 tx=0x7fb49c01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fbd5a4871f08ad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4b3400640 1 -- 172.21.15.73:0/1084099677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c0b2070 con 0x7fb4b40b27c0 2024-04-15T15:33:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4b3400640 1 -- 172.21.15.73:0/1084099677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49c0a56e0 con 0x7fb4b40b27c0 2024-04-15T15:33:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4b3400640 1 -- 172.21.15.73:0/1084099677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c0a5ab0 con 0x7fb4b40b27c0 2024-04-15T15:33:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4bb200640 1 -- 172.21.15.73:0/1084099677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b27c0 msgr2=0x7fb4b415fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4bb200640 1 --2- 172.21.15.73:0/1084099677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b27c0 0x7fb4b415fc90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009d90 tx=0x7fb49c01c820 comp rx=0 tx=0).stop 2024-04-15T15:33:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4bb200640 1 -- 172.21.15.73:0/1084099677 shutdown_connections 2024-04-15T15:33:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4bb200640 1 --2- 172.21.15.73:0/1084099677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4b40b3e30 0x7fb4b40b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4bb200640 1 --2- 172.21.15.73:0/1084099677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b27c0 0x7fb4b415fc90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4bb200640 1 -- 172.21.15.73:0/1084099677 >> 172.21.15.73:0/1084099677 conn(0x7fb4b4067dd0 msgr2=0x7fb4b40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4bb200640 1 -- 172.21.15.73:0/1084099677 shutdown_connections 2024-04-15T15:33:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4bb200640 1 -- 172.21.15.73:0/1084099677 wait complete. 2024-04-15T15:33:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4bb200640 1 Processor -- start 2024-04-15T15:33:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.304+0000 7fb4bb200640 1 -- start start 2024-04-15T15:33:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4bb200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4b40b27c0 0x7fb4b41570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4bb200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b3e30 0x7fb4b41537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4bb200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4b415b5d0 0x7fb4b415df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4bb200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b406faa0 con 0x7fb4b40b3e30 2024-04-15T15:33:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4bb200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b40b4240 con 0x7fb4b415b5d0 2024-04-15T15:33:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4bb200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb4b406fc20 con 0x7fb4b40b27c0 2024-04-15T15:33:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4ab400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b3e30 0x7fb4b41537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4ab400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b3e30 0x7fb4b41537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51560/0 (socket says 172.21.15.73:51560) 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4ab400640 1 -- 172.21.15.73:0/2571578438 learned_addr learned my addr 172.21.15.73:0/2571578438 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4b3e00640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4b40b27c0 0x7fb4b41570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4b9200640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4b415b5d0 0x7fb4b415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4ab400640 1 -- 172.21.15.73:0/2571578438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4b40b27c0 msgr2=0x7fb4b41570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4ab400640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4b40b27c0 0x7fb4b41570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4ab400640 1 -- 172.21.15.73:0/2571578438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4b415b5d0 msgr2=0x7fb4b415df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4ab400640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4b415b5d0 0x7fb4b415df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4ab400640 1 -- 172.21.15.73:0/2571578438 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b4157760 con 0x7fb4b40b3e30 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4ab400640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b3e30 0x7fb4b41537e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0b0040 tx=0x7fb49c0195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4b0c00640 1 -- 172.21.15.73:0/2571578438 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c0b2050 con 0x7fb4b40b3e30 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4b0c00640 1 -- 172.21.15.73:0/2571578438 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49c0be070 con 0x7fb4b40b3e30 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4b0c00640 1 -- 172.21.15.73:0/2571578438 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c009450 con 0x7fb4b40b3e30 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4bb200640 1 -- 172.21.15.73:0/2571578438 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b4157a40 con 0x7fb4b40b3e30 2024-04-15T15:33:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4bb200640 1 -- 172.21.15.73:0/2571578438 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b4158000 con 0x7fb4b40b3e30 2024-04-15T15:33:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4bb200640 1 -- 172.21.15.73:0/2571578438 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b4068ab0 con 0x7fb4b40b3e30 2024-04-15T15:33:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.308+0000 7fb4b0c00640 1 -- 172.21.15.73:0/2571578438 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fb49c0ada50 con 0x7fb4b40b3e30 2024-04-15T15:33:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.312+0000 7fb4b0c00640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb490068410 0x7fb49006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.312+0000 7fb4b0c00640 1 -- 172.21.15.73:0/2571578438 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7fb49c121e70 con 0x7fb4b40b3e30 2024-04-15T15:33:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.312+0000 7fb4b3e00640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb490068410 0x7fb49006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.312+0000 7fb4b3e00640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb490068410 0x7fb49006a8d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4000f70 tx=0x7fb4a4007b60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.316+0000 7fb4b0c00640 1 -- 172.21.15.73:0/2571578438 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb49c016560 con 0x7fb4b40b3e30 2024-04-15T15:33:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.488+0000 7fb4bb200640 1 -- 172.21.15.73:0/2571578438 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4b40afce0 con 0x7fb4b40b3e30 2024-04-15T15:33:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.488+0000 7fb4b0c00640 1 -- 172.21.15.73:0/2571578438 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17041 (secure 0 0 0) 0x7fb49c0f22a0 con 0x7fb4b40b3e30 2024-04-15T15:33:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:19.491 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":42,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:33:14.628670+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6834/2635966606":"2024-04-16T15:33:09.602425+0000","172.21.15.118:6832/2635966606":"2024-04-16T15:33:09.602425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:33:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 -- 172.21.15.73:0/2571578438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb490068410 msgr2=0x7fb49006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb490068410 0x7fb49006a8d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4000f70 tx=0x7fb4a4007b60 comp rx=0 tx=0).stop 2024-04-15T15:33:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 -- 172.21.15.73:0/2571578438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b3e30 msgr2=0x7fb4b41537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b3e30 0x7fb4b41537e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0b0040 tx=0x7fb49c0195c0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 -- 172.21.15.73:0/2571578438 shutdown_connections 2024-04-15T15:33:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4b415b5d0 0x7fb4b415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4b40b3e30 0x7fb4b41537e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb490068410 0x7fb49006a8d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 --2- 172.21.15.73:0/2571578438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4b40b27c0 0x7fb4b41570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 -- 172.21.15.73:0/2571578438 >> 172.21.15.73:0/2571578438 conn(0x7fb4b4067dd0 msgr2=0x7fb4b40b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:19.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 -- 172.21.15.73:0/2571578438 shutdown_connections 2024-04-15T15:33:19.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.492+0000 7fb4bb200640 1 -- 172.21.15.73:0/2571578438 wait complete. 2024-04-15T15:33:19.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:32:46.793984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:32:48.072270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T15:33:19.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:33:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c9e00640 1 Processor -- start 2024-04-15T15:33:19.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c9e00640 1 -- start start 2024-04-15T15:33:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c9e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9c415c640 0x7fd9c40b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c9e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c40cede0 0x7fd9c40cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c9e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd9c406fdd0 0x7fd9c4070220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c9e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c40d1310 con 0x7fd9c415c640 2024-04-15T15:33:19.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c9e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c40cf780 con 0x7fd9c406fdd0 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c9e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c40d0e80 con 0x7fd9c40cede0 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c8a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9c415c640 0x7fd9c40b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c8a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9c415c640 0x7fd9c40b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51562/0 (socket says 172.21.15.73:51562) 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c8a00640 1 -- 172.21.15.73:0/1393426537 learned_addr learned my addr 172.21.15.73:0/1393426537 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c3e00640 1 --2- 172.21.15.73:0/1393426537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c40cede0 0x7fd9c40cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c9400640 1 --2- 172.21.15.73:0/1393426537 >> v2:172.21.15.118:3300/0 conn(0x7fd9c406fdd0 0x7fd9c4070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c8a00640 1 -- 172.21.15.73:0/1393426537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c40cede0 msgr2=0x7fd9c40cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c8a00640 1 --2- 172.21.15.73:0/1393426537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c40cede0 0x7fd9c40cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c8a00640 1 -- 172.21.15.73:0/1393426537 >> v2:172.21.15.118:3300/0 conn(0x7fd9c406fdd0 msgr2=0x7fd9c4070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c8a00640 1 --2- 172.21.15.73:0/1393426537 >> v2:172.21.15.118:3300/0 conn(0x7fd9c406fdd0 0x7fd9c4070220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c8a00640 1 -- 172.21.15.73:0/1393426537 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c415ca20 con 0x7fd9c415c640 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c3e00640 1 --2- 172.21.15.73:0/1393426537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c40cede0 0x7fd9c40cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:19.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.652+0000 7fd9c9400640 1 --2- 172.21.15.73:0/1393426537 >> v2:172.21.15.118:3300/0 conn(0x7fd9c406fdd0 0x7fd9c4070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:19.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c8a00640 1 --2- 172.21.15.73:0/1393426537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c415c640 0x7fd9c40b4710 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40b1b30 tx=0x7fd9b801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710b21cb5f84a386 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:19.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c3400640 1 -- 172.21.15.73:0/1393426537 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80aa610 con 0x7fd9c415c640 2024-04-15T15:33:19.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c3400640 1 -- 172.21.15.73:0/1393426537 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b80af070 con 0x7fd9c415c640 2024-04-15T15:33:19.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c3400640 1 -- 172.21.15.73:0/1393426537 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80aa9d0 con 0x7fd9c415c640 2024-04-15T15:33:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c9e00640 1 -- 172.21.15.73:0/1393426537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c415c640 msgr2=0x7fd9c40b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c9e00640 1 --2- 172.21.15.73:0/1393426537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c415c640 0x7fd9c40b4710 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40b1b30 tx=0x7fd9b801c4f0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c9e00640 1 -- 172.21.15.73:0/1393426537 shutdown_connections 2024-04-15T15:33:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c9e00640 1 --2- 172.21.15.73:0/1393426537 >> v2:172.21.15.118:3300/0 conn(0x7fd9c406fdd0 0x7fd9c4070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c9e00640 1 --2- 172.21.15.73:0/1393426537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c40cede0 0x7fd9c40cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c9e00640 1 --2- 172.21.15.73:0/1393426537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c415c640 0x7fd9c40b4710 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c9e00640 1 -- 172.21.15.73:0/1393426537 >> 172.21.15.73:0/1393426537 conn(0x7fd9c406ba50 msgr2=0x7fd9c406be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c9e00640 1 -- 172.21.15.73:0/1393426537 shutdown_connections 2024-04-15T15:33:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.656+0000 7fd9c9e00640 1 -- 172.21.15.73:0/1393426537 wait complete. 2024-04-15T15:33:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 Processor -- start 2024-04-15T15:33:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 -- start start 2024-04-15T15:33:19.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c406fdd0 0x7fd9c415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9c40cede0 0x7fd9c415f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c415c640 0x7fd9c415ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c4070b70 con 0x7fd9c406fdd0 2024-04-15T15:33:19.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c40d0b10 con 0x7fd9c40cede0 2024-04-15T15:33:19.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c40ceaa0 con 0x7fd9c415c640 2024-04-15T15:33:19.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c8a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c406fdd0 0x7fd9c415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c8a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c406fdd0 0x7fd9c415efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51566/0 (socket says 172.21.15.73:51566) 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c8a00640 1 -- 172.21.15.73:0/238187196 learned_addr learned my addr 172.21.15.73:0/238187196 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c3e00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9c40cede0 0x7fd9c415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9400640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c415c640 0x7fd9c415ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c8a00640 1 -- 172.21.15.73:0/238187196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c415c640 msgr2=0x7fd9c415ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c8a00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c415c640 0x7fd9c415ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c8a00640 1 -- 172.21.15.73:0/238187196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9c40cede0 msgr2=0x7fd9c415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c8a00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9c40cede0 0x7fd9c415f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c8a00640 1 -- 172.21.15.73:0/238187196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c415dc20 con 0x7fd9c406fdd0 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9400640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c415c640 0x7fd9c415ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c3e00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9c40cede0 0x7fd9c415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c8a00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c406fdd0 0x7fd9c415efe0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd9b801aba0 tx=0x7fd9b801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c0c00640 1 -- 172.21.15.73:0/238187196 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80bd5f0 con 0x7fd9c406fdd0 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c0c00640 1 -- 172.21.15.73:0/238187196 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b80bd790 con 0x7fd9c406fdd0 2024-04-15T15:33:19.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 -- 172.21.15.73:0/238187196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c415df00 con 0x7fd9c406fdd0 2024-04-15T15:33:19.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c0c00640 1 -- 172.21.15.73:0/238187196 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80bdb80 con 0x7fd9c406fdd0 2024-04-15T15:33:19.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 -- 172.21.15.73:0/238187196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c415e4c0 con 0x7fd9c406fdd0 2024-04-15T15:33:19.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.660+0000 7fd9c9e00640 1 -- 172.21.15.73:0/238187196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c404fd60 con 0x7fd9c406fdd0 2024-04-15T15:33:19.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.664+0000 7fd9c0c00640 1 -- 172.21.15.73:0/238187196 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fd9b80b33f0 con 0x7fd9c406fdd0 2024-04-15T15:33:19.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.664+0000 7fd9c0c00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd9a4068410 0x7fd9a406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.664+0000 7fd9c0c00640 1 -- 172.21.15.73:0/238187196 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7fd9b8121ae0 con 0x7fd9c406fdd0 2024-04-15T15:33:19.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.664+0000 7fd9c3e00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd9a4068410 0x7fd9a406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.664+0000 7fd9c3e00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd9a4068410 0x7fd9a406a8d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4166920 tx=0x7fd9b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:19.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.668+0000 7fd9c0c00640 1 -- 172.21.15.73:0/238187196 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd9b80c3060 con 0x7fd9c406fdd0 2024-04-15T15:33:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.824+0000 7fd9c9e00640 1 -- 172.21.15.73:0/238187196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd9c406dbd0 con 0x7fd9c406fdd0 2024-04-15T15:33:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.824+0000 7fd9c0c00640 1 -- 172.21.15.73:0/238187196 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7fd9b80a7070 con 0x7fd9c406fdd0 2024-04-15T15:33:19.827 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:33:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 -- 172.21.15.73:0/238187196 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd9a4068410 msgr2=0x7fd9a406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd9a4068410 0x7fd9a406a8d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4166920 tx=0x7fd9b0008040 comp rx=0 tx=0).stop 2024-04-15T15:33:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 -- 172.21.15.73:0/238187196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c406fdd0 msgr2=0x7fd9c415efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c406fdd0 0x7fd9c415efe0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd9b801aba0 tx=0x7fd9b801ad30 comp rx=0 tx=0).stop 2024-04-15T15:33:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 -- 172.21.15.73:0/238187196 shutdown_connections 2024-04-15T15:33:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd9a4068410 0x7fd9a406a8d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9c415c640 0x7fd9c415ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9c40cede0 0x7fd9c415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 --2- 172.21.15.73:0/238187196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9c406fdd0 0x7fd9c415efe0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 -- 172.21.15.73:0/238187196 >> 172.21.15.73:0/238187196 conn(0x7fd9c406ba50 msgr2=0x7fd9c406cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 -- 172.21.15.73:0/238187196 shutdown_connections 2024-04-15T15:33:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.828+0000 7fd9c9e00640 1 -- 172.21.15.73:0/238187196 wait complete. 2024-04-15T15:33:19.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:33:19.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f4845200640 1 Processor -- start 2024-04-15T15:33:19.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f4845200640 1 -- start start 2024-04-15T15:33:19.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f4845200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48400b27c0 0x7f484015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f4845200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48400b3e30 0x7f48400b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f4845200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4840070160 con 0x7f484015b5d0 2024-04-15T15:33:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f4845200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f484015b9b0 con 0x7f48400b3e30 2024-04-15T15:33:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f4845200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f484015f1f0 con 0x7f48400b27c0 2024-04-15T15:33:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483de00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f484015b5d0 0x7f48400b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49796/0 (socket says 172.21.15.73:49796) 2024-04-15T15:33:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483de00640 1 -- 172.21.15.73:0/2936665496 learned_addr learned my addr 172.21.15.73:0/2936665496 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483e800640 1 --2- 172.21.15.73:0/2936665496 >> v2:172.21.15.73:3300/0 conn(0x7f48400b3e30 0x7f48400b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483ca00640 1 -- 172.21.15.73:0/2936665496 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993541542 0 0) 0x7f4840070160 con 0x7f484015b5d0 2024-04-15T15:33:19.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483d400640 1 --2- 172.21.15.73:0/2936665496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48400b27c0 0x7f484015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483ca00640 1 -- 172.21.15.73:0/2936665496 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4824003530 con 0x7f484015b5d0 2024-04-15T15:33:19.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483e800640 1 -- 172.21.15.73:0/2936665496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48400b27c0 msgr2=0x7f484015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:19.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483e800640 1 --2- 172.21.15.73:0/2936665496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48400b27c0 0x7f484015fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483e800640 1 -- 172.21.15.73:0/2936665496 >> v1:172.21.15.73:6789/0 conn(0x7f484015b5d0 legacy=0x7f48400b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483e800640 1 -- 172.21.15.73:0/2936665496 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484006fe80 con 0x7f48400b3e30 2024-04-15T15:33:19.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.984+0000 7f483d400640 1 --2- 172.21.15.73:0/2936665496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48400b27c0 0x7f484015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f483e800640 1 --2- 172.21.15.73:0/2936665496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b3e30 0x7f48400b4740 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4838009d90 tx=0x7f483801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4162a36860570e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f483ca00640 1 -- 172.21.15.73:0/2936665496 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48380b2070 con 0x7f48400b3e30 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f483ca00640 1 -- 172.21.15.73:0/2936665496 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48380a56e0 con 0x7f48400b3e30 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f483ca00640 1 -- 172.21.15.73:0/2936665496 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48380a5ab0 con 0x7f48400b3e30 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f4845200640 1 -- 172.21.15.73:0/2936665496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b3e30 msgr2=0x7f48400b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f4845200640 1 --2- 172.21.15.73:0/2936665496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b3e30 0x7f48400b4740 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4838009d90 tx=0x7f483801c820 comp rx=0 tx=0).stop 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f4845200640 1 -- 172.21.15.73:0/2936665496 shutdown_connections 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f4845200640 1 --2- 172.21.15.73:0/2936665496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48400b27c0 0x7f484015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f4845200640 1 --2- 172.21.15.73:0/2936665496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b3e30 0x7f48400b4740 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f4845200640 1 -- 172.21.15.73:0/2936665496 >> 172.21.15.73:0/2936665496 conn(0x7f4840067dd0 msgr2=0x7f48400d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f4845200640 1 -- 172.21.15.73:0/2936665496 shutdown_connections 2024-04-15T15:33:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.988+0000 7f4845200640 1 -- 172.21.15.73:0/2936665496 wait complete. 2024-04-15T15:33:19.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4845200640 1 Processor -- start 2024-04-15T15:33:19.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4845200640 1 -- start start 2024-04-15T15:33:19.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4845200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b27c0 0x7f484014b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4845200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48400b3e30 0x7f48401f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4845200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f484015b5d0 0x7f48401656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4845200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f484006faa0 con 0x7f48400b27c0 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4845200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f48400cfd00 con 0x7f48400b3e30 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4845200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f484006fc20 con 0x7f484015b5d0 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b27c0 0x7f484014b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b27c0 0x7f484014b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51578/0 (socket says 172.21.15.73:51578) 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483de00640 1 -- 172.21.15.73:0/2040189425 learned_addr learned my addr 172.21.15.73:0/2040189425 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483d400640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48400b3e30 0x7f48401f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483e800640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f484015b5d0 0x7f48401656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483de00640 1 -- 172.21.15.73:0/2040189425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f484015b5d0 msgr2=0x7f48401656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483de00640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f484015b5d0 0x7f48401656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483de00640 1 -- 172.21.15.73:0/2040189425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48400b3e30 msgr2=0x7f48401f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483de00640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48400b3e30 0x7f48401f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483de00640 1 -- 172.21.15.73:0/2040189425 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4840150840 con 0x7f48400b27c0 2024-04-15T15:33:19.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f483de00640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b27c0 0x7f484014b780 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f483000c450 tx=0x7f483000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:19.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4836000640 1 -- 172.21.15.73:0/2040189425 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830017070 con 0x7f48400b27c0 2024-04-15T15:33:19.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4836000640 1 -- 172.21.15.73:0/2040189425 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4830005cf0 con 0x7f48400b27c0 2024-04-15T15:33:19.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4836000640 1 -- 172.21.15.73:0/2040189425 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830007290 con 0x7f48400b27c0 2024-04-15T15:33:19.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4845200640 1 -- 172.21.15.73:0/2040189425 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4840150b20 con 0x7f48400b27c0 2024-04-15T15:33:19.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.992+0000 7f4845200640 1 -- 172.21.15.73:0/2040189425 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48401510e0 con 0x7f48400b27c0 2024-04-15T15:33:19.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.996+0000 7f4845200640 1 -- 172.21.15.73:0/2040189425 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4840068ab0 con 0x7f48400b27c0 2024-04-15T15:33:19.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.996+0000 7f4836000640 1 -- 172.21.15.73:0/2040189425 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f483001a070 con 0x7f48400b27c0 2024-04-15T15:33:19.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.996+0000 7f4836000640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4820068410 0x7f482006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:19.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.996+0000 7f4836000640 1 -- 172.21.15.73:0/2040189425 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f4830085f20 con 0x7f48400b27c0 2024-04-15T15:33:19.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.996+0000 7f483d400640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4820068410 0x7f482006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:19.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:19.996+0000 7f483d400640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4820068410 0x7f482006a8d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f482c006fd0 tx=0x7f482c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:20.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.000+0000 7f4836000640 1 -- 172.21.15.73:0/2040189425 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4830056380 con 0x7f48400b27c0 2024-04-15T15:33:20.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.156+0000 7f4845200640 1 -- 172.21.15.73:0/2040189425 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f484006f370 con 0x7f48400b27c0 2024-04-15T15:33:20.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.156+0000 7f4836000640 1 -- 172.21.15.73:0/2040189425 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) ==== 104+0+11 (secure 0 0 0) 0x7f4830055c80 con 0x7f48400b27c0 2024-04-15T15:33:20.158 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:33:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 -- 172.21.15.73:0/2040189425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4820068410 msgr2=0x7f482006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4820068410 0x7f482006a8d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f482c006fd0 tx=0x7f482c008040 comp rx=0 tx=0).stop 2024-04-15T15:33:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 -- 172.21.15.73:0/2040189425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b27c0 msgr2=0x7f484014b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b27c0 0x7f484014b780 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f483000c450 tx=0x7f483000c910 comp rx=0 tx=0).stop 2024-04-15T15:33:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 -- 172.21.15.73:0/2040189425 shutdown_connections 2024-04-15T15:33:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4820068410 0x7f482006a8d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f484015b5d0 0x7f48401656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48400b3e30 0x7f48401f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 --2- 172.21.15.73:0/2040189425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48400b27c0 0x7f484014b780 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 -- 172.21.15.73:0/2040189425 >> 172.21.15.73:0/2040189425 conn(0x7f4840067dd0 msgr2=0x7f48400cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 -- 172.21.15.73:0/2040189425 shutdown_connections 2024-04-15T15:33:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.160+0000 7f4845200640 1 -- 172.21.15.73:0/2040189425 wait complete. 2024-04-15T15:33:20.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:33:20.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8530c00640 1 Processor -- start 2024-04-15T15:33:20.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8530c00640 1 -- start start 2024-04-15T15:33:20.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8530c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f852c0b38d0 0x7f852c09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8530c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f852c0d16c0 0x7f852c1625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8530c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f852c162b20 0x7f852c15e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8530c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f852c09b140 con 0x7f852c0b38d0 2024-04-15T15:33:20.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8530c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f852c09b420 con 0x7f852c0d16c0 2024-04-15T15:33:20.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8530c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f852c09b700 con 0x7f852c162b20 2024-04-15T15:33:20.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8529e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f852c0b38d0 0x7f852c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:20.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8529e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f852c0b38d0 0x7f852c09aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51586/0 (socket says 172.21.15.73:51586) 2024-04-15T15:33:20.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8529e00640 1 -- 172.21.15.73:0/119294726 learned_addr learned my addr 172.21.15.73:0/119294726 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:20.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8529e00640 1 -- 172.21.15.73:0/119294726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f852c162b20 msgr2=0x7f852c15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:20.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8529e00640 1 --2- 172.21.15.73:0/119294726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f852c162b20 0x7f852c15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8529e00640 1 -- 172.21.15.73:0/119294726 >> v2:172.21.15.118:3300/0 conn(0x7f852c0d16c0 msgr2=0x7f852c1625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:20.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8529e00640 1 --2- 172.21.15.73:0/119294726 >> v2:172.21.15.118:3300/0 conn(0x7f852c0d16c0 0x7f852c1625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.316+0000 7f8529e00640 1 -- 172.21.15.73:0/119294726 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c09b9e0 con 0x7f852c0b38d0 2024-04-15T15:33:20.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8529e00640 1 --2- 172.21.15.73:0/119294726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0b38d0 0x7f852c09aa60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f852c073600 tx=0x7f851c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b239f04d2b8d73 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:20.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8528a00640 1 -- 172.21.15.73:0/119294726 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c0a5670 con 0x7f852c0b38d0 2024-04-15T15:33:20.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8528a00640 1 -- 172.21.15.73:0/119294726 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f851c0a5810 con 0x7f852c0b38d0 2024-04-15T15:33:20.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8528a00640 1 -- 172.21.15.73:0/119294726 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c0a5be0 con 0x7f852c0b38d0 2024-04-15T15:33:20.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8530c00640 1 -- 172.21.15.73:0/119294726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0b38d0 msgr2=0x7f852c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8530c00640 1 --2- 172.21.15.73:0/119294726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0b38d0 0x7f852c09aa60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f852c073600 tx=0x7f851c01c9f0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8530c00640 1 -- 172.21.15.73:0/119294726 shutdown_connections 2024-04-15T15:33:20.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8530c00640 1 --2- 172.21.15.73:0/119294726 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f852c162b20 0x7f852c15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8530c00640 1 --2- 172.21.15.73:0/119294726 >> v2:172.21.15.118:3300/0 conn(0x7f852c0d16c0 0x7f852c1625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8530c00640 1 --2- 172.21.15.73:0/119294726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0b38d0 0x7f852c09aa60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8530c00640 1 -- 172.21.15.73:0/119294726 >> 172.21.15.73:0/119294726 conn(0x7f852c0b4080 msgr2=0x7f852c0b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:20.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8530c00640 1 -- 172.21.15.73:0/119294726 shutdown_connections 2024-04-15T15:33:20.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.320+0000 7f8530c00640 1 -- 172.21.15.73:0/119294726 wait complete. 2024-04-15T15:33:20.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8530c00640 1 Processor -- start 2024-04-15T15:33:20.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8530c00640 1 -- start start 2024-04-15T15:33:20.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8530c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f852c0b38d0 0x7f852c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8530c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0d16c0 0x7f852c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8530c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f852c162b20 0x7f852c158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8530c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f852c06d100 con 0x7f852c0d16c0 2024-04-15T15:33:20.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8530c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f852c06cf80 con 0x7f852c0b38d0 2024-04-15T15:33:20.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8530c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f852c06d280 con 0x7f852c162b20 2024-04-15T15:33:20.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0d16c0 0x7f852c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:20.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0d16c0 0x7f852c0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51594/0 (socket says 172.21.15.73:51594) 2024-04-15T15:33:20.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529400640 1 -- 172.21.15.73:0/112805222 learned_addr learned my addr 172.21.15.73:0/112805222 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:20.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529e00640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f852c0b38d0 0x7f852c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:20.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f852a800640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f852c162b20 0x7f852c158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:20.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529400640 1 -- 172.21.15.73:0/112805222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f852c162b20 msgr2=0x7f852c158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529400640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f852c162b20 0x7f852c158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529400640 1 -- 172.21.15.73:0/112805222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f852c0b38d0 msgr2=0x7f852c0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529400640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f852c0b38d0 0x7f852c0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529400640 1 -- 172.21.15.73:0/112805222 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c159ef0 con 0x7f852c0d16c0 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529e00640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f852c0b38d0 0x7f852c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8529400640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0d16c0 0x7f852c0cf550 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f851800b550 tx=0x7f851800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8522000640 1 -- 172.21.15.73:0/112805222 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518014070 con 0x7f852c0d16c0 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8522000640 1 -- 172.21.15.73:0/112805222 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8518010610 con 0x7f852c0d16c0 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8522000640 1 -- 172.21.15.73:0/112805222 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85180109e0 con 0x7f852c0d16c0 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8530c00640 1 -- 172.21.15.73:0/112805222 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852c15a1d0 con 0x7f852c0d16c0 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.324+0000 7f8530c00640 1 -- 172.21.15.73:0/112805222 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852c14fa70 con 0x7f852c0d16c0 2024-04-15T15:33:20.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.328+0000 7f8530c00640 1 -- 172.21.15.73:0/112805222 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f852c068ab0 con 0x7f852c0d16c0 2024-04-15T15:33:20.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.328+0000 7f8522000640 1 -- 172.21.15.73:0/112805222 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f8518017070 con 0x7f852c0d16c0 2024-04-15T15:33:20.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.328+0000 7f8522000640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f850c068410 0x7f850c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.328+0000 7f8522000640 1 -- 172.21.15.73:0/112805222 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f85180865e0 con 0x7f852c0d16c0 2024-04-15T15:33:20.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.328+0000 7f8529e00640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f850c068410 0x7f850c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:20.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.328+0000 7f8529e00640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f850c068410 0x7f850c06a8d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f851c0ae000 tx=0x7f851c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:20.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.332+0000 7f8522000640 1 -- 172.21.15.73:0/112805222 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8518056a40 con 0x7f852c0d16c0 2024-04-15T15:33:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 -- 172.21.15.73:0/112805222 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f852c0b4ce0 con 0x7f852c0d16c0 2024-04-15T15:33:20.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8522000640 1 -- 172.21.15.73:0/112805222 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) ==== 100+0+11 (secure 0 0 0) 0x7f8518056340 con 0x7f852c0d16c0 2024-04-15T15:33:20.493 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:33:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 -- 172.21.15.73:0/112805222 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f850c068410 msgr2=0x7f850c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f850c068410 0x7f850c06a8d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f851c0ae000 tx=0x7f851c0a7070 comp rx=0 tx=0).stop 2024-04-15T15:33:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 -- 172.21.15.73:0/112805222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0d16c0 msgr2=0x7f852c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0d16c0 0x7f852c0cf550 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f851800b550 tx=0x7f851800ba10 comp rx=0 tx=0).stop 2024-04-15T15:33:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 -- 172.21.15.73:0/112805222 shutdown_connections 2024-04-15T15:33:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f850c068410 0x7f850c06a8d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f852c162b20 0x7f852c158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f852c0d16c0 0x7f852c0cf550 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 --2- 172.21.15.73:0/112805222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f852c0b38d0 0x7f852c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 -- 172.21.15.73:0/112805222 >> 172.21.15.73:0/112805222 conn(0x7f852c0b4080 msgr2=0x7f852c1568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 -- 172.21.15.73:0/112805222 shutdown_connections 2024-04-15T15:33:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.492+0000 7f8530c00640 1 -- 172.21.15.73:0/112805222 wait complete. 2024-04-15T15:33:20.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:33:20.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18c4c00640 1 Processor -- start 2024-04-15T15:33:20.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18c4c00640 1 -- start start 2024-04-15T15:33:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18c4c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f18c00b17a0 0x7f18c00d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18c4c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c00d1000 con 0x7f18c006dad0 2024-04-15T15:33:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18c4c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c00d12e0 con 0x7f18c009b170 2024-04-15T15:33:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18c4c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f18c00d15c0 con 0x7f18c00b17a0 2024-04-15T15:33:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18bde00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f18c00b17a0 0x7f18c00d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18b7e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f18c006dad0 0x7f18c009aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49804/0 (socket says 172.21.15.73:49804) 2024-04-15T15:33:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18b7e00640 1 -- 172.21.15.73:0/1666921780 learned_addr learned my addr 172.21.15.73:0/1666921780 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:20.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18bde00640 1 -- 172.21.15.73:0/1666921780 >> v1:172.21.15.118:6789/0 conn(0x7f18c009b170 legacy=0x7f18c015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18bde00640 1 -- 172.21.15.73:0/1666921780 >> v1:172.21.15.73:6789/0 conn(0x7f18c006dad0 legacy=0x7f18c009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.652+0000 7f18bde00640 1 -- 172.21.15.73:0/1666921780 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c00d18a0 con 0x7f18c00b17a0 2024-04-15T15:33:20.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18bde00640 1 --2- 172.21.15.73:0/1666921780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c00b17a0 0x7f18c00d08b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f18b00097a0 tx=0x7f18b001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315b9a3c2467ff45 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:20.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18bd400640 1 -- 172.21.15.73:0/1666921780 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b1070 con 0x7f18c00b17a0 2024-04-15T15:33:20.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18bd400640 1 -- 172.21.15.73:0/1666921780 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b00ac5f0 con 0x7f18c00b17a0 2024-04-15T15:33:20.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18bd400640 1 -- 172.21.15.73:0/1666921780 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00ac9c0 con 0x7f18c00b17a0 2024-04-15T15:33:20.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18c4c00640 1 -- 172.21.15.73:0/1666921780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c00b17a0 msgr2=0x7f18c00d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18c4c00640 1 --2- 172.21.15.73:0/1666921780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c00b17a0 0x7f18c00d08b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f18b00097a0 tx=0x7f18b001c480 comp rx=0 tx=0).stop 2024-04-15T15:33:20.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18c4c00640 1 -- 172.21.15.73:0/1666921780 shutdown_connections 2024-04-15T15:33:20.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18c4c00640 1 --2- 172.21.15.73:0/1666921780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c00b17a0 0x7f18c00d08b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18c4c00640 1 -- 172.21.15.73:0/1666921780 >> 172.21.15.73:0/1666921780 conn(0x7f18c00b3fe0 msgr2=0x7f18c00b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:20.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18c4c00640 1 -- 172.21.15.73:0/1666921780 shutdown_connections 2024-04-15T15:33:20.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.656+0000 7f18c4c00640 1 -- 172.21.15.73:0/1666921780 wait complete. 2024-04-15T15:33:20.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 Processor -- start 2024-04-15T15:33:20.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 -- start start 2024-04-15T15:33:20.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c006dad0 0x7f18c015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18c009b170 0x7f18c015b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18c00b17a0 0x7f18c00c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f18c006e060 con 0x7f18c006dad0 2024-04-15T15:33:20.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f18c006dee0 con 0x7f18c00b17a0 2024-04-15T15:33:20.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f18c016d0a0 con 0x7f18c009b170 2024-04-15T15:33:20.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18bde00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c006dad0 0x7f18c015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:20.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18bde00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c006dad0 0x7f18c015d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51620/0 (socket says 172.21.15.73:51620) 2024-04-15T15:33:20.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18bde00640 1 -- 172.21.15.73:0/2972122377 learned_addr learned my addr 172.21.15.73:0/2972122377 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18b7e00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18c009b170 0x7f18c015b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18be800640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18c00b17a0 0x7f18c00c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18bde00640 1 -- 172.21.15.73:0/2972122377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18c009b170 msgr2=0x7f18c015b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18bde00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18c009b170 0x7f18c015b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18bde00640 1 -- 172.21.15.73:0/2972122377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18c00b17a0 msgr2=0x7f18c00c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18bde00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18c00b17a0 0x7f18c00c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18bde00640 1 -- 172.21.15.73:0/2972122377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c015a130 con 0x7f18c006dad0 2024-04-15T15:33:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18be800640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18c00b17a0 0x7f18c00c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18bde00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c006dad0 0x7f18c015d7c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f18b00af040 tx=0x7f18b001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:20.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18b6000640 1 -- 172.21.15.73:0/2972122377 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00bc020 con 0x7f18c006dad0 2024-04-15T15:33:20.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18b6000640 1 -- 172.21.15.73:0/2972122377 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b00b2040 con 0x7f18c006dad0 2024-04-15T15:33:20.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18b6000640 1 -- 172.21.15.73:0/2972122377 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b1050 con 0x7f18c006dad0 2024-04-15T15:33:20.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 -- 172.21.15.73:0/2972122377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c00b6ba0 con 0x7f18c006dad0 2024-04-15T15:33:20.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 -- 172.21.15.73:0/2972122377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c00b7160 con 0x7f18c006dad0 2024-04-15T15:33:20.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.660+0000 7f18c4c00640 1 -- 172.21.15.73:0/2972122377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c0068ab0 con 0x7f18c006dad0 2024-04-15T15:33:20.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.664+0000 7f18b6000640 1 -- 172.21.15.73:0/2972122377 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f18b00bf070 con 0x7f18c006dad0 2024-04-15T15:33:20.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.664+0000 7f18b6000640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f189c068410 0x7f189c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:20.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.664+0000 7f18b6000640 1 -- 172.21.15.73:0/2972122377 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f18b01204e0 con 0x7f18c006dad0 2024-04-15T15:33:20.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.664+0000 7f18b7e00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f189c068410 0x7f189c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:20.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.664+0000 7f18b7e00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f189c068410 0x7f189c06a8d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f18c00b7c10 tx=0x7f18a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:20.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.668+0000 7f18b6000640 1 -- 172.21.15.73:0/2972122377 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18b00a9070 con 0x7f18c006dad0 2024-04-15T15:33:20.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.836+0000 7f18c4c00640 1 -- 172.21.15.73:0/2972122377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f18c00d22b0 con 0x7f18c006dad0 2024-04-15T15:33:20.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.836+0000 7f18b6000640 1 -- 172.21.15.73:0/2972122377 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v42) ==== 80+0+124 (secure 0 0 0) 0x7f18b0016070 con 0x7f18c006dad0 2024-04-15T15:33:20.840 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.118:6834/2635966606 2024-04-16T15:33:09.602425+0000 2024-04-15T15:33:20.840 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.118:6832/2635966606 2024-04-16T15:33:09.602425+0000 2024-04-15T15:33:20.840 INFO:teuthology.orchestra.run.smithi073.stderr:listed 2 entries 2024-04-15T15:33:20.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 -- 172.21.15.73:0/2972122377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f189c068410 msgr2=0x7f189c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f189c068410 0x7f189c06a8d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f18c00b7c10 tx=0x7f18a8009040 comp rx=0 tx=0).stop 2024-04-15T15:33:20.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 -- 172.21.15.73:0/2972122377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c006dad0 msgr2=0x7f18c015d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:20.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c006dad0 0x7f18c015d7c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f18b00af040 tx=0x7f18b001acc0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 -- 172.21.15.73:0/2972122377 shutdown_connections 2024-04-15T15:33:20.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18c00b17a0 0x7f18c00c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f189c068410 0x7f189c06a8d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18c009b170 0x7f18c015b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 --2- 172.21.15.73:0/2972122377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18c006dad0 0x7f18c015d7c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:20.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 -- 172.21.15.73:0/2972122377 >> 172.21.15.73:0/2972122377 conn(0x7f18c00b3fe0 msgr2=0x7f18c00af140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:20.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 -- 172.21.15.73:0/2972122377 shutdown_connections 2024-04-15T15:33:20.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:20.840+0000 7f18c4c00640 1 -- 172.21.15.73:0/2972122377 wait complete. 2024-04-15T15:33:20.861 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-15T15:33:20.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:20.861 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.2 2024-04-15T15:33:20.888 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:33:20.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:20.888 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-15T15:33:20.944 INFO:tasks.cephfs.mount:Terminating background process 2024-04-15T15:33:20.944 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:33:20.944 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:20.954 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:33:20.954 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:21.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:33:21.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad9f200640 1 Processor -- start 2024-04-15T15:33:21.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad9f200640 1 -- start start 2024-04-15T15:33:21.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad9f200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fad9815b5d0 0x7fad9815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad9f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad980b3e30 0x7fad980b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad9f200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad98070160 con 0x7fad980b25f0 2024-04-15T15:33:21.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad9f200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fad9815b9b0 con 0x7fad9815b5d0 2024-04-15T15:33:21.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad9f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fad9815f1f0 con 0x7fad980b3e30 2024-04-15T15:33:21.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad9d200640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fad980b25f0 0x7fad980b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49808/0 (socket says 172.21.15.73:49808) 2024-04-15T15:33:21.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad97e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fad9815b5d0 0x7fad9815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad9d200640 1 -- 172.21.15.73:0/290246141 learned_addr learned my addr 172.21.15.73:0/290246141 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:21.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad8f400640 1 --2- 172.21.15.73:0/290246141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad980b3e30 0x7fad980b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad97e00640 1 -- 172.21.15.73:0/290246141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad980b3e30 msgr2=0x7fad980b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:21.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad97e00640 1 --2- 172.21.15.73:0/290246141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad980b3e30 0x7fad980b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad97e00640 1 -- 172.21.15.73:0/290246141 >> v1:172.21.15.73:6789/0 conn(0x7fad980b25f0 legacy=0x7fad980b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad97e00640 1 -- 172.21.15.73:0/290246141 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9806fe80 con 0x7fad9815b5d0 2024-04-15T15:33:21.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad97400640 1 -- 172.21.15.73:0/290246141 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012037930 0 0) 0x7fad98070160 con 0x7fad980b25f0 2024-04-15T15:33:21.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.140+0000 7fad8f400640 1 --2- 172.21.15.73:0/290246141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad980b3e30 0x7fad980b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:21.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad97e00640 1 --2- 172.21.15.73:0/290246141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad9815b5d0 0x7fad9815fc90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fad880097c0 tx=0x7fad8801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1a8d8e161de9b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:21.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad97400640 1 -- 172.21.15.73:0/290246141 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad880b0070 con 0x7fad9815b5d0 2024-04-15T15:33:21.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad97400640 1 -- 172.21.15.73:0/290246141 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad880ab600 con 0x7fad9815b5d0 2024-04-15T15:33:21.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad97400640 1 -- 172.21.15.73:0/290246141 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad880ab9d0 con 0x7fad9815b5d0 2024-04-15T15:33:21.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad9f200640 1 -- 172.21.15.73:0/290246141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad9815b5d0 msgr2=0x7fad9815fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad9f200640 1 --2- 172.21.15.73:0/290246141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad9815b5d0 0x7fad9815fc90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fad880097c0 tx=0x7fad8801c350 comp rx=0 tx=0).stop 2024-04-15T15:33:21.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad9f200640 1 -- 172.21.15.73:0/290246141 shutdown_connections 2024-04-15T15:33:21.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad9f200640 1 --2- 172.21.15.73:0/290246141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad980b3e30 0x7fad980b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad9f200640 1 --2- 172.21.15.73:0/290246141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad9815b5d0 0x7fad9815fc90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad9f200640 1 -- 172.21.15.73:0/290246141 >> 172.21.15.73:0/290246141 conn(0x7fad98067dd0 msgr2=0x7fad980d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:21.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad9f200640 1 -- 172.21.15.73:0/290246141 shutdown_connections 2024-04-15T15:33:21.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.144+0000 7fad9f200640 1 -- 172.21.15.73:0/290246141 wait complete. 2024-04-15T15:33:21.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9f200640 1 Processor -- start 2024-04-15T15:33:21.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9f200640 1 -- start start 2024-04-15T15:33:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad980b25f0 0x7fad980aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b3e30 0x7fad980ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad9815b5d0 0x7fad980aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9f200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fad980b4390 con 0x7fad980b3e30 2024-04-15T15:33:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fad980b4210 con 0x7fad980b25f0 2024-04-15T15:33:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fad9806faa0 con 0x7fad9815b5d0 2024-04-15T15:33:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad8f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b3e30 0x7fad980ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad8f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b3e30 0x7fad980ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51646/0 (socket says 172.21.15.73:51646) 2024-04-15T15:33:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad8f400640 1 -- 172.21.15.73:0/1281903416 learned_addr learned my addr 172.21.15.73:0/1281903416 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9d200640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad9815b5d0 0x7fad980aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad97e00640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad980b25f0 0x7fad980aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad8f400640 1 -- 172.21.15.73:0/1281903416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad9815b5d0 msgr2=0x7fad980aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad8f400640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad9815b5d0 0x7fad980aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad8f400640 1 -- 172.21.15.73:0/1281903416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad980b25f0 msgr2=0x7fad980aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad8f400640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad980b25f0 0x7fad980aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad8f400640 1 -- 172.21.15.73:0/1281903416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad980ab460 con 0x7fad980b3e30 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad8f400640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b3e30 0x7fad980ae5a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fad8000c7f0 tx=0x7fad8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad94c00640 1 -- 172.21.15.73:0/1281903416 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80015070 con 0x7fad980b3e30 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad94c00640 1 -- 172.21.15.73:0/1281903416 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad80007820 con 0x7fad980b3e30 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9f200640 1 -- 172.21.15.73:0/1281903416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad980ab700 con 0x7fad980b3e30 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad94c00640 1 -- 172.21.15.73:0/1281903416 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80007c10 con 0x7fad980b3e30 2024-04-15T15:33:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.148+0000 7fad9f200640 1 -- 172.21.15.73:0/1281903416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad980abcc0 con 0x7fad980b3e30 2024-04-15T15:33:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.152+0000 7fad9f200640 1 -- 172.21.15.73:0/1281903416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad98068ab0 con 0x7fad980b3e30 2024-04-15T15:33:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.152+0000 7fad94c00640 1 -- 172.21.15.73:0/1281903416 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fad80018070 con 0x7fad980b3e30 2024-04-15T15:33:21.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.152+0000 7fad94c00640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fad74068410 0x7fad7406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.152+0000 7fad94c00640 1 -- 172.21.15.73:0/1281903416 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7fad80086fc0 con 0x7fad980b3e30 2024-04-15T15:33:21.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.152+0000 7fad97e00640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fad74068410 0x7fad7406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.152+0000 7fad97e00640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fad74068410 0x7fad7406a8d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fad880ad000 tx=0x7fad88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:21.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.156+0000 7fad94c00640 1 -- 172.21.15.73:0/1281903416 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad80057180 con 0x7fad980b3e30 2024-04-15T15:33:21.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.312+0000 7fad9f200640 1 -- 172.21.15.73:0/1281903416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad980b3590 con 0x7fad980b3e30 2024-04-15T15:33:21.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad94c00640 1 -- 172.21.15.73:0/1281903416 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17041 (secure 0 0 0) 0x7fad80056a80 con 0x7fad980b3e30 2024-04-15T15:33:21.316 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:21.316 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":42,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:33:14.628670+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6834/2635966606":"2024-04-16T15:33:09.602425+0000","172.21.15.118:6832/2635966606":"2024-04-16T15:33:09.602425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:33:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 -- 172.21.15.73:0/1281903416 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fad74068410 msgr2=0x7fad7406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fad74068410 0x7fad7406a8d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fad880ad000 tx=0x7fad88008040 comp rx=0 tx=0).stop 2024-04-15T15:33:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 -- 172.21.15.73:0/1281903416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b3e30 msgr2=0x7fad980ae5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b3e30 0x7fad980ae5a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fad8000c7f0 tx=0x7fad8000ccb0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 -- 172.21.15.73:0/1281903416 shutdown_connections 2024-04-15T15:33:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fad74068410 0x7fad7406a8d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad9815b5d0 0x7fad980aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b3e30 0x7fad980ae5a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 --2- 172.21.15.73:0/1281903416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad980b25f0 0x7fad980aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 -- 172.21.15.73:0/1281903416 >> 172.21.15.73:0/1281903416 conn(0x7fad98067dd0 msgr2=0x7fad9815db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 -- 172.21.15.73:0/1281903416 shutdown_connections 2024-04-15T15:33:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.316+0000 7fad9f200640 1 -- 172.21.15.73:0/1281903416 wait complete. 2024-04-15T15:33:21.337 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:32:46.793984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:32:48.072270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T15:33:21.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:33:21.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4fff200640 1 Processor -- start 2024-04-15T15:33:21.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4fff200640 1 -- start start 2024-04-15T15:33:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4fff200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4ff8146110 0x7f4ff80cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4fff200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4ff80b20b0 0x7f4ff80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4fff200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff80cd3a0 con 0x7f4ff8071e10 2024-04-15T15:33:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4fff200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff80b5160 con 0x7f4ff80b20b0 2024-04-15T15:33:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4fff200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff80b40c0 con 0x7f4ff8146110 2024-04-15T15:33:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4ff7400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4ff80b20b0 0x7f4ff80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4ffd200640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4ff8071e10 0x7f4ff8072260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49812/0 (socket says 172.21.15.73:49812) 2024-04-15T15:33:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4ffd200640 1 -- 172.21.15.73:0/2840321690 learned_addr learned my addr 172.21.15.73:0/2840321690 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4ff7e00640 1 --2- 172.21.15.73:0/2840321690 >> v2:172.21.15.118:3300/0 conn(0x7f4ff8146110 0x7f4ff80cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4ff7400640 1 -- 172.21.15.73:0/2840321690 >> v2:172.21.15.118:3300/0 conn(0x7f4ff8146110 msgr2=0x7f4ff80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4ff7400640 1 --2- 172.21.15.73:0/2840321690 >> v2:172.21.15.118:3300/0 conn(0x7f4ff8146110 0x7f4ff80cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4ff7400640 1 -- 172.21.15.73:0/2840321690 >> v1:172.21.15.73:6789/0 conn(0x7f4ff8071e10 legacy=0x7f4ff8072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4ff7400640 1 -- 172.21.15.73:0/2840321690 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff80b43a0 con 0x7f4ff80b20b0 2024-04-15T15:33:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.476+0000 7f4ff6a00640 1 -- 172.21.15.73:0/2840321690 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1549402109 0 0) 0x7f4ff80cd3a0 con 0x7f4ff8071e10 2024-04-15T15:33:21.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4ff7400640 1 --2- 172.21.15.73:0/2840321690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 0x7f4ff80b2530 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80cd570 tx=0x7f4fe401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f064fc532cd824 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:21.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4ff6a00640 1 -- 172.21.15.73:0/2840321690 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40b0070 con 0x7f4ff80b20b0 2024-04-15T15:33:21.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4ff6a00640 1 -- 172.21.15.73:0/2840321690 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe4004230 con 0x7f4ff80b20b0 2024-04-15T15:33:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4ff6a00640 1 -- 172.21.15.73:0/2840321690 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4003620 con 0x7f4ff80b20b0 2024-04-15T15:33:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4fff200640 1 -- 172.21.15.73:0/2840321690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 msgr2=0x7f4ff80b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4fff200640 1 --2- 172.21.15.73:0/2840321690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 0x7f4ff80b2530 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80cd570 tx=0x7f4fe401c460 comp rx=0 tx=0).stop 2024-04-15T15:33:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4fff200640 1 -- 172.21.15.73:0/2840321690 shutdown_connections 2024-04-15T15:33:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4fff200640 1 --2- 172.21.15.73:0/2840321690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 0x7f4ff80b2530 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4fff200640 1 --2- 172.21.15.73:0/2840321690 >> v2:172.21.15.118:3300/0 conn(0x7f4ff8146110 0x7f4ff80cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4fff200640 1 -- 172.21.15.73:0/2840321690 >> 172.21.15.73:0/2840321690 conn(0x7f4ff8067dd0 msgr2=0x7f4ff80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4fff200640 1 -- 172.21.15.73:0/2840321690 shutdown_connections 2024-04-15T15:33:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4fff200640 1 -- 172.21.15.73:0/2840321690 wait complete. 2024-04-15T15:33:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4fff200640 1 Processor -- start 2024-04-15T15:33:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.480+0000 7f4fff200640 1 -- start start 2024-04-15T15:33:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fff200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ff8071e10 0x7f4ff8143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fff200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 0x7f4ff81f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fff200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ff8146110 0x7f4ff81fa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fff200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80cdcf0 con 0x7f4ff80b20b0 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fff200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80b3d70 con 0x7f4ff8146110 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fff200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff815dbe0 con 0x7f4ff8071e10 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 0x7f4ff81f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 0x7f4ff81f9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51666/0 (socket says 172.21.15.73:51666) 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7400640 1 -- 172.21.15.73:0/426878178 learned_addr learned my addr 172.21.15.73:0/426878178 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7e00640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ff8071e10 0x7f4ff8143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ffd200640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ff8146110 0x7f4ff81fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7400640 1 -- 172.21.15.73:0/426878178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ff8071e10 msgr2=0x7f4ff8143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7400640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ff8071e10 0x7f4ff8143580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7400640 1 -- 172.21.15.73:0/426878178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ff8146110 msgr2=0x7f4ff81fa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7400640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ff8146110 0x7f4ff81fa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7400640 1 -- 172.21.15.73:0/426878178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff8141e60 con 0x7f4ff80b20b0 2024-04-15T15:33:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7e00640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ff8071e10 0x7f4ff8143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ffd200640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ff8146110 0x7f4ff81fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4ff7400640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 0x7f4ff81f9c40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4019070 tx=0x7f4fe4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fefe00640 1 -- 172.21.15.73:0/426878178 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40b0040 con 0x7f4ff80b20b0 2024-04-15T15:33:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fefe00640 1 -- 172.21.15.73:0/426878178 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe40bb070 con 0x7f4ff80b20b0 2024-04-15T15:33:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fefe00640 1 -- 172.21.15.73:0/426878178 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4006e20 con 0x7f4ff80b20b0 2024-04-15T15:33:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fff200640 1 -- 172.21.15.73:0/426878178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff8142140 con 0x7f4ff80b20b0 2024-04-15T15:33:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fff200640 1 -- 172.21.15.73:0/426878178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff8142700 con 0x7f4ff80b20b0 2024-04-15T15:33:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.484+0000 7f4fff200640 1 -- 172.21.15.73:0/426878178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff8068ab0 con 0x7f4ff80b20b0 2024-04-15T15:33:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.488+0000 7f4fefe00640 1 -- 172.21.15.73:0/426878178 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f4fe40b3070 con 0x7f4ff80b20b0 2024-04-15T15:33:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.488+0000 7f4fefe00640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4fd8068410 0x7f4fd806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.488+0000 7f4fefe00640 1 -- 172.21.15.73:0/426878178 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f4fe4120c20 con 0x7f4ff80b20b0 2024-04-15T15:33:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.488+0000 7f4ff7e00640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4fd8068410 0x7f4fd806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.488+0000 7f4ff7e00640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4fd8068410 0x7f4fd806a8d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8003fd0 tx=0x7f4fe80039e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:21.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.492+0000 7f4fefe00640 1 -- 172.21.15.73:0/426878178 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4fe4016050 con 0x7f4ff80b20b0 2024-04-15T15:33:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.652+0000 7f4fff200640 1 -- 172.21.15.73:0/426878178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4ff806cdf0 con 0x7f4ff80b20b0 2024-04-15T15:33:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.652+0000 7f4fefe00640 1 -- 172.21.15.73:0/426878178 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f4fe40aa3a0 con 0x7f4ff80b20b0 2024-04-15T15:33:21.655 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:33:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 -- 172.21.15.73:0/426878178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4fd8068410 msgr2=0x7f4fd806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4fd8068410 0x7f4fd806a8d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8003fd0 tx=0x7f4fe80039e0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 -- 172.21.15.73:0/426878178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 msgr2=0x7f4ff81f9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 0x7f4ff81f9c40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4019070 tx=0x7f4fe4019200 comp rx=0 tx=0).stop 2024-04-15T15:33:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 -- 172.21.15.73:0/426878178 shutdown_connections 2024-04-15T15:33:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ff8146110 0x7f4ff81fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ff80b20b0 0x7f4ff81f9c40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4fd8068410 0x7f4fd806a8d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 --2- 172.21.15.73:0/426878178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ff8071e10 0x7f4ff8143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 -- 172.21.15.73:0/426878178 >> 172.21.15.73:0/426878178 conn(0x7f4ff8067dd0 msgr2=0x7f4ff80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 -- 172.21.15.73:0/426878178 shutdown_connections 2024-04-15T15:33:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.656+0000 7f4fff200640 1 -- 172.21.15.73:0/426878178 wait complete. 2024-04-15T15:33:21.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:33:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dee00640 1 Processor -- start 2024-04-15T15:33:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dee00640 1 -- start start 2024-04-15T15:33:21.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dee00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8146110 0x7fc2d80cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dee00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc2d80b20b0 0x7fc2d80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dee00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2d8071e10 0x7fc2d80722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dee00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d80cd3a0 con 0x7fc2d8071e10 2024-04-15T15:33:21.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dee00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d80b5160 con 0x7fc2d80b20b0 2024-04-15T15:33:21.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dee00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d80b40c0 con 0x7fc2d8146110 2024-04-15T15:33:21.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dce00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2d8071e10 0x7fc2d80722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dce00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2d8071e10 0x7fc2d80722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51672/0 (socket says 172.21.15.73:51672) 2024-04-15T15:33:21.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2dce00640 1 -- 172.21.15.73:0/1144569914 learned_addr learned my addr 172.21.15.73:0/1144569914 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:21.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dce00640 1 -- 172.21.15.73:0/1144569914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8146110 msgr2=0x7fc2d80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:21.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.816+0000 7fc2cf400640 1 --2- 172.21.15.73:0/1144569914 >> v2:172.21.15.118:3300/0 conn(0x7fc2d80b20b0 0x7fc2d80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2d7e00640 1 --2- 172.21.15.73:0/1144569914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8146110 0x7fc2d80cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dce00640 1 --2- 172.21.15.73:0/1144569914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8146110 0x7fc2d80cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dce00640 1 -- 172.21.15.73:0/1144569914 >> v2:172.21.15.118:3300/0 conn(0x7fc2d80b20b0 msgr2=0x7fc2d80b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:21.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dce00640 1 --2- 172.21.15.73:0/1144569914 >> v2:172.21.15.118:3300/0 conn(0x7fc2d80b20b0 0x7fc2d80b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dce00640 1 -- 172.21.15.73:0/1144569914 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d80b43a0 con 0x7fc2d8071e10 2024-04-15T15:33:21.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2cf400640 1 --2- 172.21.15.73:0/1144569914 >> v2:172.21.15.118:3300/0 conn(0x7fc2d80b20b0 0x7fc2d80b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:21.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2d7e00640 1 --2- 172.21.15.73:0/1144569914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8146110 0x7fc2d80cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:21.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dce00640 1 --2- 172.21.15.73:0/1144569914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d8071e10 0x7fc2d80722a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80701f0 tx=0x7fc2d001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc676b07a1ad7ae2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:21.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2d7400640 1 -- 172.21.15.73:0/1144569914 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00a5760 con 0x7fc2d8071e10 2024-04-15T15:33:21.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2d7400640 1 -- 172.21.15.73:0/1144569914 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d00a5900 con 0x7fc2d8071e10 2024-04-15T15:33:21.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2d7400640 1 -- 172.21.15.73:0/1144569914 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00a5cd0 con 0x7fc2d8071e10 2024-04-15T15:33:21.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dee00640 1 -- 172.21.15.73:0/1144569914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d8071e10 msgr2=0x7fc2d80722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dee00640 1 --2- 172.21.15.73:0/1144569914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d8071e10 0x7fc2d80722a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80701f0 tx=0x7fc2d001c9f0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dee00640 1 -- 172.21.15.73:0/1144569914 shutdown_connections 2024-04-15T15:33:21.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dee00640 1 --2- 172.21.15.73:0/1144569914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d8071e10 0x7fc2d80722a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dee00640 1 --2- 172.21.15.73:0/1144569914 >> v2:172.21.15.118:3300/0 conn(0x7fc2d80b20b0 0x7fc2d80b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dee00640 1 --2- 172.21.15.73:0/1144569914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8146110 0x7fc2d80cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dee00640 1 -- 172.21.15.73:0/1144569914 >> 172.21.15.73:0/1144569914 conn(0x7fc2d8067dd0 msgr2=0x7fc2d80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:21.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dee00640 1 -- 172.21.15.73:0/1144569914 shutdown_connections 2024-04-15T15:33:21.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.820+0000 7fc2dee00640 1 -- 172.21.15.73:0/1144569914 wait complete. 2024-04-15T15:33:21.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dee00640 1 Processor -- start 2024-04-15T15:33:21.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dee00640 1 -- start start 2024-04-15T15:33:21.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dee00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8071e10 0x7fc2d813fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dee00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d80b20b0 0x7fc2d813e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d8146110 0x7fc2d8143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dee00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d80b3d70 con 0x7fc2d80b20b0 2024-04-15T15:33:21.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d80b4c40 con 0x7fc2d8146110 2024-04-15T15:33:21.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dee00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d80cdcf0 con 0x7fc2d8071e10 2024-04-15T15:33:21.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2cf400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d80b20b0 0x7fc2d813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2cf400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d80b20b0 0x7fc2d813e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51676/0 (socket says 172.21.15.73:51676) 2024-04-15T15:33:21.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2cf400640 1 -- 172.21.15.73:0/2906563761 learned_addr learned my addr 172.21.15.73:0/2906563761 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dce00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d8146110 0x7fc2d8143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2d7e00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8071e10 0x7fc2d813fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2cf400640 1 -- 172.21.15.73:0/2906563761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8071e10 msgr2=0x7fc2d813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2cf400640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8071e10 0x7fc2d813fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2cf400640 1 -- 172.21.15.73:0/2906563761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d8146110 msgr2=0x7fc2d8143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2cf400640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d8146110 0x7fc2d8143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2cf400640 1 -- 172.21.15.73:0/2906563761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d813ecc0 con 0x7fc2d80b20b0 2024-04-15T15:33:21.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2d7e00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8071e10 0x7fc2d813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:21.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2cf400640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d80b20b0 0x7fc2d813e350 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c7f0 tx=0x7fc2c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:21.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2d4c00640 1 -- 172.21.15.73:0/2906563761 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0007a30 con 0x7fc2d80b20b0 2024-04-15T15:33:21.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2d4c00640 1 -- 172.21.15.73:0/2906563761 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c0007bd0 con 0x7fc2d80b20b0 2024-04-15T15:33:21.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2d4c00640 1 -- 172.21.15.73:0/2906563761 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c00113f0 con 0x7fc2d80b20b0 2024-04-15T15:33:21.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dee00640 1 -- 172.21.15.73:0/2906563761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d813efa0 con 0x7fc2d80b20b0 2024-04-15T15:33:21.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.824+0000 7fc2dee00640 1 -- 172.21.15.73:0/2906563761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d813f560 con 0x7fc2d80b20b0 2024-04-15T15:33:21.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.828+0000 7fc2dee00640 1 -- 172.21.15.73:0/2906563761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d8068ab0 con 0x7fc2d80b20b0 2024-04-15T15:33:21.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.828+0000 7fc2d4c00640 1 -- 172.21.15.73:0/2906563761 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fc2c0011590 con 0x7fc2d80b20b0 2024-04-15T15:33:21.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.828+0000 7fc2d4c00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc2b4068410 0x7fc2b406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:21.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.828+0000 7fc2d4c00640 1 -- 172.21.15.73:0/2906563761 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7fc2c0086f70 con 0x7fc2d80b20b0 2024-04-15T15:33:21.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.828+0000 7fc2d7e00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc2b4068410 0x7fc2b406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:21.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.828+0000 7fc2d7e00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc2b4068410 0x7fc2b406a8d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8006fd0 tx=0x7fc2c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:21.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.832+0000 7fc2d4c00640 1 -- 172.21.15.73:0/2906563761 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc2c0015020 con 0x7fc2d80b20b0 2024-04-15T15:33:21.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 -- 172.21.15.73:0/2906563761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc2d8075220 con 0x7fc2d80b20b0 2024-04-15T15:33:21.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2d4c00640 1 -- 172.21.15.73:0/2906563761 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) ==== 104+0+11 (secure 0 0 0) 0x7fc2c0056ae0 con 0x7fc2d80b20b0 2024-04-15T15:33:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:33:21.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 -- 172.21.15.73:0/2906563761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc2b4068410 msgr2=0x7fc2b406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc2b4068410 0x7fc2b406a8d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8006fd0 tx=0x7fc2c8008040 comp rx=0 tx=0).stop 2024-04-15T15:33:21.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 -- 172.21.15.73:0/2906563761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d80b20b0 msgr2=0x7fc2d813e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:21.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d80b20b0 0x7fc2d813e350 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c7f0 tx=0x7fc2c000ccb0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 -- 172.21.15.73:0/2906563761 shutdown_connections 2024-04-15T15:33:21.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d8146110 0x7fc2d8143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2d80b20b0 0x7fc2d813e350 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc2b4068410 0x7fc2b406a8d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 --2- 172.21.15.73:0/2906563761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2d8071e10 0x7fc2d813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:21.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 -- 172.21.15.73:0/2906563761 >> 172.21.15.73:0/2906563761 conn(0x7fc2d8067dd0 msgr2=0x7fc2d8142b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:21.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 -- 172.21.15.73:0/2906563761 shutdown_connections 2024-04-15T15:33:21.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:21.992+0000 7fc2dee00640 1 -- 172.21.15.73:0/2906563761 wait complete. 2024-04-15T15:33:22.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:33:22.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.148+0000 7f77e3e00640 1 Processor -- start 2024-04-15T15:33:22.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.148+0000 7f77e3e00640 1 -- start start 2024-04-15T15:33:22.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77e40b4070 0x7f77e40b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77e40d0b60 0x7f77e40ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e3e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e406eb00 con 0x7f77e40b4990 2024-04-15T15:33:22.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e3e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f77e406eda0 con 0x7f77e40b4070 2024-04-15T15:33:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e3e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f77e406f060 con 0x7f77e40d0b60 2024-04-15T15:33:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e2a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77e40b4070 0x7f77e40b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e2a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77e40b4070 0x7f77e40b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51682/0 (socket says 172.21.15.73:51682) 2024-04-15T15:33:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e2a00640 1 -- 172.21.15.73:0/2776494825 learned_addr learned my addr 172.21.15.73:0/2776494825 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e3400640 1 --2- 172.21.15.73:0/2776494825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77e40d0b60 0x7f77e40ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e2a00640 1 -- 172.21.15.73:0/2776494825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77e40d0b60 msgr2=0x7f77e40ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e2a00640 1 --2- 172.21.15.73:0/2776494825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77e40d0b60 0x7f77e40ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e2a00640 1 -- 172.21.15.73:0/2776494825 >> v1:172.21.15.118:6789/0 conn(0x7f77e40b4990 legacy=0x7f77e40d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.152+0000 7f77e2a00640 1 -- 172.21.15.73:0/2776494825 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e406f340 con 0x7f77e40b4070 2024-04-15T15:33:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e2a00640 1 --2- 172.21.15.73:0/2776494825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40b4070 0x7f77e40b4450 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009e50 tx=0x7f77d401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d735e0aec78fecd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e1600640 1 -- 172.21.15.73:0/2776494825 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d40a58d0 con 0x7f77e40b4070 2024-04-15T15:33:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e1600640 1 -- 172.21.15.73:0/2776494825 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d40a5a70 con 0x7f77e40b4070 2024-04-15T15:33:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e1600640 1 -- 172.21.15.73:0/2776494825 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d40a5e40 con 0x7f77e40b4070 2024-04-15T15:33:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 -- 172.21.15.73:0/2776494825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40b4070 msgr2=0x7f77e40b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 --2- 172.21.15.73:0/2776494825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40b4070 0x7f77e40b4450 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009e50 tx=0x7f77d401ca00 comp rx=0 tx=0).stop 2024-04-15T15:33:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 -- 172.21.15.73:0/2776494825 shutdown_connections 2024-04-15T15:33:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 --2- 172.21.15.73:0/2776494825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77e40d0b60 0x7f77e40ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 --2- 172.21.15.73:0/2776494825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40b4070 0x7f77e40b4450 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 -- 172.21.15.73:0/2776494825 >> 172.21.15.73:0/2776494825 conn(0x7f77e406bc20 msgr2=0x7f77e406c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 -- 172.21.15.73:0/2776494825 shutdown_connections 2024-04-15T15:33:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 -- 172.21.15.73:0/2776494825 wait complete. 2024-04-15T15:33:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 Processor -- start 2024-04-15T15:33:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 -- start start 2024-04-15T15:33:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e40b4070 0x7f77e4158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77e40b4990 0x7f77e4166ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40d0b60 0x7f77e41fadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40ae090 con 0x7f77e40d0b60 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40adf10 con 0x7f77e40b4070 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f77e40ae210 con 0x7f77e40b4990 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40d0b60 0x7f77e41fadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40d0b60 0x7f77e41fadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51694/0 (socket says 172.21.15.73:51694) 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.156+0000 7f77e3400640 1 -- 172.21.15.73:0/1085142511 learned_addr learned my addr 172.21.15.73:0/1085142511 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e2a00640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e40b4070 0x7f77e4158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e2000640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77e40b4990 0x7f77e4166ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e3400640 1 -- 172.21.15.73:0/1085142511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77e40b4990 msgr2=0x7f77e4166ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e3400640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77e40b4990 0x7f77e4166ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e3400640 1 -- 172.21.15.73:0/1085142511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e40b4070 msgr2=0x7f77e4158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e3400640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e40b4070 0x7f77e4158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e3400640 1 -- 172.21.15.73:0/1085142511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e4167220 con 0x7f77e40d0b60 2024-04-15T15:33:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e2a00640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e40b4070 0x7f77e4158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e3400640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40d0b60 0x7f77e41fadb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e820 tx=0x7f77dc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77db400640 1 -- 172.21.15.73:0/1085142511 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc017070 con 0x7f77e40d0b60 2024-04-15T15:33:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77db400640 1 -- 172.21.15.73:0/1085142511 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77dc00c940 con 0x7f77e40d0b60 2024-04-15T15:33:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e3e00640 1 -- 172.21.15.73:0/1085142511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e4159040 con 0x7f77e40d0b60 2024-04-15T15:33:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77db400640 1 -- 172.21.15.73:0/1085142511 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00cd10 con 0x7f77e40d0b60 2024-04-15T15:33:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e3e00640 1 -- 172.21.15.73:0/1085142511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e41fa5b0 con 0x7f77e40d0b60 2024-04-15T15:33:22.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77e3e00640 1 -- 172.21.15.73:0/1085142511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e41faa90 con 0x7f77e40d0b60 2024-04-15T15:33:22.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77db400640 1 -- 172.21.15.73:0/1085142511 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f77dc01a070 con 0x7f77e40d0b60 2024-04-15T15:33:22.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.160+0000 7f77db400640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f77c4068440 0x7f77c406a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.164+0000 7f77db400640 1 -- 172.21.15.73:0/1085142511 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f77dc086e50 con 0x7f77e40d0b60 2024-04-15T15:33:22.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.164+0000 7f77e2a00640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f77c4068440 0x7f77c406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.164+0000 7f77e2a00640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f77c4068440 0x7f77c406a900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f77d40ae000 tx=0x7f77d40a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:22.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.164+0000 7f77db400640 1 -- 172.21.15.73:0/1085142511 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f77dc057120 con 0x7f77e40d0b60 2024-04-15T15:33:22.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.320+0000 7f77e3e00640 1 -- 172.21.15.73:0/1085142511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f77e406e3d0 con 0x7f77e40d0b60 2024-04-15T15:33:22.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.320+0000 7f77db400640 1 -- 172.21.15.73:0/1085142511 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) ==== 100+0+11 (secure 0 0 0) 0x7f77dc056a20 con 0x7f77e40d0b60 2024-04-15T15:33:22.323 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:33:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 -- 172.21.15.73:0/1085142511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f77c4068440 msgr2=0x7f77c406a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f77c4068440 0x7f77c406a900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f77d40ae000 tx=0x7f77d40a7070 comp rx=0 tx=0).stop 2024-04-15T15:33:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 -- 172.21.15.73:0/1085142511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40d0b60 msgr2=0x7f77e41fadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40d0b60 0x7f77e41fadb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e820 tx=0x7f77dc00ece0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 -- 172.21.15.73:0/1085142511 shutdown_connections 2024-04-15T15:33:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77e40d0b60 0x7f77e41fadb0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f77c4068440 0x7f77c406a900 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77e40b4990 0x7f77e4166ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 --2- 172.21.15.73:0/1085142511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e40b4070 0x7f77e4158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 -- 172.21.15.73:0/1085142511 >> 172.21.15.73:0/1085142511 conn(0x7f77e406bc20 msgr2=0x7f77e40d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 -- 172.21.15.73:0/1085142511 shutdown_connections 2024-04-15T15:33:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.324+0000 7f77e3e00640 1 -- 172.21.15.73:0/1085142511 wait complete. 2024-04-15T15:33:22.344 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T15:33:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4da00640 1 Processor -- start 2024-04-15T15:33:22.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4da00640 1 -- start start 2024-04-15T15:33:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4da00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f480af610 0x7f7f4806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4da00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7f480d0450 0x7f7f480d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4da00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f480d0e00 con 0x7f7f4815b560 2024-04-15T15:33:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4da00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f7f480ce620 con 0x7f7f480d0450 2024-04-15T15:33:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4da00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4806dc10 con 0x7f7f480af610 2024-04-15T15:33:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4d000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7f480d0450 0x7f7f480d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f47e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7f4815b560 0x7f7f480cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:50462/0 (socket says 172.21.15.73:50462) 2024-04-15T15:33:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f47e00640 1 -- 172.21.15.73:0/2341488439 learned_addr learned my addr 172.21.15.73:0/2341488439 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f3f400640 1 --2- 172.21.15.73:0/2341488439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f480af610 0x7f7f4806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4d000640 1 -- 172.21.15.73:0/2341488439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f480af610 msgr2=0x7f7f4806e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4d000640 1 --2- 172.21.15.73:0/2341488439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f480af610 0x7f7f4806e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4d000640 1 -- 172.21.15.73:0/2341488439 >> v1:172.21.15.118:6789/0 conn(0x7f7f4815b560 legacy=0x7f7f480cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.480+0000 7f7f4d000640 1 -- 172.21.15.73:0/2341488439 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4806def0 con 0x7f7f480d0450 2024-04-15T15:33:22.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f4d000640 1 --2- 172.21.15.73:0/2341488439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f480d0450 0x7f7f480d08c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000ba60 tx=0x7f7f4001eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18505dd0a73d6c02 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:22.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f47400640 1 -- 172.21.15.73:0/2341488439 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400b4070 con 0x7f7f480d0450 2024-04-15T15:33:22.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f47400640 1 -- 172.21.15.73:0/2341488439 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f400a79b0 con 0x7f7f480d0450 2024-04-15T15:33:22.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f47400640 1 -- 172.21.15.73:0/2341488439 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400a7d80 con 0x7f7f480d0450 2024-04-15T15:33:22.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f4da00640 1 -- 172.21.15.73:0/2341488439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f480d0450 msgr2=0x7f7f480d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f4da00640 1 --2- 172.21.15.73:0/2341488439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f480d0450 0x7f7f480d08c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000ba60 tx=0x7f7f4001eae0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f4da00640 1 -- 172.21.15.73:0/2341488439 shutdown_connections 2024-04-15T15:33:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f4da00640 1 --2- 172.21.15.73:0/2341488439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f480d0450 0x7f7f480d08c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f4da00640 1 --2- 172.21.15.73:0/2341488439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f480af610 0x7f7f4806e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f4da00640 1 -- 172.21.15.73:0/2341488439 >> 172.21.15.73:0/2341488439 conn(0x7f7f4806bc20 msgr2=0x7f7f4806c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f4da00640 1 -- 172.21.15.73:0/2341488439 shutdown_connections 2024-04-15T15:33:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.484+0000 7f7f4da00640 1 -- 172.21.15.73:0/2341488439 wait complete. 2024-04-15T15:33:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 Processor -- start 2024-04-15T15:33:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 -- start start 2024-04-15T15:33:22.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f480af610 0x7f7f480c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f480d0450 0x7f7f48099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f4815b560 0x7f7f48159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7f480b4110 con 0x7f7f480af610 2024-04-15T15:33:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7f480b3f90 con 0x7f7f4815b560 2024-04-15T15:33:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7f480b4290 con 0x7f7f480d0450 2024-04-15T15:33:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f47e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f480af610 0x7f7f480c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f47e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f480af610 0x7f7f480c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51704/0 (socket says 172.21.15.73:51704) 2024-04-15T15:33:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f47e00640 1 -- 172.21.15.73:0/69708556 learned_addr learned my addr 172.21.15.73:0/69708556 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f3f400640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f480d0450 0x7f7f48099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4d000640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f4815b560 0x7f7f48159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f47e00640 1 -- 172.21.15.73:0/69708556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f480d0450 msgr2=0x7f7f48099870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f47e00640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f480d0450 0x7f7f48099870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f47e00640 1 -- 172.21.15.73:0/69708556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f4815b560 msgr2=0x7f7f48159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f47e00640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f4815b560 0x7f7f48159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f47e00640 1 -- 172.21.15.73:0/69708556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f480cbdf0 con 0x7f7f480af610 2024-04-15T15:33:22.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4d000640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f4815b560 0x7f7f48159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:22.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f47e00640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f480af610 0x7f7f480c9fb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800c370 tx=0x7f7f3800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:22.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f44c00640 1 -- 172.21.15.73:0/69708556 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38017070 con 0x7f7f480af610 2024-04-15T15:33:22.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f44c00640 1 -- 172.21.15.73:0/69708556 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f38005cf0 con 0x7f7f480af610 2024-04-15T15:33:22.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f44c00640 1 -- 172.21.15.73:0/69708556 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f380072f0 con 0x7f7f480af610 2024-04-15T15:33:22.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 -- 172.21.15.73:0/69708556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f480cc0d0 con 0x7f7f480af610 2024-04-15T15:33:22.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 -- 172.21.15.73:0/69708556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f480ca4f0 con 0x7f7f480af610 2024-04-15T15:33:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.488+0000 7f7f4da00640 1 -- 172.21.15.73:0/69708556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4804fd60 con 0x7f7f480af610 2024-04-15T15:33:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.492+0000 7f7f44c00640 1 -- 172.21.15.73:0/69708556 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f7f3801a070 con 0x7f7f480af610 2024-04-15T15:33:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.492+0000 7f7f44c00640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7f24068410 0x7f7f2406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.492+0000 7f7f44c00640 1 -- 172.21.15.73:0/69708556 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f7f38085ee0 con 0x7f7f480af610 2024-04-15T15:33:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.492+0000 7f7f3f400640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7f24068410 0x7f7f2406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.492+0000 7f7f3f400640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7f24068410 0x7f7f2406a8d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7f4815feb0 tx=0x7f7f3000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:22.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.496+0000 7f7f44c00640 1 -- 172.21.15.73:0/69708556 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7f38055bf0 con 0x7f7f480af610 2024-04-15T15:33:22.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 -- 172.21.15.73:0/69708556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7f4806c380 con 0x7f7f480af610 2024-04-15T15:33:22.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f44c00640 1 -- 172.21.15.73:0/69708556 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v42) ==== 80+0+124 (secure 0 0 0) 0x7f7f38059ef0 con 0x7f7f480af610 2024-04-15T15:33:22.669 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.118:6834/2635966606 2024-04-16T15:33:09.602425+0000 2024-04-15T15:33:22.669 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.118:6832/2635966606 2024-04-16T15:33:09.602425+0000 2024-04-15T15:33:22.669 INFO:teuthology.orchestra.run.smithi073.stderr:listed 2 entries 2024-04-15T15:33:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 -- 172.21.15.73:0/69708556 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7f24068410 msgr2=0x7f7f2406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7f24068410 0x7f7f2406a8d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7f4815feb0 tx=0x7f7f3000b040 comp rx=0 tx=0).stop 2024-04-15T15:33:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 -- 172.21.15.73:0/69708556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f480af610 msgr2=0x7f7f480c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f480af610 0x7f7f480c9fb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800c370 tx=0x7f7f3800c830 comp rx=0 tx=0).stop 2024-04-15T15:33:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 -- 172.21.15.73:0/69708556 shutdown_connections 2024-04-15T15:33:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f4815b560 0x7f7f48159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7f24068410 0x7f7f2406a8d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f480d0450 0x7f7f48099870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 --2- 172.21.15.73:0/69708556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f480af610 0x7f7f480c9fb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 -- 172.21.15.73:0/69708556 >> 172.21.15.73:0/69708556 conn(0x7f7f4806bc20 msgr2=0x7f7f48153df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:22.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 -- 172.21.15.73:0/69708556 shutdown_connections 2024-04-15T15:33:22.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.668+0000 7f7f4da00640 1 -- 172.21.15.73:0/69708556 wait complete. 2024-04-15T15:33:22.690 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-15T15:33:22.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:22.690 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.3 2024-04-15T15:33:22.719 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:33:22.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:22.719 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-15T15:33:22.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:33:22.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee4200640 1 Processor -- start 2024-04-15T15:33:22.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee4200640 1 -- start start 2024-04-15T15:33:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee4200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8edc15b5d0 0x7f8edc15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee4200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0b27c0 0x7f8edc0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee4200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8edc070160 con 0x7f8edc0b3e30 2024-04-15T15:33:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee4200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f8edc15b9b0 con 0x7f8edc15b5d0 2024-04-15T15:33:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee4200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8edc15f1f0 con 0x7f8edc0b27c0 2024-04-15T15:33:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee0e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8edc0b3e30 0x7f8edc0b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49818/0 (socket says 172.21.15.73:49818) 2024-04-15T15:33:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee0e00640 1 -- 172.21.15.73:0/3363600604 learned_addr learned my addr 172.21.15.73:0/3363600604 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee2200640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0b27c0 0x7f8edc0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee1800640 1 --2- 172.21.15.73:0/3363600604 >> v2:172.21.15.118:3300/0 conn(0x7f8edc15b5d0 0x7f8edc15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148802755 0 0) 0x7f8edc070160 con 0x7f8edc0b3e30 2024-04-15T15:33:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ec4003530 con 0x7f8edc0b3e30 2024-04-15T15:33:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3520474684 0 0) 0x7f8ec4003530 con 0x7f8edc0b3e30 2024-04-15T15:33:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0b27c0 msgr2=0x7f8edc0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0b27c0 0x7f8edc0b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 >> v2:172.21.15.118:3300/0 conn(0x7f8edc15b5d0 msgr2=0x7f8edc15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 --2- 172.21.15.73:0/3363600604 >> v2:172.21.15.118:3300/0 conn(0x7f8edc15b5d0 0x7f8edc15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc06fe80 con 0x7f8edc0b3e30 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f8ec8001680 con 0x7f8edc0b3e30 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 >> v1:172.21.15.73:6789/0 conn(0x7f8edc0b3e30 legacy=0x7f8edc0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ec40039c0 0x7f8ec4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ec4004810 0x7f8ec4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0b27c0 0x7f8ec40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc15f1f0 con 0x7f8ec40039c0 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec400ba80 con 0x7f8ec4004810 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec400bc80 con 0x7f8edc0b27c0 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee1800640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ec40039c0 0x7f8ec4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee0e00640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ec4004810 0x7f8ec4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee2200640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0b27c0 0x7f8ec40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee1800640 1 -- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0b27c0 msgr2=0x7f8ec40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee1800640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0b27c0 0x7f8ec40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee1800640 1 -- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ec4004810 msgr2=0x7f8ec4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee1800640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ec4004810 0x7f8ec4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.904+0000 7f8ee1800640 1 -- 172.21.15.73:0/3363600604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec4003530 con 0x7f8ec40039c0 2024-04-15T15:33:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8ee1800640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ec40039c0 0x7f8ec4003de0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009ab0 tx=0x7f8ed001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6a38fe9be0bf9a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed00b2070 con 0x7f8ec40039c0 2024-04-15T15:33:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed00a5610 con 0x7f8ec40039c0 2024-04-15T15:33:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8edbe00640 1 -- 172.21.15.73:0/3363600604 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed00096b0 con 0x7f8ec40039c0 2024-04-15T15:33:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8ee4200640 1 -- 172.21.15.73:0/3363600604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ec40039c0 msgr2=0x7f8ec4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8ee4200640 1 --2- 172.21.15.73:0/3363600604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ec40039c0 0x7f8ec4003de0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009ab0 tx=0x7f8ed001ca40 comp rx=0 tx=0).stop 2024-04-15T15:33:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8ee2200640 1 -- 172.21.15.73:0/3363600604 reap_dead start 2024-04-15T15:33:22.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8ee4200640 1 -- 172.21.15.73:0/3363600604 shutdown_connections 2024-04-15T15:33:22.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8ee4200640 1 -- 172.21.15.73:0/3363600604 >> 172.21.15.73:0/3363600604 conn(0x7f8edc067dd0 msgr2=0x7f8edc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:22.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8ee4200640 1 -- 172.21.15.73:0/3363600604 shutdown_connections 2024-04-15T15:33:22.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.908+0000 7f8ee4200640 1 -- 172.21.15.73:0/3363600604 wait complete. 2024-04-15T15:33:22.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee4200640 1 Processor -- start 2024-04-15T15:33:22.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee4200640 1 -- start start 2024-04-15T15:33:22.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee4200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ec40039c0 0x7f8edc152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee4200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0ad8d0 0x7f8edc168cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee4200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8edc15ce80 0x7f8edc15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee4200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc06faa0 con 0x7f8edc15ce80 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee4200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc0b4240 con 0x7f8ec40039c0 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee4200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8edc06fc20 con 0x7f8edc0ad8d0 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee2200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8edc15ce80 0x7f8edc15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee2200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8edc15ce80 0x7f8edc15d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51732/0 (socket says 172.21.15.73:51732) 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee2200640 1 -- 172.21.15.73:0/2767775482 learned_addr learned my addr 172.21.15.73:0/2767775482 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee1800640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ec40039c0 0x7f8edc152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee0e00640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0ad8d0 0x7f8edc168cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee2200640 1 -- 172.21.15.73:0/2767775482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0ad8d0 msgr2=0x7f8edc168cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee2200640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0ad8d0 0x7f8edc168cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee2200640 1 -- 172.21.15.73:0/2767775482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ec40039c0 msgr2=0x7f8edc152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee2200640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ec40039c0 0x7f8edc152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee2200640 1 -- 172.21.15.73:0/2767775482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc0ade40 con 0x7f8edc15ce80 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee2200640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8edc15ce80 0x7f8edc15d300 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8edc071c80 tx=0x7f8ed40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ed9600640 1 -- 172.21.15.73:0/2767775482 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4011e40 con 0x7f8edc15ce80 2024-04-15T15:33:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ed9600640 1 -- 172.21.15.73:0/2767775482 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed401b070 con 0x7f8edc15ce80 2024-04-15T15:33:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee4200640 1 -- 172.21.15.73:0/2767775482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8edc0ae120 con 0x7f8edc15ce80 2024-04-15T15:33:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ed9600640 1 -- 172.21.15.73:0/2767775482 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40039a0 con 0x7f8edc15ce80 2024-04-15T15:33:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.912+0000 7f8ee4200640 1 -- 172.21.15.73:0/2767775482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8edc1f72d0 con 0x7f8edc15ce80 2024-04-15T15:33:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.916+0000 7f8ee4200640 1 -- 172.21.15.73:0/2767775482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8edc068ab0 con 0x7f8edc15ce80 2024-04-15T15:33:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.916+0000 7f8ed9600640 1 -- 172.21.15.73:0/2767775482 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f8ed4003b40 con 0x7f8edc15ce80 2024-04-15T15:33:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.916+0000 7f8ed9600640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ebc068440 0x7f8ebc06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.916+0000 7f8ed9600640 1 -- 172.21.15.73:0/2767775482 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f8ed4087540 con 0x7f8edc15ce80 2024-04-15T15:33:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.916+0000 7f8ee1800640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ebc068440 0x7f8ebc06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.916+0000 7f8ee1800640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ebc068440 0x7f8ebc06a900 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00af000 tx=0x7f8ed00046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:22.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:22.920+0000 7f8ed9600640 1 -- 172.21.15.73:0/2767775482 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ed4025020 con 0x7f8edc15ce80 2024-04-15T15:33:23.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.108+0000 7f8ee4200640 1 -- 172.21.15.73:0/2767775482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8edc1f74a0 con 0x7f8edc15ce80 2024-04-15T15:33:23.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.108+0000 7f8ed9600640 1 -- 172.21.15.73:0/2767775482 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5186 (secure 0 0 0) 0x7f8ed40570b0 con 0x7f8edc15ce80 2024-04-15T15:33:23.112 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:23.112 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/326969724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":326969724},{"type":"v1","addr":"172.21.15.118:6834","nonce":326969724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:32:49.112134+0000","modified":"2024-04-15T15:33:13.617001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.73:6836/1374015509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1374015509},{"type":"v1","addr":"172.21.15.73:6836","nonce":1374015509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":2}]} 2024-04-15T15:33:23.112 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-04-15T15:33:23.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 -- 172.21.15.73:0/2767775482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ebc068440 msgr2=0x7f8ebc06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ebc068440 0x7f8ebc06a900 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00af000 tx=0x7f8ed00046d0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 -- 172.21.15.73:0/2767775482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8edc15ce80 msgr2=0x7f8edc15d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8edc15ce80 0x7f8edc15d300 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8edc071c80 tx=0x7f8ed40115a0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 -- 172.21.15.73:0/2767775482 shutdown_connections 2024-04-15T15:33:23.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8edc15ce80 0x7f8edc15d300 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ebc068440 0x7f8ebc06a900 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8edc0ad8d0 0x7f8edc168cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 --2- 172.21.15.73:0/2767775482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ec40039c0 0x7f8edc152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 -- 172.21.15.73:0/2767775482 >> 172.21.15.73:0/2767775482 conn(0x7f8edc067dd0 msgr2=0x7f8edc0b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:23.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 -- 172.21.15.73:0/2767775482 shutdown_connections 2024-04-15T15:33:23.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.112+0000 7f8ee4200640 1 -- 172.21.15.73:0/2767775482 wait complete. 2024-04-15T15:33:23.133 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:33:23.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbffe00640 1 Processor -- start 2024-04-15T15:33:23.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbffe00640 1 -- start start 2024-04-15T15:33:23.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbffe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc0015b630 0x7fbc000cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbffe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc000cef00 0x7fbc000cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbffe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc000cdbb0 0x7fbc000ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbffe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbc000ccdc0 con 0x7fbc000cef00 2024-04-15T15:33:23.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbffe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fbc0015ba10 con 0x7fbc000cdbb0 2024-04-15T15:33:23.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbffe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbc000cc1b0 con 0x7fbc0015b630 2024-04-15T15:33:23.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbfe000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc000cef00 0x7fbc000cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbfe000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc000cef00 0x7fbc000cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51742/0 (socket says 172.21.15.73:51742) 2024-04-15T15:33:23.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbfe000640 1 -- 172.21.15.73:0/1257100326 learned_addr learned my addr 172.21.15.73:0/1257100326 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:23.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbfea00640 1 --2- 172.21.15.73:0/1257100326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc0015b630 0x7fbc000cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbff400640 1 --2- 172.21.15.73:0/1257100326 >> v2:172.21.15.118:3300/0 conn(0x7fbc000cdbb0 0x7fbc000ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbfe000640 1 -- 172.21.15.73:0/1257100326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc0015b630 msgr2=0x7fbc000cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:23.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbfe000640 1 --2- 172.21.15.73:0/1257100326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc0015b630 0x7fbc000cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbfe000640 1 -- 172.21.15.73:0/1257100326 >> v2:172.21.15.118:3300/0 conn(0x7fbc000cdbb0 msgr2=0x7fbc000ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:23.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbfe000640 1 --2- 172.21.15.73:0/1257100326 >> v2:172.21.15.118:3300/0 conn(0x7fbc000cdbb0 0x7fbc000ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.268+0000 7fbbfe000640 1 -- 172.21.15.73:0/1257100326 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc000cc490 con 0x7fbc000cef00 2024-04-15T15:33:23.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbfe000640 1 --2- 172.21.15.73:0/1257100326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 0x7fbc000cd250 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbc00073cf0 tx=0x7fbbec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919416365c2eb020 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbfd600640 1 -- 172.21.15.73:0/1257100326 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0b0070 con 0x7fbc000cef00 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbfd600640 1 -- 172.21.15.73:0/1257100326 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec0ab600 con 0x7fbc000cef00 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbfd600640 1 -- 172.21.15.73:0/1257100326 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0ab9d0 con 0x7fbc000cef00 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 -- 172.21.15.73:0/1257100326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 msgr2=0x7fbc000cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 --2- 172.21.15.73:0/1257100326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 0x7fbc000cd250 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbc00073cf0 tx=0x7fbbec01c520 comp rx=0 tx=0).stop 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 -- 172.21.15.73:0/1257100326 shutdown_connections 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 --2- 172.21.15.73:0/1257100326 >> v2:172.21.15.118:3300/0 conn(0x7fbc000cdbb0 0x7fbc000ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 --2- 172.21.15.73:0/1257100326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 0x7fbc000cd250 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 --2- 172.21.15.73:0/1257100326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc0015b630 0x7fbc000cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 -- 172.21.15.73:0/1257100326 >> 172.21.15.73:0/1257100326 conn(0x7fbc0009aa60 msgr2=0x7fbc000b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:23.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 -- 172.21.15.73:0/1257100326 shutdown_connections 2024-04-15T15:33:23.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 -- 172.21.15.73:0/1257100326 wait complete. 2024-04-15T15:33:23.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 Processor -- start 2024-04-15T15:33:23.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.272+0000 7fbbffe00640 1 -- start start 2024-04-15T15:33:23.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbffe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc000cdbb0 0x7fbc000c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbffe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 0x7fbc0006ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbffe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc0015b630 0x7fbc000c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbffe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbc000cbf50 con 0x7fbc000cef00 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbffe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbc000cbdd0 con 0x7fbc000cdbb0 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbffe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbc000c5690 con 0x7fbc0015b630 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfe000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 0x7fbc0006ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfe000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 0x7fbc0006ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51748/0 (socket says 172.21.15.73:51748) 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfe000640 1 -- 172.21.15.73:0/746251993 learned_addr learned my addr 172.21.15.73:0/746251993 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfea00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc000cdbb0 0x7fbc000c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbff400640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc0015b630 0x7fbc000c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfe000640 1 -- 172.21.15.73:0/746251993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc0015b630 msgr2=0x7fbc000c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfe000640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc0015b630 0x7fbc000c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfe000640 1 -- 172.21.15.73:0/746251993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc000cdbb0 msgr2=0x7fbc000c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfe000640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc000cdbb0 0x7fbc000c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfe000640 1 -- 172.21.15.73:0/746251993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc000c8ec0 con 0x7fbc000cef00 2024-04-15T15:33:23.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfea00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc000cdbb0 0x7fbc000c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:23.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbfe000640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 0x7fbc0006ffe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbbec01abd0 tx=0x7fbbec0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:23.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbf6a00640 1 -- 172.21.15.73:0/746251993 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0b0040 con 0x7fbc000cef00 2024-04-15T15:33:23.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbf6a00640 1 -- 172.21.15.73:0/746251993 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec0b9070 con 0x7fbc000cef00 2024-04-15T15:33:23.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbffe00640 1 -- 172.21.15.73:0/746251993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc000c91a0 con 0x7fbc000cef00 2024-04-15T15:33:23.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbf6a00640 1 -- 172.21.15.73:0/746251993 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0b4440 con 0x7fbc000cef00 2024-04-15T15:33:23.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbffe00640 1 -- 172.21.15.73:0/746251993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc000c9760 con 0x7fbc000cef00 2024-04-15T15:33:23.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.276+0000 7fbbffe00640 1 -- 172.21.15.73:0/746251993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc0004fd60 con 0x7fbc000cef00 2024-04-15T15:33:23.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.280+0000 7fbbf6a00640 1 -- 172.21.15.73:0/746251993 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fbbec0b45e0 con 0x7fbc000cef00 2024-04-15T15:33:23.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.280+0000 7fbbf6a00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbbe0068410 0x7fbbe006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.280+0000 7fbbf6a00640 1 -- 172.21.15.73:0/746251993 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7fbbec1208d0 con 0x7fbc000cef00 2024-04-15T15:33:23.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.280+0000 7fbbfea00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbbe0068410 0x7fbbe006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.280+0000 7fbbfea00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbbe0068410 0x7fbbe006a8d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbc000709c0 tx=0x7fbbf0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:23.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.284+0000 7fbbf6a00640 1 -- 172.21.15.73:0/746251993 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbbec016110 con 0x7fbc000cef00 2024-04-15T15:33:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.440+0000 7fbbffe00640 1 -- 172.21.15.73:0/746251993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc000cfab0 con 0x7fbc000cef00 2024-04-15T15:33:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbf6a00640 1 -- 172.21.15.73:0/746251993 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17041 (secure 0 0 0) 0x7fbbec0f0b10 con 0x7fbc000cef00 2024-04-15T15:33:23.444 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:23.445 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":42,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:33:14.628670+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6834/2635966606":"2024-04-16T15:33:09.602425+0000","172.21.15.118:6832/2635966606":"2024-04-16T15:33:09.602425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:33:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 -- 172.21.15.73:0/746251993 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbbe0068410 msgr2=0x7fbbe006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbbe0068410 0x7fbbe006a8d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbc000709c0 tx=0x7fbbf0008040 comp rx=0 tx=0).stop 2024-04-15T15:33:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 -- 172.21.15.73:0/746251993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 msgr2=0x7fbc0006ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 0x7fbc0006ffe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbbec01abd0 tx=0x7fbbec0192c0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 -- 172.21.15.73:0/746251993 shutdown_connections 2024-04-15T15:33:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fbbe0068410 0x7fbbe006a8d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc0015b630 0x7fbc000c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc000cef00 0x7fbc0006ffe0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 --2- 172.21.15.73:0/746251993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc000cdbb0 0x7fbc000c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 -- 172.21.15.73:0/746251993 >> 172.21.15.73:0/746251993 conn(0x7fbc0009aa60 msgr2=0x7fbc000c5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 -- 172.21.15.73:0/746251993 shutdown_connections 2024-04-15T15:33:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.444+0000 7fbbffe00640 1 -- 172.21.15.73:0/746251993 wait complete. 2024-04-15T15:33:23.466 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T15:31:21.381557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T15:32:46.793984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T15:32:48.072270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T15:33:23.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T15:33:23.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f6302200640 1 Processor -- start 2024-04-15T15:33:23.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f6302200640 1 -- start start 2024-04-15T15:33:23.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f6302200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc146110 0x7f62fc0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f6302200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62fc0b20b0 0x7f62fc0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f6302200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f62fc071e10 0x7f62fc0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f6302200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f62fc0cd3a0 con 0x7f62fc0b20b0 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f6302200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f62fc0b5160 con 0x7f62fc071e10 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f6302200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f62fc0b40c0 con 0x7f62fc146110 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62faa00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62fc0b20b0 0x7f62fc0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62faa00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62fc0b20b0 0x7f62fc0b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51764/0 (socket says 172.21.15.73:51764) 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62faa00640 1 -- 172.21.15.73:0/2301698997 learned_addr learned my addr 172.21.15.73:0/2301698997 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62fb400640 1 --2- 172.21.15.73:0/2301698997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc146110 0x7f62fc0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62fbe00640 1 --2- 172.21.15.73:0/2301698997 >> v2:172.21.15.118:3300/0 conn(0x7f62fc071e10 0x7f62fc0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62faa00640 1 -- 172.21.15.73:0/2301698997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc146110 msgr2=0x7f62fc0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62faa00640 1 --2- 172.21.15.73:0/2301698997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc146110 0x7f62fc0cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62faa00640 1 -- 172.21.15.73:0/2301698997 >> v2:172.21.15.118:3300/0 conn(0x7f62fc071e10 msgr2=0x7f62fc0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62faa00640 1 --2- 172.21.15.73:0/2301698997 >> v2:172.21.15.118:3300/0 conn(0x7f62fc071e10 0x7f62fc0722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62faa00640 1 -- 172.21.15.73:0/2301698997 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc0b43a0 con 0x7f62fc0b20b0 2024-04-15T15:33:23.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.604+0000 7f62fb400640 1 --2- 172.21.15.73:0/2301698997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc146110 0x7f62fc0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:23.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f62faa00640 1 --2- 172.21.15.73:0/2301698997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 0x7f62fc0b2530 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f62fc073290 tx=0x7f62e801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf306ecfacf1d1b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:23.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f62fa000640 1 -- 172.21.15.73:0/2301698997 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e80b1070 con 0x7f62fc0b20b0 2024-04-15T15:33:23.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f62fa000640 1 -- 172.21.15.73:0/2301698997 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e80ac630 con 0x7f62fc0b20b0 2024-04-15T15:33:23.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f62fa000640 1 -- 172.21.15.73:0/2301698997 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e80a8050 con 0x7f62fc0b20b0 2024-04-15T15:33:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f6302200640 1 -- 172.21.15.73:0/2301698997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 msgr2=0x7f62fc0b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f6302200640 1 --2- 172.21.15.73:0/2301698997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 0x7f62fc0b2530 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f62fc073290 tx=0x7f62e801c520 comp rx=0 tx=0).stop 2024-04-15T15:33:23.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f6302200640 1 -- 172.21.15.73:0/2301698997 shutdown_connections 2024-04-15T15:33:23.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f6302200640 1 --2- 172.21.15.73:0/2301698997 >> v2:172.21.15.118:3300/0 conn(0x7f62fc071e10 0x7f62fc0722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f6302200640 1 --2- 172.21.15.73:0/2301698997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 0x7f62fc0b2530 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f6302200640 1 --2- 172.21.15.73:0/2301698997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc146110 0x7f62fc0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f6302200640 1 -- 172.21.15.73:0/2301698997 >> 172.21.15.73:0/2301698997 conn(0x7f62fc067dd0 msgr2=0x7f62fc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:23.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f6302200640 1 -- 172.21.15.73:0/2301698997 shutdown_connections 2024-04-15T15:33:23.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.608+0000 7f6302200640 1 -- 172.21.15.73:0/2301698997 wait complete. 2024-04-15T15:33:23.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 Processor -- start 2024-04-15T15:33:23.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 -- start start 2024-04-15T15:33:23.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc071e10 0x7f62fc0cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 0x7f62fc0c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62fc146110 0x7f62fc0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc0b3d70 con 0x7f62fc0b20b0 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc0b4c40 con 0x7f62fc146110 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f62fc0cdcf0 con 0x7f62fc071e10 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62faa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 0x7f62fc0c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62faa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 0x7f62fc0c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51776/0 (socket says 172.21.15.73:51776) 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62faa00640 1 -- 172.21.15.73:0/2007752390 learned_addr learned my addr 172.21.15.73:0/2007752390 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62fb400640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc071e10 0x7f62fc0cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62fbe00640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62fc146110 0x7f62fc0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62faa00640 1 -- 172.21.15.73:0/2007752390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc071e10 msgr2=0x7f62fc0cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62faa00640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc071e10 0x7f62fc0cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62faa00640 1 -- 172.21.15.73:0/2007752390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62fc146110 msgr2=0x7f62fc0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62faa00640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62fc146110 0x7f62fc0c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62faa00640 1 -- 172.21.15.73:0/2007752390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc0c8010 con 0x7f62fc0b20b0 2024-04-15T15:33:23.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62faa00640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 0x7f62fc0c7400 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f62e80af040 tx=0x7f62e80192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:23.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62f3400640 1 -- 172.21.15.73:0/2007752390 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e80bc070 con 0x7f62fc0b20b0 2024-04-15T15:33:23.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62f3400640 1 -- 172.21.15.73:0/2007752390 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e80b7430 con 0x7f62fc0b20b0 2024-04-15T15:33:23.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 -- 172.21.15.73:0/2007752390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62fc0c82f0 con 0x7f62fc0b20b0 2024-04-15T15:33:23.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f62f3400640 1 -- 172.21.15.73:0/2007752390 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e80b1040 con 0x7f62fc0b20b0 2024-04-15T15:33:23.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 -- 172.21.15.73:0/2007752390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62fc159f60 con 0x7f62fc0b20b0 2024-04-15T15:33:23.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.612+0000 7f6302200640 1 -- 172.21.15.73:0/2007752390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62fc068ab0 con 0x7f62fc0b20b0 2024-04-15T15:33:23.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.616+0000 7f62f3400640 1 -- 172.21.15.73:0/2007752390 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f62e80bf070 con 0x7f62fc0b20b0 2024-04-15T15:33:23.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.616+0000 7f62f3400640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62dc068410 0x7f62dc06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.616+0000 7f62f3400640 1 -- 172.21.15.73:0/2007752390 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f62e81203f0 con 0x7f62fc0b20b0 2024-04-15T15:33:23.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.616+0000 7f62fb400640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62dc068410 0x7f62dc06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.616+0000 7f62fb400640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62dc068410 0x7f62dc06a8d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f62ec003b90 tx=0x7f62ec009910 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:23.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.620+0000 7f62f3400640 1 -- 172.21.15.73:0/2007752390 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f62e8016110 con 0x7f62fc0b20b0 2024-04-15T15:33:23.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 -- 172.21.15.73:0/2007752390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f62fc0c87a0 con 0x7f62fc0b20b0 2024-04-15T15:33:23.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f62f3400640 1 -- 172.21.15.73:0/2007752390 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f62e80eff60 con 0x7f62fc0b20b0 2024-04-15T15:33:23.781 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 -- 172.21.15.73:0/2007752390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62dc068410 msgr2=0x7f62dc06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62dc068410 0x7f62dc06a8d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f62ec003b90 tx=0x7f62ec009910 comp rx=0 tx=0).stop 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 -- 172.21.15.73:0/2007752390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 msgr2=0x7f62fc0c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 0x7f62fc0c7400 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f62e80af040 tx=0x7f62e80192c0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 -- 172.21.15.73:0/2007752390 shutdown_connections 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62fc146110 0x7f62fc0c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62fc0b20b0 0x7f62fc0c7400 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f62dc068410 0x7f62dc06a8d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 --2- 172.21.15.73:0/2007752390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62fc071e10 0x7f62fc0cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 -- 172.21.15.73:0/2007752390 >> 172.21.15.73:0/2007752390 conn(0x7f62fc067dd0 msgr2=0x7f62fc141e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 -- 172.21.15.73:0/2007752390 shutdown_connections 2024-04-15T15:33:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.780+0000 7f6302200640 1 -- 172.21.15.73:0/2007752390 wait complete. 2024-04-15T15:33:23.802 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T15:33:23.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a56200640 1 Processor -- start 2024-04-15T15:33:23.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a56200640 1 -- start start 2024-04-15T15:33:23.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a56200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7a500af440 0x7f7a50162390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a56200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a500adab0 con 0x7f7a500b26f0 2024-04-15T15:33:23.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a56200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a50162a90 con 0x7f7a500b2310 2024-04-15T15:33:23.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a56200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f7a500b3770 con 0x7f7a500af440 2024-04-15T15:33:23.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4fe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7a500b26f0 0x7f7a500ae270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49822/0 (socket says 172.21.15.73:49822) 2024-04-15T15:33:23.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4fe00640 1 -- 172.21.15.73:0/2122408683 learned_addr learned my addr 172.21.15.73:0/2122408683 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:23.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4ea00640 1 --2- 172.21.15.73:0/2122408683 >> v2:172.21.15.118:3300/0 conn(0x7f7a500af440 0x7f7a50162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443674742 0 0) 0x7f7a500adab0 con 0x7f7a500b26f0 2024-04-15T15:33:23.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a34003530 con 0x7f7a500b26f0 2024-04-15T15:33:23.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2433030236 0 0) 0x7f7a34003530 con 0x7f7a500b26f0 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 >> v2:172.21.15.118:3300/0 conn(0x7f7a500af440 msgr2=0x7f7a50162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 --2- 172.21.15.73:0/2122408683 >> v2:172.21.15.118:3300/0 conn(0x7f7a500af440 0x7f7a50162390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 >> v1:172.21.15.118:6789/0 conn(0x7f7a500b2310 legacy=0x7f7a5015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a50162d70 con 0x7f7a500b26f0 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f7a48001a20 con 0x7f7a500b26f0 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 >> v1:172.21.15.73:6789/0 conn(0x7f7a500b26f0 legacy=0x7f7a500ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a34003a10 0x7f7a34003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a34004810 0x7f7a34004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a340051d0 0x7f7a3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3400c0a0 con 0x7f7a340051d0 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3400c250 con 0x7f7a34004810 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3400c450 con 0x7f7a34003a10 2024-04-15T15:33:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4fe00640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a340051d0 0x7f7a3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4ea00640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a34004810 0x7f7a34004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4f400640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a34003a10 0x7f7a34003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4fe00640 1 -- 172.21.15.73:0/2122408683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a34003a10 msgr2=0x7f7a34003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4fe00640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a34003a10 0x7f7a34003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4fe00640 1 -- 172.21.15.73:0/2122408683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a34004810 msgr2=0x7f7a34004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4fe00640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a34004810 0x7f7a34004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4fe00640 1 -- 172.21.15.73:0/2122408683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a34003530 con 0x7f7a340051d0 2024-04-15T15:33:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.940+0000 7f7a4f400640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a34003a10 0x7f7a34003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:23.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a4fe00640 1 -- 172.21.15.73:0/2122408683 reap_dead start 2024-04-15T15:33:23.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a4fe00640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a340051d0 0x7f7a3400b9d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800a780 tx=0x7f7a4801d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01815e09a2bec65 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:23.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4800a3d0 con 0x7f7a340051d0 2024-04-15T15:33:23.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a480ad650 con 0x7f7a340051d0 2024-04-15T15:33:23.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a4e000640 1 -- 172.21.15.73:0/2122408683 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480a5e60 con 0x7f7a340051d0 2024-04-15T15:33:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a56200640 1 -- 172.21.15.73:0/2122408683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a340051d0 msgr2=0x7f7a3400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a56200640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a340051d0 0x7f7a3400b9d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800a780 tx=0x7f7a4801d280 comp rx=0 tx=0).stop 2024-04-15T15:33:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a56200640 1 -- 172.21.15.73:0/2122408683 shutdown_connections 2024-04-15T15:33:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a56200640 1 --2- 172.21.15.73:0/2122408683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a340051d0 0x7f7a3400b9d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a56200640 1 -- 172.21.15.73:0/2122408683 >> 172.21.15.73:0/2122408683 conn(0x7f7a50067dd0 msgr2=0x7f7a500d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a56200640 1 -- 172.21.15.73:0/2122408683 shutdown_connections 2024-04-15T15:33:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.944+0000 7f7a56200640 1 -- 172.21.15.73:0/2122408683 wait complete. 2024-04-15T15:33:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a56200640 1 Processor -- start 2024-04-15T15:33:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a56200640 1 -- start start 2024-04-15T15:33:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a56200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a340051d0 0x7f7a50154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a56200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a50143df0 0x7f7a50151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a56200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a5006ba50 0x7f7a5006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a56200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5006e690 con 0x7f7a50143df0 2024-04-15T15:33:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a56200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7a500add50 con 0x7f7a5006ba50 2024-04-15T15:33:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a56200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5006e810 con 0x7f7a340051d0 2024-04-15T15:33:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a50143df0 0x7f7a50151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a50143df0 0x7f7a50151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51806/0 (socket says 172.21.15.73:51806) 2024-04-15T15:33:23.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4ea00640 1 -- 172.21.15.73:0/888352382 learned_addr learned my addr 172.21.15.73:0/888352382 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:23.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4f400640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a340051d0 0x7f7a50154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4fe00640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a5006ba50 0x7f7a5006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4ea00640 1 -- 172.21.15.73:0/888352382 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a340051d0 msgr2=0x7f7a50154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4ea00640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a340051d0 0x7f7a50154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4ea00640 1 -- 172.21.15.73:0/888352382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a5006ba50 msgr2=0x7f7a5006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:23.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4ea00640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a5006ba50 0x7f7a5006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:23.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4ea00640 1 -- 172.21.15.73:0/888352382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a50152ec0 con 0x7f7a50143df0 2024-04-15T15:33:23.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a4ea00640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a50143df0 0x7f7a50151dd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0119c0 tx=0x7f7a3c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:23.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a47400640 1 -- 172.21.15.73:0/888352382 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00fbb0 con 0x7f7a50143df0 2024-04-15T15:33:23.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a47400640 1 -- 172.21.15.73:0/888352382 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3c00fd50 con 0x7f7a50143df0 2024-04-15T15:33:23.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a47400640 1 -- 172.21.15.73:0/888352382 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c014680 con 0x7f7a50143df0 2024-04-15T15:33:23.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a56200640 1 -- 172.21.15.73:0/888352382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a50144270 con 0x7f7a50143df0 2024-04-15T15:33:23.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.948+0000 7f7a56200640 1 -- 172.21.15.73:0/888352382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a50152900 con 0x7f7a50143df0 2024-04-15T15:33:23.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.952+0000 7f7a56200640 1 -- 172.21.15.73:0/888352382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a50068ab0 con 0x7f7a50143df0 2024-04-15T15:33:23.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.952+0000 7f7a47400640 1 -- 172.21.15.73:0/888352382 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f7a3c012040 con 0x7f7a50143df0 2024-04-15T15:33:23.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.952+0000 7f7a47400640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7a30068410 0x7f7a3006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:23.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.952+0000 7f7a47400640 1 -- 172.21.15.73:0/888352382 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f7a3c087110 con 0x7f7a50143df0 2024-04-15T15:33:23.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.952+0000 7f7a4f400640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7a30068410 0x7f7a3006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:23.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.952+0000 7f7a4f400640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7a30068410 0x7f7a3006a8d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7a40000c10 tx=0x7f7a40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:23.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:23.956+0000 7f7a47400640 1 -- 172.21.15.73:0/888352382 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7a50152ec0 con 0x7f7a50143df0 2024-04-15T15:33:24.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.112+0000 7f7a56200640 1 -- 172.21.15.73:0/888352382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7a500b1830 con 0x7f7a50143df0 2024-04-15T15:33:24.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.112+0000 7f7a47400640 1 -- 172.21.15.73:0/888352382 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) ==== 104+0+11 (secure 0 0 0) 0x7f7a3c019030 con 0x7f7a50143df0 2024-04-15T15:33:24.115 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-15T15:33:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 -- 172.21.15.73:0/888352382 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7a30068410 msgr2=0x7f7a3006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7a30068410 0x7f7a3006a8d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7a40000c10 tx=0x7f7a40009040 comp rx=0 tx=0).stop 2024-04-15T15:33:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 -- 172.21.15.73:0/888352382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a50143df0 msgr2=0x7f7a50151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a50143df0 0x7f7a50151dd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0119c0 tx=0x7f7a3c011e80 comp rx=0 tx=0).stop 2024-04-15T15:33:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 -- 172.21.15.73:0/888352382 shutdown_connections 2024-04-15T15:33:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a5006ba50 0x7f7a5006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a50143df0 0x7f7a50151dd0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7a30068410 0x7f7a3006a8d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 --2- 172.21.15.73:0/888352382 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a340051d0 0x7f7a50154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 -- 172.21.15.73:0/888352382 >> 172.21.15.73:0/888352382 conn(0x7f7a50067dd0 msgr2=0x7f7a500afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 -- 172.21.15.73:0/888352382 shutdown_connections 2024-04-15T15:33:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.116+0000 7f7a56200640 1 -- 172.21.15.73:0/888352382 wait complete. 2024-04-15T15:33:24.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T15:33:24.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.272+0000 7f2ab3a00640 1 Processor -- start 2024-04-15T15:33:24.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.272+0000 7f2ab3a00640 1 -- start start 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2ab3a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac0b20b0 0x7f2aac0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2ab3a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2aac15cbd0 0x7f2aac15d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2ab3a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aac0cd3a0 con 0x7f2aac146110 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2ab3a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f2aac0b5160 con 0x7f2aac15cbd0 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2ab3a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac0b40c0 con 0x7f2aac0b20b0 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2ab1000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2aac146110 0x7f2aac0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49832/0 (socket says 172.21.15.73:49832) 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2ab1000640 1 -- 172.21.15.73:0/1057223888 learned_addr learned my addr 172.21.15.73:0/1057223888 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2ab1a00640 1 --2- 172.21.15.73:0/1057223888 >> v2:172.21.15.118:3300/0 conn(0x7f2aac15cbd0 0x7f2aac15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2aa3e00640 1 --2- 172.21.15.73:0/1057223888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac0b20b0 0x7f2aac0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2aabe00640 1 -- 172.21.15.73:0/1057223888 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017488388 0 0) 0x7f2aac0cd3a0 con 0x7f2aac146110 2024-04-15T15:33:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2aabe00640 1 -- 172.21.15.73:0/1057223888 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a90003530 con 0x7f2aac146110 2024-04-15T15:33:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2aa3e00640 1 -- 172.21.15.73:0/1057223888 >> v2:172.21.15.118:3300/0 conn(0x7f2aac15cbd0 msgr2=0x7f2aac15d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2aa3e00640 1 --2- 172.21.15.73:0/1057223888 >> v2:172.21.15.118:3300/0 conn(0x7f2aac15cbd0 0x7f2aac15d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2aabe00640 1 -- 172.21.15.73:0/1057223888 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2673916206 0 0) 0x7f2a90003530 con 0x7f2aac146110 2024-04-15T15:33:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2aa3e00640 1 -- 172.21.15.73:0/1057223888 >> v1:172.21.15.73:6789/0 conn(0x7f2aac146110 legacy=0x7f2aac0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.276+0000 7f2aa3e00640 1 -- 172.21.15.73:0/1057223888 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac0b43a0 con 0x7f2aac0b20b0 2024-04-15T15:33:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2aa3e00640 1 --2- 172.21.15.73:0/1057223888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac0b20b0 0x7f2aac0b2530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a940097c0 tx=0x7f2a9401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=462048934a798205 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2aabe00640 1 -- 172.21.15.73:0/1057223888 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a940b0070 con 0x7f2aac0b20b0 2024-04-15T15:33:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2aabe00640 1 -- 172.21.15.73:0/1057223888 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a940ab400 con 0x7f2aac0b20b0 2024-04-15T15:33:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2aabe00640 1 -- 172.21.15.73:0/1057223888 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c001680 con 0x7f2aac0b20b0 2024-04-15T15:33:24.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2ab3a00640 1 -- 172.21.15.73:0/1057223888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac0b20b0 msgr2=0x7f2aac0b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2ab3a00640 1 --2- 172.21.15.73:0/1057223888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac0b20b0 0x7f2aac0b2530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a940097c0 tx=0x7f2a9401c3c0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2ab3a00640 1 -- 172.21.15.73:0/1057223888 shutdown_connections 2024-04-15T15:33:24.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2ab3a00640 1 --2- 172.21.15.73:0/1057223888 >> v2:172.21.15.118:3300/0 conn(0x7f2aac15cbd0 0x7f2aac15d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2ab3a00640 1 --2- 172.21.15.73:0/1057223888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac0b20b0 0x7f2aac0b2530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2ab3a00640 1 -- 172.21.15.73:0/1057223888 >> 172.21.15.73:0/1057223888 conn(0x7f2aac067dd0 msgr2=0x7f2aac0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:24.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2ab3a00640 1 -- 172.21.15.73:0/1057223888 shutdown_connections 2024-04-15T15:33:24.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2ab3a00640 1 -- 172.21.15.73:0/1057223888 wait complete. 2024-04-15T15:33:24.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2ab3a00640 1 Processor -- start 2024-04-15T15:33:24.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.280+0000 7f2ab3a00640 1 -- start start 2024-04-15T15:33:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab3a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0b20b0 0x7f2aac140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab3a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac146110 0x7f2aac139660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab3a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac15cbd0 0x7f2aac13a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab3a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac169210 con 0x7f2aac0b20b0 2024-04-15T15:33:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab3a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac0b3d70 con 0x7f2aac146110 2024-04-15T15:33:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab3a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac169390 con 0x7f2aac15cbd0 2024-04-15T15:33:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab1000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0b20b0 0x7f2aac140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab1000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0b20b0 0x7f2aac140750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51810/0 (socket says 172.21.15.73:51810) 2024-04-15T15:33:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab1000640 1 -- 172.21.15.73:0/2176077563 learned_addr learned my addr 172.21.15.73:0/2176077563 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2aa3e00640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac146110 0x7f2aac139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab1a00640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac15cbd0 0x7f2aac13a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab1000640 1 -- 172.21.15.73:0/2176077563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac15cbd0 msgr2=0x7f2aac13a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab1000640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac15cbd0 0x7f2aac13a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab1000640 1 -- 172.21.15.73:0/2176077563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac146110 msgr2=0x7f2aac139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab1000640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac146110 0x7f2aac139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab1000640 1 -- 172.21.15.73:0/2176077563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac06fe20 con 0x7f2aac0b20b0 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab1000640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0b20b0 0x7f2aac140750 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c730 tx=0x7f2a9c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2aa9600640 1 -- 172.21.15.73:0/2176077563 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c017070 con 0x7f2aac0b20b0 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2aa9600640 1 -- 172.21.15.73:0/2176077563 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9c005ae0 con 0x7f2aac0b20b0 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2aa9600640 1 -- 172.21.15.73:0/2176077563 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c007070 con 0x7f2aac0b20b0 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab3a00640 1 -- 172.21.15.73:0/2176077563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac13c830 con 0x7f2aac0b20b0 2024-04-15T15:33:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab3a00640 1 -- 172.21.15.73:0/2176077563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac13cdf0 con 0x7f2aac0b20b0 2024-04-15T15:33:24.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2ab3a00640 1 -- 172.21.15.73:0/2176077563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac068ab0 con 0x7f2aac0b20b0 2024-04-15T15:33:24.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.284+0000 7f2aa9600640 1 -- 172.21.15.73:0/2176077563 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f2a9c01a070 con 0x7f2aac0b20b0 2024-04-15T15:33:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.288+0000 7f2aa9600640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2a88068410 0x7f2a8806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.288+0000 7f2aa9600640 1 -- 172.21.15.73:0/2176077563 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f2a9c086180 con 0x7f2aac0b20b0 2024-04-15T15:33:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.288+0000 7f2aa3e00640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2a88068410 0x7f2a8806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.288+0000 7f2aa3e00640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2a88068410 0x7f2a8806a8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ad000 tx=0x7f2a940a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:24.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.292+0000 7f2aa9600640 1 -- 172.21.15.73:0/2176077563 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2a9c055e00 con 0x7f2aac0b20b0 2024-04-15T15:33:24.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.448+0000 7f2ab3a00640 1 -- 172.21.15.73:0/2176077563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2aac075d20 con 0x7f2aac0b20b0 2024-04-15T15:33:24.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.448+0000 7f2aa9600640 1 -- 172.21.15.73:0/2176077563 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) ==== 100+0+11 (secure 0 0 0) 0x7f2a9c05a100 con 0x7f2aac0b20b0 2024-04-15T15:33:24.451 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-15T15:33:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 -- 172.21.15.73:0/2176077563 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2a88068410 msgr2=0x7f2a8806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2a88068410 0x7f2a8806a8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ad000 tx=0x7f2a940a6000 comp rx=0 tx=0).stop 2024-04-15T15:33:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 -- 172.21.15.73:0/2176077563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0b20b0 msgr2=0x7f2aac140750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0b20b0 0x7f2aac140750 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c730 tx=0x7f2a9c00cbf0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 -- 172.21.15.73:0/2176077563 shutdown_connections 2024-04-15T15:33:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2a88068410 0x7f2a8806a8d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2aac15cbd0 0x7f2aac13a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac146110 0x7f2aac139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 --2- 172.21.15.73:0/2176077563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0b20b0 0x7f2aac140750 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 -- 172.21.15.73:0/2176077563 >> 172.21.15.73:0/2176077563 conn(0x7f2aac067dd0 msgr2=0x7f2aac0cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 -- 172.21.15.73:0/2176077563 shutdown_connections 2024-04-15T15:33:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.452+0000 7f2ab3a00640 1 -- 172.21.15.73:0/2176077563 wait complete. 2024-04-15T15:33:24.472 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:33:24.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc401400640 1 Processor -- start 2024-04-15T15:33:24.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc401400640 1 -- start start 2024-04-15T15:33:24.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc401400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3fc0b18b0 0x7fc3fc06c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc401400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3fc0b2210 0x7fc3fc0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc401400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc0d0bc0 con 0x7fc3fc0b0510 2024-04-15T15:33:24.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc401400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc3fc0b1420 con 0x7fc3fc0b18b0 2024-04-15T15:33:24.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc401400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc3fc0d0e50 con 0x7fc3fc0b2210 2024-04-15T15:33:24.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc3f3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3fc0b18b0 0x7fc3fc06c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc3f3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3fc0b18b0 0x7fc3fc06c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51826/0 (socket says 172.21.15.73:51826) 2024-04-15T15:33:24.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc3f3e00640 1 -- 172.21.15.73:0/637581928 learned_addr learned my addr 172.21.15.73:0/637581928 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:24.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc400a00640 1 --2- 172.21.15.73:0/637581928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3fc0b2210 0x7fc3fc0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc3f3e00640 1 -- 172.21.15.73:0/637581928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3fc0b2210 msgr2=0x7fc3fc0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:24.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc3f3e00640 1 --2- 172.21.15.73:0/637581928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3fc0b2210 0x7fc3fc0b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc3f3e00640 1 -- 172.21.15.73:0/637581928 >> v1:172.21.15.118:6789/0 conn(0x7fc3fc0b0510 legacy=0x7fc3fc0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc3f3e00640 1 -- 172.21.15.73:0/637581928 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc0b0dd0 con 0x7fc3fc0b18b0 2024-04-15T15:33:24.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.608+0000 7fc3fb400640 1 -- 172.21.15.73:0/637581928 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439225765 0 0) 0x7fc3fc0d0bc0 con 0x7fc3fc0b0510 2024-04-15T15:33:24.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc3f3e00640 1 --2- 172.21.15.73:0/637581928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b18b0 0x7fc3fc06c480 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009870 tx=0x7fc3e401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714763e3c6c24859 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:24.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc3fb400640 1 -- 172.21.15.73:0/637581928 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40b2070 con 0x7fc3fc0b18b0 2024-04-15T15:33:24.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc3fb400640 1 -- 172.21.15.73:0/637581928 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e40a9070 con 0x7fc3fc0b18b0 2024-04-15T15:33:24.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc3fb400640 1 -- 172.21.15.73:0/637581928 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40ad880 con 0x7fc3fc0b18b0 2024-04-15T15:33:24.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc401400640 1 -- 172.21.15.73:0/637581928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b18b0 msgr2=0x7fc3fc06c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc401400640 1 --2- 172.21.15.73:0/637581928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b18b0 0x7fc3fc06c480 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009870 tx=0x7fc3e401c560 comp rx=0 tx=0).stop 2024-04-15T15:33:24.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc401400640 1 -- 172.21.15.73:0/637581928 shutdown_connections 2024-04-15T15:33:24.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc401400640 1 --2- 172.21.15.73:0/637581928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3fc0b2210 0x7fc3fc0b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc401400640 1 --2- 172.21.15.73:0/637581928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b18b0 0x7fc3fc06c480 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc401400640 1 -- 172.21.15.73:0/637581928 >> 172.21.15.73:0/637581928 conn(0x7fc3fc09aa60 msgr2=0x7fc3fc0d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:24.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc401400640 1 -- 172.21.15.73:0/637581928 shutdown_connections 2024-04-15T15:33:24.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc401400640 1 -- 172.21.15.73:0/637581928 wait complete. 2024-04-15T15:33:24.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc401400640 1 Processor -- start 2024-04-15T15:33:24.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.612+0000 7fc401400640 1 -- start start 2024-04-15T15:33:24.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc401400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b0510 0x7fc3fc159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc401400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3fc0b18b0 0x7fc3fc0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc401400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc0b2210 0x7fc3fc0b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc401400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc15eb70 con 0x7fc3fc0b0510 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc401400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc15e9f0 con 0x7fc3fc0b2210 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc401400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc3fc0cb920 con 0x7fc3fc0b18b0 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3fbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b0510 0x7fc3fc159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3fbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b0510 0x7fc3fc159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51838/0 (socket says 172.21.15.73:51838) 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3fbe00640 1 -- 172.21.15.73:0/3957668967 learned_addr learned my addr 172.21.15.73:0/3957668967 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3f3e00640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3fc0b18b0 0x7fc3fc0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc400a00640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc0b2210 0x7fc3fc0b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3fbe00640 1 -- 172.21.15.73:0/3957668967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3fc0b18b0 msgr2=0x7fc3fc0b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3fbe00640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3fc0b18b0 0x7fc3fc0b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3fbe00640 1 -- 172.21.15.73:0/3957668967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc0b2210 msgr2=0x7fc3fc0b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3fbe00640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc0b2210 0x7fc3fc0b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3fbe00640 1 -- 172.21.15.73:0/3957668967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc0cead0 con 0x7fc3fc0b0510 2024-04-15T15:33:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc400a00640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc0b2210 0x7fc3fc0b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3fbe00640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b0510 0x7fc3fc159640 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c4d0 tx=0x7fc3ec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3f8c00640 1 -- 172.21.15.73:0/3957668967 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec017070 con 0x7fc3fc0b0510 2024-04-15T15:33:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3f8c00640 1 -- 172.21.15.73:0/3957668967 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec005480 con 0x7fc3fc0b0510 2024-04-15T15:33:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3f8c00640 1 -- 172.21.15.73:0/3957668967 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec003840 con 0x7fc3fc0b0510 2024-04-15T15:33:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc401400640 1 -- 172.21.15.73:0/3957668967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc0ca010 con 0x7fc3fc0b0510 2024-04-15T15:33:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc401400640 1 -- 172.21.15.73:0/3957668967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc0ca5d0 con 0x7fc3fc0b0510 2024-04-15T15:33:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc401400640 1 -- 172.21.15.73:0/3957668967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3fc04fd60 con 0x7fc3fc0b0510 2024-04-15T15:33:24.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.616+0000 7fc3f8c00640 1 -- 172.21.15.73:0/3957668967 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fc3ec01a070 con 0x7fc3fc0b0510 2024-04-15T15:33:24.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.620+0000 7fc3f8c00640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc3d8068410 0x7fc3d806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.620+0000 7fc3f8c00640 1 -- 172.21.15.73:0/3957668967 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7fc3ec086160 con 0x7fc3fc0b0510 2024-04-15T15:33:24.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.620+0000 7fc3f3e00640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc3d8068410 0x7fc3d806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.620+0000 7fc3f3e00640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc3d8068410 0x7fc3d806a8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40af000 tx=0x7fc3e40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:24.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.624+0000 7fc3f8c00640 1 -- 172.21.15.73:0/3957668967 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc3ec056460 con 0x7fc3fc0b0510 2024-04-15T15:33:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 -- 172.21.15.73:0/3957668967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3fc0b7250 con 0x7fc3fc0b0510 2024-04-15T15:33:24.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc3f8c00640 1 -- 172.21.15.73:0/3957668967 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5186 (secure 0 0 0) 0x7fc3ec055d60 con 0x7fc3fc0b0510 2024-04-15T15:33:24.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:24.818 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/326969724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":326969724},{"type":"v1","addr":"172.21.15.118:6834","nonce":326969724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:32:49.112134+0000","modified":"2024-04-15T15:33:13.617001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.73:6836/1374015509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1374015509},{"type":"v1","addr":"172.21.15.73:6836","nonce":1374015509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":2}]} 2024-04-15T15:33:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-04-15T15:33:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 -- 172.21.15.73:0/3957668967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc3d8068410 msgr2=0x7fc3d806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc3d8068410 0x7fc3d806a8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40af000 tx=0x7fc3e40a7000 comp rx=0 tx=0).stop 2024-04-15T15:33:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 -- 172.21.15.73:0/3957668967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b0510 msgr2=0x7fc3fc159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b0510 0x7fc3fc159640 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c4d0 tx=0x7fc3ec00c990 comp rx=0 tx=0).stop 2024-04-15T15:33:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 -- 172.21.15.73:0/3957668967 shutdown_connections 2024-04-15T15:33:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3fc0b2210 0x7fc3fc0b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc3d8068410 0x7fc3d806a8d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3fc0b18b0 0x7fc3fc0b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 --2- 172.21.15.73:0/3957668967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3fc0b0510 0x7fc3fc159640 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 -- 172.21.15.73:0/3957668967 >> 172.21.15.73:0/3957668967 conn(0x7fc3fc09aa60 msgr2=0x7fc3fc0702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 -- 172.21.15.73:0/3957668967 shutdown_connections 2024-04-15T15:33:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.816+0000 7fc401400640 1 -- 172.21.15.73:0/3957668967 wait complete. 2024-04-15T15:33:24.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:33:24.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.972+0000 7fc471c00640 1 Processor -- start 2024-04-15T15:33:24.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.972+0000 7fc471c00640 1 -- start start 2024-04-15T15:33:24.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.972+0000 7fc471c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15fc90 0x7fc46c0b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.972+0000 7fc471c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c070160 con 0x7fc46c0b27c0 2024-04-15T15:33:24.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.972+0000 7fc471c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c15f1f0 con 0x7fc46c15b5d0 2024-04-15T15:33:24.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.972+0000 7fc471c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc46c15b9b0 con 0x7fc46c15fc90 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc462000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc46c0b27c0 0x7fc46c0b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49834/0 (socket says 172.21.15.73:49834) 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc462000640 1 -- 172.21.15.73:0/1682039891 learned_addr learned my addr 172.21.15.73:0/1682039891 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46b400640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15fc90 0x7fc46c0b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017982705 0 0) 0x7fc46c070160 con 0x7fc46c0b27c0 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc450005740 con 0x7fc46c0b27c0 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 300272456 0 0) 0x7fc46c15f1f0 con 0x7fc46c15b5d0 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc46c070160 con 0x7fc46c15b5d0 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 457036717 0 0) 0x7fc450005740 con 0x7fc46c0b27c0 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15fc90 msgr2=0x7fc46c0b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15fc90 0x7fc46c0b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 >> v1:172.21.15.118:6789/0 conn(0x7fc46c15b5d0 legacy=0x7fc46c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46c06fe80 con 0x7fc46c0b27c0 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7fc454001a00 con 0x7fc46c0b27c0 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 >> v1:172.21.15.73:6789/0 conn(0x7fc46c0b27c0 legacy=0x7fc46c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15fc90 0x7fc450005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc450006340 0x7fc450006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 0x7fc4500073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc45000de10 con 0x7fc450006f60 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc45000dfc0 con 0x7fc450006340 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc45000e1c0 con 0x7fc46c15fc90 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46b400640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 0x7fc4500073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46aa00640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15fc90 0x7fc450005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc462000640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc450006340 0x7fc450006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46b400640 1 -- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15fc90 msgr2=0x7fc450005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46b400640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15fc90 0x7fc450005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46b400640 1 -- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc450006340 msgr2=0x7fc450006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:24.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46b400640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc450006340 0x7fc450006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.976+0000 7fc46b400640 1 -- 172.21.15.73:0/1682039891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc450005740 con 0x7fc450006f60 2024-04-15T15:33:24.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc46b400640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 0x7fc4500073e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc464009ae0 tx=0x7fc46401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147c16e9eb98b44e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:24.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4640096b0 con 0x7fc450006f60 2024-04-15T15:33:24.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4640a6510 con 0x7fc450006f60 2024-04-15T15:33:24.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc46a000640 1 -- 172.21.15.73:0/1682039891 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4640a6900 con 0x7fc450006f60 2024-04-15T15:33:24.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc471c00640 1 -- 172.21.15.73:0/1682039891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 msgr2=0x7fc4500073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc471c00640 1 --2- 172.21.15.73:0/1682039891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 0x7fc4500073e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc464009ae0 tx=0x7fc46401ca70 comp rx=0 tx=0).stop 2024-04-15T15:33:24.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc46b400640 1 -- 172.21.15.73:0/1682039891 reap_dead start 2024-04-15T15:33:24.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc471c00640 1 -- 172.21.15.73:0/1682039891 shutdown_connections 2024-04-15T15:33:24.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc471c00640 1 -- 172.21.15.73:0/1682039891 >> 172.21.15.73:0/1682039891 conn(0x7fc46c067dd0 msgr2=0x7fc46c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:24.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc471c00640 1 -- 172.21.15.73:0/1682039891 shutdown_connections 2024-04-15T15:33:24.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc471c00640 1 -- 172.21.15.73:0/1682039891 wait complete. 2024-04-15T15:33:24.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc471c00640 1 Processor -- start 2024-04-15T15:33:24.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.980+0000 7fc471c00640 1 -- start start 2024-04-15T15:33:24.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc471c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 0x7fc46c0b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc471c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc46c15bc10 0x7fc46c14d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc471c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15c090 0x7fc46c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc471c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c06faa0 con 0x7fc450006f60 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc471c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c0b4240 con 0x7fc46c15bc10 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc471c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc46c06fc20 con 0x7fc46c15c090 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 0x7fc46c0b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 0x7fc46c0b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51852/0 (socket says 172.21.15.73:51852) 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46aa00640 1 -- 172.21.15.73:0/1888930409 learned_addr learned my addr 172.21.15.73:0/1888930409 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc462000640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc46c15bc10 0x7fc46c14d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46b400640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15c090 0x7fc46c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46aa00640 1 -- 172.21.15.73:0/1888930409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15c090 msgr2=0x7fc46c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46aa00640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15c090 0x7fc46c154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46aa00640 1 -- 172.21.15.73:0/1888930409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc46c15bc10 msgr2=0x7fc46c14d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:24.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46aa00640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc46c15bc10 0x7fc46c14d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:24.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46aa00640 1 -- 172.21.15.73:0/1888930409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46c0b4870 con 0x7fc450006f60 2024-04-15T15:33:24.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46b400640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15c090 0x7fc46c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:24.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc46aa00640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 0x7fc46c0b0090 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00f770 tx=0x7fc45c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:24.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc463400640 1 -- 172.21.15.73:0/1888930409 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c0050d0 con 0x7fc450006f60 2024-04-15T15:33:24.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc463400640 1 -- 172.21.15.73:0/1888930409 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc45c018070 con 0x7fc450006f60 2024-04-15T15:33:24.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc471c00640 1 -- 172.21.15.73:0/1888930409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46c153d80 con 0x7fc450006f60 2024-04-15T15:33:24.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc463400640 1 -- 172.21.15.73:0/1888930409 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c00d730 con 0x7fc450006f60 2024-04-15T15:33:24.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc471c00640 1 -- 172.21.15.73:0/1888930409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc46c0b05d0 con 0x7fc450006f60 2024-04-15T15:33:24.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc471c00640 1 -- 172.21.15.73:0/1888930409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc46c068ab0 con 0x7fc450006f60 2024-04-15T15:33:24.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.984+0000 7fc463400640 1 -- 172.21.15.73:0/1888930409 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fc45c00d8d0 con 0x7fc450006f60 2024-04-15T15:33:24.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.988+0000 7fc463400640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc448068410 0x7fc44806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:24.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.988+0000 7fc463400640 1 -- 172.21.15.73:0/1888930409 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7fc45c086a30 con 0x7fc450006f60 2024-04-15T15:33:24.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.988+0000 7fc462000640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc448068410 0x7fc44806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:24.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.988+0000 7fc462000640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc448068410 0x7fc44806a8d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc46c158960 tx=0x7fc454006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:24.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:24.992+0000 7fc463400640 1 -- 172.21.15.73:0/1888930409 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc45c056e10 con 0x7fc450006f60 2024-04-15T15:33:25.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.148+0000 7fc471c00640 1 -- 172.21.15.73:0/1888930409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc46c06f370 con 0x7fc450006f60 2024-04-15T15:33:25.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.148+0000 7fc463400640 1 -- 172.21.15.73:0/1888930409 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17041 (secure 0 0 0) 0x7fc45c056710 con 0x7fc450006f60 2024-04-15T15:33:25.150 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:25.150 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":42,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:33:14.628670+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6834/2635966606":"2024-04-16T15:33:09.602425+0000","172.21.15.118:6832/2635966606":"2024-04-16T15:33:09.602425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:33:25.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 -- 172.21.15.73:0/1888930409 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc448068410 msgr2=0x7fc44806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc448068410 0x7fc44806a8d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc46c158960 tx=0x7fc454006040 comp rx=0 tx=0).stop 2024-04-15T15:33:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 -- 172.21.15.73:0/1888930409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 msgr2=0x7fc46c0b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 0x7fc46c0b0090 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00f770 tx=0x7fc45c00fc30 comp rx=0 tx=0).stop 2024-04-15T15:33:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 -- 172.21.15.73:0/1888930409 shutdown_connections 2024-04-15T15:33:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc448068410 0x7fc44806a8d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46c15c090 0x7fc46c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc46c15bc10 0x7fc46c14d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 --2- 172.21.15.73:0/1888930409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc450006f60 0x7fc46c0b0090 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 -- 172.21.15.73:0/1888930409 >> 172.21.15.73:0/1888930409 conn(0x7fc46c067dd0 msgr2=0x7fc46c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:25.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 -- 172.21.15.73:0/1888930409 shutdown_connections 2024-04-15T15:33:25.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.152+0000 7fc471c00640 1 -- 172.21.15.73:0/1888930409 wait complete. 2024-04-15T15:33:25.172 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-15T15:33:25.172 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:33:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ee00640 1 Processor -- start 2024-04-15T15:33:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ee00640 1 -- start start 2024-04-15T15:33:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ee00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f7815c6d0 0x7f3f780d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ee00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f7809b170 0x7f3f780d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ee00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f780cd690 con 0x7f3f780cd1b0 2024-04-15T15:33:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ee00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3f780cd970 con 0x7f3f7809b170 2024-04-15T15:33:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ee00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3f780cdc50 con 0x7f3f7815c6d0 2024-04-15T15:33:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ce00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f7809b170 0x7f3f780d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ce00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f7809b170 0x7f3f780d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51854/0 (socket says 172.21.15.73:51854) 2024-04-15T15:33:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ce00640 1 -- 172.21.15.73:0/568149152 learned_addr learned my addr 172.21.15.73:0/568149152 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f77e00640 1 --2- 172.21.15.73:0/568149152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f7815c6d0 0x7f3f780d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ce00640 1 -- 172.21.15.73:0/568149152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f7815c6d0 msgr2=0x7f3f780d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ce00640 1 --2- 172.21.15.73:0/568149152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f7815c6d0 0x7f3f780d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ce00640 1 -- 172.21.15.73:0/568149152 >> v1:172.21.15.118:6789/0 conn(0x7f3f780cd1b0 legacy=0x7f3f7809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.308+0000 7f3f7ce00640 1 -- 172.21.15.73:0/568149152 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f780cdf30 con 0x7f3f7809b170 2024-04-15T15:33:25.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ce00640 1 --2- 172.21.15.73:0/568149152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7809b170 0x7f3f780d12b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009e50 tx=0x7f3f7001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c634ae50465d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:25.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f76a00640 1 -- 172.21.15.73:0/568149152 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f700a58f0 con 0x7f3f7809b170 2024-04-15T15:33:25.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f76a00640 1 -- 172.21.15.73:0/568149152 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f700a5a90 con 0x7f3f7809b170 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f76a00640 1 -- 172.21.15.73:0/568149152 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f700a5e60 con 0x7f3f7809b170 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ee00640 1 -- 172.21.15.73:0/568149152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7809b170 msgr2=0x7f3f780d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ee00640 1 --2- 172.21.15.73:0/568149152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7809b170 0x7f3f780d12b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009e50 tx=0x7f3f7001ca00 comp rx=0 tx=0).stop 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ee00640 1 -- 172.21.15.73:0/568149152 shutdown_connections 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ee00640 1 --2- 172.21.15.73:0/568149152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7809b170 0x7f3f780d12b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ee00640 1 --2- 172.21.15.73:0/568149152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f7815c6d0 0x7f3f780d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ee00640 1 -- 172.21.15.73:0/568149152 >> 172.21.15.73:0/568149152 conn(0x7f3f780b3fe0 msgr2=0x7f3f780b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ee00640 1 -- 172.21.15.73:0/568149152 shutdown_connections 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ee00640 1 -- 172.21.15.73:0/568149152 wait complete. 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ee00640 1 Processor -- start 2024-04-15T15:33:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.312+0000 7f3f7ee00640 1 -- start start 2024-04-15T15:33:25.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ee00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f7809b170 0x7f3f78154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f780cd1b0 0x7f3f7815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ee00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7815c6d0 0x7f3f7815d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ee00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3f780b1c20 con 0x7f3f7815c6d0 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3f780b1aa0 con 0x7f3f780cd1b0 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ee00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3f780b1da0 con 0x7f3f7809b170 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ce00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7815c6d0 0x7f3f7815d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ce00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7815c6d0 0x7f3f7815d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51856/0 (socket says 172.21.15.73:51856) 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ce00640 1 -- 172.21.15.73:0/2687247248 learned_addr learned my addr 172.21.15.73:0/2687247248 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f77e00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f7809b170 0x7f3f78154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f77400640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f780cd1b0 0x7f3f7815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ce00640 1 -- 172.21.15.73:0/2687247248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f7809b170 msgr2=0x7f3f78154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ce00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f7809b170 0x7f3f78154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ce00640 1 -- 172.21.15.73:0/2687247248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f780cd1b0 msgr2=0x7f3f7815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ce00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f780cd1b0 0x7f3f7815cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ce00640 1 -- 172.21.15.73:0/2687247248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7806e2a0 con 0x7f3f7815c6d0 2024-04-15T15:33:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ce00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7815c6d0 0x7f3f7815d490 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3f700af040 tx=0x7f3f700197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f6fe00640 1 -- 172.21.15.73:0/2687247248 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f700bc020 con 0x7f3f7815c6d0 2024-04-15T15:33:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f6fe00640 1 -- 172.21.15.73:0/2687247248 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f700b8690 con 0x7f3f7815c6d0 2024-04-15T15:33:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f6fe00640 1 -- 172.21.15.73:0/2687247248 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f700a58f0 con 0x7f3f7815c6d0 2024-04-15T15:33:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ee00640 1 -- 172.21.15.73:0/2687247248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f780c9740 con 0x7f3f7815c6d0 2024-04-15T15:33:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ee00640 1 -- 172.21.15.73:0/2687247248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f780c9d00 con 0x7f3f7815c6d0 2024-04-15T15:33:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.316+0000 7f3f7ee00640 1 -- 172.21.15.73:0/2687247248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f78068ab0 con 0x7f3f7815c6d0 2024-04-15T15:33:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.320+0000 7f3f6fe00640 1 -- 172.21.15.73:0/2687247248 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f3f700bf020 con 0x7f3f7815c6d0 2024-04-15T15:33:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.320+0000 7f3f6fe00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f58068410 0x7f3f5806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.320+0000 7f3f6fe00640 1 -- 172.21.15.73:0/2687247248 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f3f701222c0 con 0x7f3f7815c6d0 2024-04-15T15:33:25.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.320+0000 7f3f77e00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f58068410 0x7f3f5806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.320+0000 7f3f77e00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f58068410 0x7f3f5806a8d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f68006fd0 tx=0x7f3f68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:25.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.324+0000 7f3f6fe00640 1 -- 172.21.15.73:0/2687247248 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f700c6030 con 0x7f3f7815c6d0 2024-04-15T15:33:25.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 -- 172.21.15.73:0/2687247248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f780b4d80 con 0x7f3f7815c6d0 2024-04-15T15:33:25.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f6fe00640 1 -- 172.21.15.73:0/2687247248 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5186 (secure 0 0 0) 0x7f3f70016620 con 0x7f3f7815c6d0 2024-04-15T15:33:25.516 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:25.517 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/326969724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":326969724},{"type":"v1","addr":"172.21.15.118:6834","nonce":326969724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:32:49.112134+0000","modified":"2024-04-15T15:33:13.617001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.73:6836/1374015509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1374015509},{"type":"v1","addr":"172.21.15.73:6836","nonce":1374015509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":2}]} 2024-04-15T15:33:25.517 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-04-15T15:33:25.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 -- 172.21.15.73:0/2687247248 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f58068410 msgr2=0x7f3f5806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f58068410 0x7f3f5806a8d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f68006fd0 tx=0x7f3f68008040 comp rx=0 tx=0).stop 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 -- 172.21.15.73:0/2687247248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7815c6d0 msgr2=0x7f3f7815d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7815c6d0 0x7f3f7815d490 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3f700af040 tx=0x7f3f700197a0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 -- 172.21.15.73:0/2687247248 shutdown_connections 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7815c6d0 0x7f3f7815d490 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f780cd1b0 0x7f3f7815cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f3f58068410 0x7f3f5806a8d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 --2- 172.21.15.73:0/2687247248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f7809b170 0x7f3f78154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 -- 172.21.15.73:0/2687247248 >> 172.21.15.73:0/2687247248 conn(0x7f3f780b3fe0 msgr2=0x7f3f780af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 -- 172.21.15.73:0/2687247248 shutdown_connections 2024-04-15T15:33:25.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.516+0000 7f3f7ee00640 1 -- 172.21.15.73:0/2687247248 wait complete. 2024-04-15T15:33:25.538 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:33:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.672+0000 7f63e1600640 1 Processor -- start 2024-04-15T15:33:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.672+0000 7f63e1600640 1 -- start start 2024-04-15T15:33:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.672+0000 7f63e1600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63dc0d0450 0x7f63dc0cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.672+0000 7f63e1600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63dc0cca10 0x7f63dc06ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.672+0000 7f63e1600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63dc073960 con 0x7f63dc1630f0 2024-04-15T15:33:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.672+0000 7f63e1600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f63dc0d0830 con 0x7f63dc0d0450 2024-04-15T15:33:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.672+0000 7f63e1600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f63dc0ccf50 con 0x7f63dc0cca10 2024-04-15T15:33:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.672+0000 7f63dbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63dc0d0450 0x7f63dc0cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63dbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63dc0d0450 0x7f63dc0cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51868/0 (socket says 172.21.15.73:51868) 2024-04-15T15:33:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63dbe00640 1 -- 172.21.15.73:0/388094439 learned_addr learned my addr 172.21.15.73:0/388094439 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63d3400640 1 --2- 172.21.15.73:0/388094439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63dc0cca10 0x7f63dc06ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63dbe00640 1 -- 172.21.15.73:0/388094439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63dc0cca10 msgr2=0x7f63dc06ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63dbe00640 1 --2- 172.21.15.73:0/388094439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63dc0cca10 0x7f63dc06ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63dbe00640 1 -- 172.21.15.73:0/388094439 >> v1:172.21.15.118:6789/0 conn(0x7f63dc1630f0 legacy=0x7f63dc15ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63dbe00640 1 -- 172.21.15.73:0/388094439 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc0cd230 con 0x7f63dc0d0450 2024-04-15T15:33:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63dbe00640 1 --2- 172.21.15.73:0/388094439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0d0450 0x7f63dc0cc4d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009e80 tx=0x7f63cc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db48e6f3b1603eb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:25.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63db400640 1 -- 172.21.15.73:0/388094439 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a5660 con 0x7f63dc0d0450 2024-04-15T15:33:25.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63db400640 1 -- 172.21.15.73:0/388094439 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc0a5800 con 0x7f63dc0d0450 2024-04-15T15:33:25.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.676+0000 7f63db400640 1 -- 172.21.15.73:0/388094439 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a5bd0 con 0x7f63dc0d0450 2024-04-15T15:33:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 -- 172.21.15.73:0/388094439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0d0450 msgr2=0x7f63dc0cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 --2- 172.21.15.73:0/388094439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0d0450 0x7f63dc0cc4d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009e80 tx=0x7f63cc01c950 comp rx=0 tx=0).stop 2024-04-15T15:33:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 -- 172.21.15.73:0/388094439 shutdown_connections 2024-04-15T15:33:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 --2- 172.21.15.73:0/388094439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63dc0cca10 0x7f63dc06ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 --2- 172.21.15.73:0/388094439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0d0450 0x7f63dc0cc4d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 -- 172.21.15.73:0/388094439 >> 172.21.15.73:0/388094439 conn(0x7f63dc072370 msgr2=0x7f63dc072750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 -- 172.21.15.73:0/388094439 shutdown_connections 2024-04-15T15:33:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 -- 172.21.15.73:0/388094439 wait complete. 2024-04-15T15:33:25.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 Processor -- start 2024-04-15T15:33:25.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 -- start start 2024-04-15T15:33:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0cca10 0x7f63dc157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63dc0d0450 0x7f63dc13dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63dc1630f0 0x7f63dc155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc16b910 con 0x7f63dc0cca10 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc073080 con 0x7f63dc0d0450 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e1600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f63dc16ba90 con 0x7f63dc1630f0 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63dbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0cca10 0x7f63dc157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63dbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0cca10 0x7f63dc157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51878/0 (socket says 172.21.15.73:51878) 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63dbe00640 1 -- 172.21.15.73:0/3913247292 learned_addr learned my addr 172.21.15.73:0/3913247292 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63e0c00640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63dc1630f0 0x7f63dc155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63d3400640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63dc0d0450 0x7f63dc13dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63dbe00640 1 -- 172.21.15.73:0/3913247292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63dc1630f0 msgr2=0x7f63dc155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63dbe00640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63dc1630f0 0x7f63dc155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63dbe00640 1 -- 172.21.15.73:0/3913247292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63dc0d0450 msgr2=0x7f63dc13dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63dbe00640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63dc0d0450 0x7f63dc13dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63dbe00640 1 -- 172.21.15.73:0/3913247292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc1563c0 con 0x7f63dc0cca10 2024-04-15T15:33:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63dbe00640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0cca10 0x7f63dc157b40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f63cc01a580 tx=0x7f63cc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63d8c00640 1 -- 172.21.15.73:0/3913247292 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0bc020 con 0x7f63dc0cca10 2024-04-15T15:33:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63d8c00640 1 -- 172.21.15.73:0/3913247292 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc0b8690 con 0x7f63dc0cca10 2024-04-15T15:33:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.680+0000 7f63d8c00640 1 -- 172.21.15.73:0/3913247292 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc009510 con 0x7f63dc0cca10 2024-04-15T15:33:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.684+0000 7f63e1600640 1 -- 172.21.15.73:0/3913247292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63dc13e200 con 0x7f63dc0cca10 2024-04-15T15:33:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.684+0000 7f63e1600640 1 -- 172.21.15.73:0/3913247292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63dc13e7c0 con 0x7f63dc0cca10 2024-04-15T15:33:25.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.684+0000 7f63e1600640 1 -- 172.21.15.73:0/3913247292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63dc04fd60 con 0x7f63dc0cca10 2024-04-15T15:33:25.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.684+0000 7f63d8c00640 1 -- 172.21.15.73:0/3913247292 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f63cc0bf020 con 0x7f63dc0cca10 2024-04-15T15:33:25.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.684+0000 7f63d8c00640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f63b8068410 0x7f63b806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:25.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.684+0000 7f63d8c00640 1 -- 172.21.15.73:0/3913247292 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f63cc121bc0 con 0x7f63dc0cca10 2024-04-15T15:33:25.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.684+0000 7f63d3400640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f63b8068410 0x7f63b806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:25.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.684+0000 7f63d3400640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f63b8068410 0x7f63b806a8d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f63dc1625e0 tx=0x7f63c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:25.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.688+0000 7f63d8c00640 1 -- 172.21.15.73:0/3913247292 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63cc016600 con 0x7f63dc0cca10 2024-04-15T15:33:25.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.880+0000 7f63e1600640 1 -- 172.21.15.73:0/3913247292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63dc067d90 con 0x7f63dc0cca10 2024-04-15T15:33:25.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.880+0000 7f63d8c00640 1 -- 172.21.15.73:0/3913247292 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5186 (secure 0 0 0) 0x7f63cc0f2070 con 0x7f63dc0cca10 2024-04-15T15:33:25.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:25.883 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/326969724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":326969724},{"type":"v1","addr":"172.21.15.118:6834","nonce":326969724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T15:32:49.112134+0000","modified":"2024-04-15T15:33:13.617001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.73:6836/1374015509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1374015509},{"type":"v1","addr":"172.21.15.73:6836","nonce":1374015509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5322,"qdb_cluster":[5322]},"id":2}]} 2024-04-15T15:33:25.884 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-04-15T15:33:25.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 -- 172.21.15.73:0/3913247292 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f63b8068410 msgr2=0x7f63b806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f63b8068410 0x7f63b806a8d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f63dc1625e0 tx=0x7f63c4008040 comp rx=0 tx=0).stop 2024-04-15T15:33:25.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 -- 172.21.15.73:0/3913247292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0cca10 msgr2=0x7f63dc157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:25.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0cca10 0x7f63dc157b40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f63cc01a580 tx=0x7f63cc0196f0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 -- 172.21.15.73:0/3913247292 shutdown_connections 2024-04-15T15:33:25.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f63b8068410 0x7f63b806a8d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63dc1630f0 0x7f63dc155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63dc0d0450 0x7f63dc13dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 --2- 172.21.15.73:0/3913247292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63dc0cca10 0x7f63dc157b40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:25.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 -- 172.21.15.73:0/3913247292 >> 172.21.15.73:0/3913247292 conn(0x7f63dc072370 msgr2=0x7f63dc0c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:25.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 -- 172.21.15.73:0/3913247292 shutdown_connections 2024-04-15T15:33:25.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:25.884+0000 7f63e1600640 1 -- 172.21.15.73:0/3913247292 wait complete. 2024-04-15T15:33:25.904 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:33:26.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.036+0000 7f1170a00640 1 Processor -- start 2024-04-15T15:33:26.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.036+0000 7f1170a00640 1 -- start start 2024-04-15T15:33:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1170a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0b20b0 0x7f116c0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1170a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f116c0cd3a0 con 0x7f116c146110 2024-04-15T15:33:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1170a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f116c0b5160 con 0x7f116c15cbd0 2024-04-15T15:33:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1170a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f116c0b40c0 con 0x7f116c0b20b0 2024-04-15T15:33:26.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f116c146110 0x7f116c0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49846/0 (socket says 172.21.15.73:49846) 2024-04-15T15:33:26.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169e00640 1 -- 172.21.15.73:0/304978281 learned_addr learned my addr 172.21.15.73:0/304978281 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1161400640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0b20b0 0x7f116c0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1560139661 0 0) 0x7f116c0cd3a0 con 0x7f116c146110 2024-04-15T15:33:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1150003530 con 0x7f116c146110 2024-04-15T15:33:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2091917256 0 0) 0x7f1150003530 con 0x7f116c146110 2024-04-15T15:33:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0b20b0 msgr2=0x7f116c0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0b20b0 0x7f116c0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 >> v1:172.21.15.118:6789/0 conn(0x7f116c15cbd0 legacy=0x7f116c15d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c0b43a0 con 0x7f116c146110 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7f115c001a00 con 0x7f116c146110 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 >> v1:172.21.15.73:6789/0 conn(0x7f116c146110 legacy=0x7f116c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11500039f0 0x7f1150003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 0x7f1150004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0b20b0 0x7f11500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f116c0b40c0 con 0x7f1150004810 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f115000ba80 con 0x7f11500039f0 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f115000bc80 con 0x7f116c0b20b0 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1161400640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 0x7f1150004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169e00640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11500039f0 0x7f1150003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f116a800640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0b20b0 0x7f11500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1161400640 1 -- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0b20b0 msgr2=0x7f11500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1161400640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0b20b0 0x7f11500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1161400640 1 -- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11500039f0 msgr2=0x7f1150003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:26.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1161400640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11500039f0 0x7f1150003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1161400640 1 -- 172.21.15.73:0/304978281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1150003530 con 0x7f1150004810 2024-04-15T15:33:26.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.040+0000 7f1169e00640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11500039f0 0x7f1150003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:26.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1161400640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 0x7f1150004c90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1154009ab0 tx=0x7f115401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66786b5d3dc1513c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:26.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11540b2070 con 0x7f1150004810 2024-04-15T15:33:26.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11540a5620 con 0x7f1150004810 2024-04-15T15:33:26.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1169400640 1 -- 172.21.15.73:0/304978281 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11540096b0 con 0x7f1150004810 2024-04-15T15:33:26.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1170a00640 1 -- 172.21.15.73:0/304978281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 msgr2=0x7f1150004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1170a00640 1 --2- 172.21.15.73:0/304978281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 0x7f1150004c90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1154009ab0 tx=0x7f115401ca30 comp rx=0 tx=0).stop 2024-04-15T15:33:26.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f116a800640 1 -- 172.21.15.73:0/304978281 reap_dead start 2024-04-15T15:33:26.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1170a00640 1 -- 172.21.15.73:0/304978281 shutdown_connections 2024-04-15T15:33:26.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1170a00640 1 -- 172.21.15.73:0/304978281 >> 172.21.15.73:0/304978281 conn(0x7f116c067dd0 msgr2=0x7f116c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:26.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1170a00640 1 -- 172.21.15.73:0/304978281 shutdown_connections 2024-04-15T15:33:26.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1170a00640 1 -- 172.21.15.73:0/304978281 wait complete. 2024-04-15T15:33:26.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1170a00640 1 Processor -- start 2024-04-15T15:33:26.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.044+0000 7f1170a00640 1 -- start start 2024-04-15T15:33:26.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1170a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 0x7f116c13ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1170a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f116c1f4360 0x7f116c0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1170a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0c58d0 0x7f116c0ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1170a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f116c0b4c40 con 0x7f1150004810 2024-04-15T15:33:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1170a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f116c0b4960 con 0x7f116c1f4360 2024-04-15T15:33:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1170a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f116c0b3d70 con 0x7f116c0c58d0 2024-04-15T15:33:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1169e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 0x7f116c13ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1169e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 0x7f116c13ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51896/0 (socket says 172.21.15.73:51896) 2024-04-15T15:33:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1169e00640 1 -- 172.21.15.73:0/1531053931 learned_addr learned my addr 172.21.15.73:0/1531053931 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f116a800640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0c58d0 0x7f116c0ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1161400640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f116c1f4360 0x7f116c0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1169e00640 1 -- 172.21.15.73:0/1531053931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0c58d0 msgr2=0x7f116c0ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1169e00640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0c58d0 0x7f116c0ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1169e00640 1 -- 172.21.15.73:0/1531053931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f116c1f4360 msgr2=0x7f116c0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1169e00640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f116c1f4360 0x7f116c0c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1169e00640 1 -- 172.21.15.73:0/1531053931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c0acc70 con 0x7f1150004810 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1169e00640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 0x7f116c13ccf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f115c011880 tx=0x7f115c011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1162a00640 1 -- 172.21.15.73:0/1531053931 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c010040 con 0x7f1150004810 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1162a00640 1 -- 172.21.15.73:0/1531053931 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115c01a070 con 0x7f1150004810 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1162a00640 1 -- 172.21.15.73:0/1531053931 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c00fd60 con 0x7f1150004810 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1170a00640 1 -- 172.21.15.73:0/1531053931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c0acf50 con 0x7f1150004810 2024-04-15T15:33:26.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1170a00640 1 -- 172.21.15.73:0/1531053931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c0ad510 con 0x7f1150004810 2024-04-15T15:33:26.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1170a00640 1 -- 172.21.15.73:0/1531053931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116c0c5ce0 con 0x7f1150004810 2024-04-15T15:33:26.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.048+0000 7f1162a00640 1 -- 172.21.15.73:0/1531053931 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f115c01f460 con 0x7f1150004810 2024-04-15T15:33:26.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.052+0000 7f1162a00640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1148068410 0x7f114806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.052+0000 7f1162a00640 1 -- 172.21.15.73:0/1531053931 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f115c089e60 con 0x7f1150004810 2024-04-15T15:33:26.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.052+0000 7f1161400640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1148068410 0x7f114806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.052+0000 7f1161400640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1148068410 0x7f114806a8d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f11540af000 tx=0x7f11540046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.056+0000 7f1162a00640 1 -- 172.21.15.73:0/1531053931 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f116c0c5ce0 con 0x7f1150004810 2024-04-15T15:33:26.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.212+0000 7f1170a00640 1 -- 172.21.15.73:0/1531053931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f116c1423b0 con 0x7f1150004810 2024-04-15T15:33:26.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1162a00640 1 -- 172.21.15.73:0/1531053931 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17041 (secure 0 0 0) 0x7f115c05a1c0 con 0x7f1150004810 2024-04-15T15:33:26.216 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:26.216 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":42,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:33:14.628670+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-15T15:32:46.793984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-15T15:32:48.072270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.7","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6834/2635966606":"2024-04-16T15:33:09.602425+0000","172.21.15.118:6832/2635966606":"2024-04-16T15:33:09.602425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:33:26.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 -- 172.21.15.73:0/1531053931 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1148068410 msgr2=0x7f114806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1148068410 0x7f114806a8d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f11540af000 tx=0x7f11540046d0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 -- 172.21.15.73:0/1531053931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 msgr2=0x7f116c13ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 0x7f116c13ccf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f115c011880 tx=0x7f115c011d40 comp rx=0 tx=0).stop 2024-04-15T15:33:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 -- 172.21.15.73:0/1531053931 shutdown_connections 2024-04-15T15:33:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1148068410 0x7f114806a8d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f116c0c58d0 0x7f116c0ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f116c1f4360 0x7f116c0c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 --2- 172.21.15.73:0/1531053931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1150004810 0x7f116c13ccf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 -- 172.21.15.73:0/1531053931 >> 172.21.15.73:0/1531053931 conn(0x7f116c067dd0 msgr2=0x7f116c143580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 -- 172.21.15.73:0/1531053931 shutdown_connections 2024-04-15T15:33:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.216+0000 7f1170a00640 1 -- 172.21.15.73:0/1531053931 wait complete. 2024-04-15T15:33:26.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-15T15:33:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f243f200640 1 Processor -- start 2024-04-15T15:33:26.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f243f200640 1 -- start start 2024-04-15T15:33:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f243f200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f24380b20b0 0x7f24380b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f243f200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f243815cbd0 0x7f243815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f243f200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24380cd3a0 con 0x7f2438146110 2024-04-15T15:33:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f243f200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f24380b5160 con 0x7f24380b20b0 2024-04-15T15:33:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f243f200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f24380b40c0 con 0x7f243815cbd0 2024-04-15T15:33:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f2437e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2438146110 0x7f24380cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49848/0 (socket says 172.21.15.73:49848) 2024-04-15T15:33:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f2437e00640 1 -- 172.21.15.73:0/2840586600 learned_addr learned my addr 172.21.15.73:0/2840586600 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f242f400640 1 --2- 172.21.15.73:0/2840586600 >> v2:172.21.15.73:3300/0 conn(0x7f24380b20b0 0x7f24380b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f243d200640 1 --2- 172.21.15.73:0/2840586600 >> v2:172.21.15.118:3300/0 conn(0x7f243815cbd0 0x7f243815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f2437400640 1 -- 172.21.15.73:0/2840586600 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299047509 0 0) 0x7f24380cd3a0 con 0x7f2438146110 2024-04-15T15:33:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f2437400640 1 -- 172.21.15.73:0/2840586600 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f241c003530 con 0x7f2438146110 2024-04-15T15:33:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f242f400640 1 -- 172.21.15.73:0/2840586600 >> v2:172.21.15.118:3300/0 conn(0x7f243815cbd0 msgr2=0x7f243815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f242f400640 1 --2- 172.21.15.73:0/2840586600 >> v2:172.21.15.118:3300/0 conn(0x7f243815cbd0 0x7f243815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f242f400640 1 -- 172.21.15.73:0/2840586600 >> v1:172.21.15.73:6789/0 conn(0x7f2438146110 legacy=0x7f24380cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.372+0000 7f242f400640 1 -- 172.21.15.73:0/2840586600 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24380b43a0 con 0x7f24380b20b0 2024-04-15T15:33:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f243d200640 1 --2- 172.21.15.73:0/2840586600 >> v2:172.21.15.118:3300/0 conn(0x7f243815cbd0 0x7f243815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f242f400640 1 --2- 172.21.15.73:0/2840586600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 0x7f24380b2530 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f24380cd570 tx=0x7f242001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bef5f3550ebad56 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f2437400640 1 -- 172.21.15.73:0/2840586600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24200b0070 con 0x7f24380b20b0 2024-04-15T15:33:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f2437400640 1 -- 172.21.15.73:0/2840586600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2420004230 con 0x7f24380b20b0 2024-04-15T15:33:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f2437400640 1 -- 172.21.15.73:0/2840586600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420003620 con 0x7f24380b20b0 2024-04-15T15:33:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f243f200640 1 -- 172.21.15.73:0/2840586600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 msgr2=0x7f24380b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f243f200640 1 --2- 172.21.15.73:0/2840586600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 0x7f24380b2530 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f24380cd570 tx=0x7f242001c460 comp rx=0 tx=0).stop 2024-04-15T15:33:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f243f200640 1 -- 172.21.15.73:0/2840586600 shutdown_connections 2024-04-15T15:33:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f243f200640 1 --2- 172.21.15.73:0/2840586600 >> v2:172.21.15.118:3300/0 conn(0x7f243815cbd0 0x7f243815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f243f200640 1 --2- 172.21.15.73:0/2840586600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 0x7f24380b2530 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f243f200640 1 -- 172.21.15.73:0/2840586600 >> 172.21.15.73:0/2840586600 conn(0x7f2438067dd0 msgr2=0x7f24380d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f243f200640 1 -- 172.21.15.73:0/2840586600 shutdown_connections 2024-04-15T15:33:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.376+0000 7f243f200640 1 -- 172.21.15.73:0/2840586600 wait complete. 2024-04-15T15:33:26.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f243f200640 1 Processor -- start 2024-04-15T15:33:26.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f243f200640 1 -- start start 2024-04-15T15:33:26.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f243f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 0x7f243806de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f243f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2438146110 0x7f24381592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f243f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243815cbd0 0x7f24380aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f243f200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2438169210 con 0x7f24380b20b0 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f243f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f24380b3d70 con 0x7f2438146110 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f243f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2438169390 con 0x7f243815cbd0 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2437e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 0x7f243806de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2437e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 0x7f243806de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51922/0 (socket says 172.21.15.73:51922) 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2437e00640 1 -- 172.21.15.73:0/3265287550 learned_addr learned my addr 172.21.15.73:0/3265287550 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2437e00640 1 -- 172.21.15.73:0/3265287550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243815cbd0 msgr2=0x7f24380aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2437e00640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243815cbd0 0x7f24380aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2437e00640 1 -- 172.21.15.73:0/3265287550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2438146110 msgr2=0x7f24381592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2437e00640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2438146110 0x7f24381592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2437e00640 1 -- 172.21.15.73:0/3265287550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24381411a0 con 0x7f24380b20b0 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2437e00640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 0x7f243806de10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f242800c480 tx=0x7f242800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2434c00640 1 -- 172.21.15.73:0/3265287550 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2428017070 con 0x7f24380b20b0 2024-04-15T15:33:26.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2434c00640 1 -- 172.21.15.73:0/3265287550 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2428005cf0 con 0x7f24380b20b0 2024-04-15T15:33:26.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f243f200640 1 -- 172.21.15.73:0/3265287550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24380af2e0 con 0x7f24380b20b0 2024-04-15T15:33:26.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f2434c00640 1 -- 172.21.15.73:0/3265287550 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2428007290 con 0x7f24380b20b0 2024-04-15T15:33:26.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.380+0000 7f243f200640 1 -- 172.21.15.73:0/3265287550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243806e780 con 0x7f24380b20b0 2024-04-15T15:33:26.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.384+0000 7f243f200640 1 -- 172.21.15.73:0/3265287550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2438068ab0 con 0x7f24380b20b0 2024-04-15T15:33:26.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.384+0000 7f2434c00640 1 -- 172.21.15.73:0/3265287550 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f242801a070 con 0x7f24380b20b0 2024-04-15T15:33:26.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.384+0000 7f2434c00640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2414068410 0x7f241406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.384+0000 7f2434c00640 1 -- 172.21.15.73:0/3265287550 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f24280860b0 con 0x7f24380b20b0 2024-04-15T15:33:26.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.384+0000 7f242f400640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2414068410 0x7f241406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.384+0000 7f242f400640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2414068410 0x7f241406a8d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f24200ad000 tx=0x7f2420004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:26.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.388+0000 7f2434c00640 1 -- 172.21.15.73:0/3265287550 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2428056410 con 0x7f24380b20b0 2024-04-15T15:33:26.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.576+0000 7f243f200640 1 -- 172.21.15.73:0/3265287550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f243806f0b0 con 0x7f24380b20b0 2024-04-15T15:33:26.579 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-04-15T15:33:26.576+0000 7f0e1ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T15:33:26.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.580+0000 7f2434c00640 1 -- 172.21.15.73:0/3265287550 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) ==== 161+0+0 (secure 0 0 0) 0x7f2428055d10 con 0x7f24380b20b0 2024-04-15T15:33:26.581 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 -- 172.21.15.73:0/3265287550 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2414068410 msgr2=0x7f241406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2414068410 0x7f241406a8d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f24200ad000 tx=0x7f2420004740 comp rx=0 tx=0).stop 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 -- 172.21.15.73:0/3265287550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 msgr2=0x7f243806de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 0x7f243806de10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f242800c480 tx=0x7f242800c940 comp rx=0 tx=0).stop 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 -- 172.21.15.73:0/3265287550 shutdown_connections 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2414068410 0x7f241406a8d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243815cbd0 0x7f24380aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2438146110 0x7f24381592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 --2- 172.21.15.73:0/3265287550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24380b20b0 0x7f243806de10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 -- 172.21.15.73:0/3265287550 >> 172.21.15.73:0/3265287550 conn(0x7f2438067dd0 msgr2=0x7f2438071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 -- 172.21.15.73:0/3265287550 shutdown_connections 2024-04-15T15:33:26.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.584+0000 7f243f200640 1 -- 172.21.15.73:0/3265287550 wait complete. 2024-04-15T15:33:26.597 INFO:tasks.ceph.mds.a.smithi073.stderr: -1157> 2024-04-15T15:33:17.692+0000 7f8109c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-15T15:33:26.605 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-15T15:33:26.641 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-04-15T15:33:26.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.744+0000 7fd4a1a00640 1 Processor -- start 2024-04-15T15:33:26.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.744+0000 7fd4a1a00640 1 -- start start 2024-04-15T15:33:26.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd4a1a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd49c06fc90 0x7fd49c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd4a1a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c072520 0x7fd49c15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd4a1a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c06f5a0 con 0x7fd49c15e910 2024-04-15T15:33:26.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd4a1a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd49c15b9e0 con 0x7fd49c06fc90 2024-04-15T15:33:26.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd4a1a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd49c15f480 con 0x7fd49c072520 2024-04-15T15:33:26.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd49b400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c072520 0x7fd49c15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd49aa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd49c06fc90 0x7fd49c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd49b400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c072520 0x7fd49c15edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:55052/0 (socket says 172.21.15.73:55052) 2024-04-15T15:33:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd49b400640 1 -- 172.21.15.73:0/1431778694 learned_addr learned my addr 172.21.15.73:0/1431778694 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd49aa00640 1 -- 172.21.15.73:0/1431778694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c072520 msgr2=0x7fd49c15edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd49aa00640 1 --2- 172.21.15.73:0/1431778694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c072520 0x7fd49c15edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd49aa00640 1 -- 172.21.15.73:0/1431778694 >> v1:172.21.15.118:6789/0 conn(0x7fd49c15e910 legacy=0x7fd49c071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd49a000640 1 -- 172.21.15.73:0/1431778694 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1525930202 0 0) 0x7fd484001120 con 0x7fd49c15e910 2024-04-15T15:33:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd49aa00640 1 -- 172.21.15.73:0/1431778694 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c15f760 con 0x7fd49c06fc90 2024-04-15T15:33:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.748+0000 7fd49b400640 1 --2- 172.21.15.73:0/1431778694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c072520 0x7fd49c15edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:26.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd49aa00640 1 --2- 172.21.15.73:0/1431778694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c06fc90 0x7fd49c15be70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0097c0 tx=0x7fd48c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88d3521430184dac server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:26.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd49a000640 1 -- 172.21.15.73:0/1431778694 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0b0070 con 0x7fd49c06fc90 2024-04-15T15:33:26.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd49a000640 1 -- 172.21.15.73:0/1431778694 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48c0ab600 con 0x7fd49c06fc90 2024-04-15T15:33:26.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd49a000640 1 -- 172.21.15.73:0/1431778694 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0ab9d0 con 0x7fd49c06fc90 2024-04-15T15:33:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd4a1a00640 1 -- 172.21.15.73:0/1431778694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c06fc90 msgr2=0x7fd49c15be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd4a1a00640 1 --2- 172.21.15.73:0/1431778694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c06fc90 0x7fd49c15be70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0097c0 tx=0x7fd48c01c470 comp rx=0 tx=0).stop 2024-04-15T15:33:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd4a1a00640 1 -- 172.21.15.73:0/1431778694 shutdown_connections 2024-04-15T15:33:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd4a1a00640 1 --2- 172.21.15.73:0/1431778694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c072520 0x7fd49c15edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd4a1a00640 1 --2- 172.21.15.73:0/1431778694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c06fc90 0x7fd49c15be70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd4a1a00640 1 -- 172.21.15.73:0/1431778694 >> 172.21.15.73:0/1431778694 conn(0x7fd49c067dd0 msgr2=0x7fd49c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd4a1a00640 1 -- 172.21.15.73:0/1431778694 shutdown_connections 2024-04-15T15:33:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd4a1a00640 1 -- 172.21.15.73:0/1431778694 wait complete. 2024-04-15T15:33:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd4a1a00640 1 Processor -- start 2024-04-15T15:33:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.752+0000 7fd4a1a00640 1 -- start start 2024-04-15T15:33:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd4a1a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c06fc90 0x7fd49c1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd4a1a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49c072520 0x7fd49c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd4a1a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c15e910 0x7fd49c1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd4a1a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c0b3f90 con 0x7fd49c072520 2024-04-15T15:33:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd4a1a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c0b3e10 con 0x7fd49c15e910 2024-04-15T15:33:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd4a1a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd49c0b4110 con 0x7fd49c06fc90 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd492000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49c072520 0x7fd49c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd492000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49c072520 0x7fd49c154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51954/0 (socket says 172.21.15.73:51954) 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd492000640 1 -- 172.21.15.73:0/3513817039 learned_addr learned my addr 172.21.15.73:0/3513817039 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd49b400640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c15e910 0x7fd49c1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd49aa00640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c06fc90 0x7fd49c1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd492000640 1 -- 172.21.15.73:0/3513817039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c06fc90 msgr2=0x7fd49c1522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd492000640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c06fc90 0x7fd49c1522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd492000640 1 -- 172.21.15.73:0/3513817039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c15e910 msgr2=0x7fd49c1509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd492000640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c15e910 0x7fd49c1509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd492000640 1 -- 172.21.15.73:0/3513817039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c151220 con 0x7fd49c072520 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd49b400640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c15e910 0x7fd49c1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd492000640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49c072520 0x7fd49c154f10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd48400c440 tx=0x7fd48400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:26.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd493400640 1 -- 172.21.15.73:0/3513817039 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484005480 con 0x7fd49c072520 2024-04-15T15:33:26.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd493400640 1 -- 172.21.15.73:0/3513817039 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd484003600 con 0x7fd49c072520 2024-04-15T15:33:26.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd4a1a00640 1 -- 172.21.15.73:0/3513817039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd49c151500 con 0x7fd49c072520 2024-04-15T15:33:26.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd493400640 1 -- 172.21.15.73:0/3513817039 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4840039f0 con 0x7fd49c072520 2024-04-15T15:33:26.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd4a1a00640 1 -- 172.21.15.73:0/3513817039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd49c151da0 con 0x7fd49c072520 2024-04-15T15:33:26.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.756+0000 7fd4a1a00640 1 -- 172.21.15.73:0/3513817039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd49c1516d0 con 0x7fd49c072520 2024-04-15T15:33:26.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.760+0000 7fd493400640 1 -- 172.21.15.73:0/3513817039 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fd484003b90 con 0x7fd49c072520 2024-04-15T15:33:26.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.760+0000 7fd493400640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd478068410 0x7fd47806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:26.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.760+0000 7fd493400640 1 -- 172.21.15.73:0/3513817039 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6302+0+0 (secure 0 0 0) 0x7fd484086930 con 0x7fd49c072520 2024-04-15T15:33:26.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.760+0000 7fd49aa00640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd478068410 0x7fd47806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:26.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.760+0000 7fd49aa00640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd478068410 0x7fd47806a8d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0ad000 tx=0x7fd48c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:26.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.764+0000 7fd493400640 1 -- 172.21.15.73:0/3513817039 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd49c06f5a0 con 0x7fd49c072520 2024-04-15T15:33:26.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:26.952+0000 7fd4a1a00640 1 -- 172.21.15.73:0/3513817039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd49c151fa0 con 0x7fd49c072520 2024-04-15T15:33:27.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.580+0000 7fd493400640 1 -- 172.21.15.73:0/3513817039 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) ==== 104+0+0 (secure 0 0 0) 0x7fd49c151fa0 con 0x7fd49c072520 2024-04-15T15:33:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 -- 172.21.15.73:0/3513817039 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd478068410 msgr2=0x7fd47806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd478068410 0x7fd47806a8d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0ad000 tx=0x7fd48c008040 comp rx=0 tx=0).stop 2024-04-15T15:33:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 -- 172.21.15.73:0/3513817039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49c072520 msgr2=0x7fd49c154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49c072520 0x7fd49c154f10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd48400c440 tx=0x7fd48400c900 comp rx=0 tx=0).stop 2024-04-15T15:33:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 -- 172.21.15.73:0/3513817039 shutdown_connections 2024-04-15T15:33:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c15e910 0x7fd49c1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd49c072520 0x7fd49c154f10 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fd478068410 0x7fd47806a8d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 --2- 172.21.15.73:0/3513817039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd49c06fc90 0x7fd49c1522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:27.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 -- 172.21.15.73:0/3513817039 >> 172.21.15.73:0/3513817039 conn(0x7fd49c067dd0 msgr2=0x7fd49c15a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 -- 172.21.15.73:0/3513817039 shutdown_connections 2024-04-15T15:33:27.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.584+0000 7fd4a1a00640 1 -- 172.21.15.73:0/3513817039 wait complete. 2024-04-15T15:33:27.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-15T15:33:27.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14f400640 1 Processor -- start 2024-04-15T15:33:27.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14f400640 1 -- start start 2024-04-15T15:33:27.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14f400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14809aa60 0x7ff1480ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff14809ae40 0x7ff1480b5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14f400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1480cd0e0 con 0x7ff14809b7e0 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14f400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff14809bf10 con 0x7ff14809ae40 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14f400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff14809bc40 con 0x7ff14809aa60 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff147e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff14809b7e0 0x7ff1480d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37290/0 (socket says 172.21.15.73:37290) 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff147e00640 1 -- 172.21.15.73:0/548204325 learned_addr learned my addr 172.21.15.73:0/548204325 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14d400640 1 --2- 172.21.15.73:0/548204325 >> v2:172.21.15.73:3300/0 conn(0x7ff14809ae40 0x7ff1480b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14ca00640 1 --2- 172.21.15.73:0/548204325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14809aa60 0x7ff1480ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff147400640 1 -- 172.21.15.73:0/548204325 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 346760317 0 0) 0x7ff1480cd0e0 con 0x7ff14809b7e0 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff147400640 1 -- 172.21.15.73:0/548204325 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff130003530 con 0x7ff14809b7e0 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14d400640 1 -- 172.21.15.73:0/548204325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14809aa60 msgr2=0x7ff1480ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14d400640 1 --2- 172.21.15.73:0/548204325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14809aa60 0x7ff1480ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:27.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14d400640 1 -- 172.21.15.73:0/548204325 >> v1:172.21.15.73:6789/0 conn(0x7ff14809b7e0 legacy=0x7ff1480d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:27.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.792+0000 7ff14d400640 1 -- 172.21.15.73:0/548204325 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14815cb70 con 0x7ff14809ae40 2024-04-15T15:33:27.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff14d400640 1 --2- 172.21.15.73:0/548204325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809ae40 0x7ff1480b5390 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff140009d90 tx=0x7ff14001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1c81304a5c9dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:27.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff147400640 1 -- 172.21.15.73:0/548204325 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1400b2070 con 0x7ff14809ae40 2024-04-15T15:33:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff147400640 1 -- 172.21.15.73:0/548204325 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1400a5970 con 0x7ff14809ae40 2024-04-15T15:33:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff147400640 1 -- 172.21.15.73:0/548204325 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1400a5d20 con 0x7ff14809ae40 2024-04-15T15:33:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff14f400640 1 -- 172.21.15.73:0/548204325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809ae40 msgr2=0x7ff1480b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff14f400640 1 --2- 172.21.15.73:0/548204325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809ae40 0x7ff1480b5390 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff140009d90 tx=0x7ff14001c8b0 comp rx=0 tx=0).stop 2024-04-15T15:33:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff14f400640 1 -- 172.21.15.73:0/548204325 shutdown_connections 2024-04-15T15:33:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff14f400640 1 --2- 172.21.15.73:0/548204325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809ae40 0x7ff1480b5390 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff14f400640 1 --2- 172.21.15.73:0/548204325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14809aa60 0x7ff1480ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff14f400640 1 -- 172.21.15.73:0/548204325 >> 172.21.15.73:0/548204325 conn(0x7ff1480b4030 msgr2=0x7ff1480b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff14f400640 1 -- 172.21.15.73:0/548204325 shutdown_connections 2024-04-15T15:33:27.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.796+0000 7ff14f400640 1 -- 172.21.15.73:0/548204325 wait complete. 2024-04-15T15:33:27.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14f400640 1 Processor -- start 2024-04-15T15:33:27.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14f400640 1 -- start start 2024-04-15T15:33:27.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809aa60 0x7ff1481592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:27.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff14809ae40 0x7ff1480c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:27.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14f400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14809b7e0 0x7ff14814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:27.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14f400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff14809b2f0 con 0x7ff14809aa60 2024-04-15T15:33:27.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14f400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff1480cdc20 con 0x7ff14809ae40 2024-04-15T15:33:27.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14f400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff1481695f0 con 0x7ff14809b7e0 2024-04-15T15:33:27.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14ca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809aa60 0x7ff1481592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:27.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14ca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809aa60 0x7ff1481592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38124/0 (socket says 172.21.15.73:38124) 2024-04-15T15:33:27.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14ca00640 1 -- 172.21.15.73:0/2762213470 learned_addr learned my addr 172.21.15.73:0/2762213470 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:27.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14d400640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14809b7e0 0x7ff14814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:27.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff147e00640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff14809ae40 0x7ff1480c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:27.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14ca00640 1 -- 172.21.15.73:0/2762213470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14809b7e0 msgr2=0x7ff14814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:27.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14ca00640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14809b7e0 0x7ff14814ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:27.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14ca00640 1 -- 172.21.15.73:0/2762213470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff14809ae40 msgr2=0x7ff1480c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:27.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14ca00640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff14809ae40 0x7ff1480c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:27.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14ca00640 1 -- 172.21.15.73:0/2762213470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1480c60b0 con 0x7ff14809aa60 2024-04-15T15:33:27.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14ca00640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809aa60 0x7ff1481592f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00e870 tx=0x7ff13c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:27.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff144c00640 1 -- 172.21.15.73:0/2762213470 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c017070 con 0x7ff14809aa60 2024-04-15T15:33:27.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff144c00640 1 -- 172.21.15.73:0/2762213470 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13c00c940 con 0x7ff14809aa60 2024-04-15T15:33:27.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff144c00640 1 -- 172.21.15.73:0/2762213470 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c00ccf0 con 0x7ff14809aa60 2024-04-15T15:33:27.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14f400640 1 -- 172.21.15.73:0/2762213470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1480c6390 con 0x7ff14809aa60 2024-04-15T15:33:27.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.800+0000 7ff14f400640 1 -- 172.21.15.73:0/2762213470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1480c6950 con 0x7ff14809aa60 2024-04-15T15:33:27.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.804+0000 7ff14f400640 1 -- 172.21.15.73:0/2762213470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff148068b20 con 0x7ff14809aa60 2024-04-15T15:33:27.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.804+0000 7ff144c00640 1 -- 172.21.15.73:0/2762213470 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7ff13c01a070 con 0x7ff14809aa60 2024-04-15T15:33:27.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.804+0000 7ff144c00640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff128068440 0x7ff12806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:27.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.804+0000 7ff144c00640 1 -- 172.21.15.73:0/2762213470 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6302+0+0 (secure 0 0 0) 0x7ff13c086f20 con 0x7ff14809aa60 2024-04-15T15:33:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.804+0000 7ff147e00640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff128068440 0x7ff12806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.804+0000 7ff147e00640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff128068440 0x7ff12806a900 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff134005890 tx=0x7ff134009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.808+0000 7ff144c00640 1 -- 172.21.15.73:0/2762213470 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff13c057230 con 0x7ff14809aa60 2024-04-15T15:33:27.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:27.968+0000 7ff14f400640 1 -- 172.21.15.73:0/2762213470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff14809b5c0 con 0x7ff14809aa60 2024-04-15T15:33:28.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.680+0000 7ff144c00640 1 -- 172.21.15.73:0/2762213470 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) ==== 181+0+0 (secure 0 0 0) 0x7ff13c056b30 con 0x7ff14809aa60 2024-04-15T15:33:28.682 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-04-15T15:33:28.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 -- 172.21.15.73:0/2762213470 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff128068440 msgr2=0x7ff12806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:28.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff128068440 0x7ff12806a900 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff134005890 tx=0x7ff134009040 comp rx=0 tx=0).stop 2024-04-15T15:33:28.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 -- 172.21.15.73:0/2762213470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809aa60 msgr2=0x7ff1481592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:28.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809aa60 0x7ff1481592f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00e870 tx=0x7ff13c00ec70 comp rx=0 tx=0).stop 2024-04-15T15:33:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 -- 172.21.15.73:0/2762213470 shutdown_connections 2024-04-15T15:33:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff128068440 0x7ff12806a900 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff14809b7e0 0x7ff14814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff14809ae40 0x7ff1480c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 --2- 172.21.15.73:0/2762213470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff14809aa60 0x7ff1481592f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 -- 172.21.15.73:0/2762213470 >> 172.21.15.73:0/2762213470 conn(0x7ff1480b4030 msgr2=0x7ff1480b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 -- 172.21.15.73:0/2762213470 shutdown_connections 2024-04-15T15:33:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.684+0000 7ff14f400640 1 -- 172.21.15.73:0/2762213470 wait complete. 2024-04-15T15:33:28.708 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-15T15:33:28.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.848+0000 7fa134e00640 1 Processor -- start 2024-04-15T15:33:28.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.848+0000 7fa134e00640 1 -- start start 2024-04-15T15:33:28.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa134e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa13015c890 0x7fa13006ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:28.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa134e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa13006bf90 0x7fa1300b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:28.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa134e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13015be20 con 0x7fa130159340 2024-04-15T15:33:28.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa134e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa13015ccf0 con 0x7fa13006bf90 2024-04-15T15:33:28.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa134e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa130159720 con 0x7fa13015c890 2024-04-15T15:33:28.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa12e800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa13006bf90 0x7fa1300b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:28.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa12e800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa13006bf90 0x7fa1300b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38126/0 (socket says 172.21.15.73:38126) 2024-04-15T15:33:28.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa12e800640 1 -- 172.21.15.73:0/1567057733 learned_addr learned my addr 172.21.15.73:0/1567057733 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:28.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa12d400640 1 --2- 172.21.15.73:0/1567057733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa13015c890 0x7fa13006ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:28.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa12e800640 1 -- 172.21.15.73:0/1567057733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa13015c890 msgr2=0x7fa13006ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:28.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa12e800640 1 --2- 172.21.15.73:0/1567057733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa13015c890 0x7fa13006ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:28.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa12e800640 1 -- 172.21.15.73:0/1567057733 >> v1:172.21.15.118:6789/0 conn(0x7fa130159340 legacy=0x7fa1300ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:28.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa12e800640 1 -- 172.21.15.73:0/1567057733 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13006c3b0 con 0x7fa13006bf90 2024-04-15T15:33:28.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.852+0000 7fa12e800640 1 --2- 172.21.15.73:0/1567057733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 0x7fa1300b3a70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa128009e50 tx=0x7fa12801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f343f294187cd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:28.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa12ca00640 1 -- 172.21.15.73:0/1567057733 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1280a58d0 con 0x7fa13006bf90 2024-04-15T15:33:28.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa12ca00640 1 -- 172.21.15.73:0/1567057733 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1280a5a70 con 0x7fa13006bf90 2024-04-15T15:33:28.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa12ca00640 1 -- 172.21.15.73:0/1567057733 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1280a5e40 con 0x7fa13006bf90 2024-04-15T15:33:28.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 -- 172.21.15.73:0/1567057733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 msgr2=0x7fa1300b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:28.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 --2- 172.21.15.73:0/1567057733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 0x7fa1300b3a70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa128009e50 tx=0x7fa12801ca00 comp rx=0 tx=0).stop 2024-04-15T15:33:28.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 -- 172.21.15.73:0/1567057733 shutdown_connections 2024-04-15T15:33:28.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 --2- 172.21.15.73:0/1567057733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 0x7fa1300b3a70 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:28.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 --2- 172.21.15.73:0/1567057733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa13015c890 0x7fa13006ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:28.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 -- 172.21.15.73:0/1567057733 >> 172.21.15.73:0/1567057733 conn(0x7fa130067e30 msgr2=0x7fa1300b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:28.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 -- 172.21.15.73:0/1567057733 shutdown_connections 2024-04-15T15:33:28.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 -- 172.21.15.73:0/1567057733 wait complete. 2024-04-15T15:33:28.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 Processor -- start 2024-04-15T15:33:28.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 -- start start 2024-04-15T15:33:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 0x7fa13014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa130159340 0x7fa130150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa13015c890 0x7fa130150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa1300cf990 con 0x7fa13006bf90 2024-04-15T15:33:28.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa1300d00f0 con 0x7fa130159340 2024-04-15T15:33:28.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa134e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa1300cf250 con 0x7fa13015c890 2024-04-15T15:33:28.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa12de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 0x7fa13014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:28.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa12de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 0x7fa13014d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38136/0 (socket says 172.21.15.73:38136) 2024-04-15T15:33:28.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa12de00640 1 -- 172.21.15.73:0/1424230153 learned_addr learned my addr 172.21.15.73:0/1424230153 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:28.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa12d400640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa130159340 0x7fa130150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:28.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.856+0000 7fa12e800640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa13015c890 0x7fa130150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:28.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa12de00640 1 -- 172.21.15.73:0/1424230153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa13015c890 msgr2=0x7fa130150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:28.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa12de00640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa13015c890 0x7fa130150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:28.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa12de00640 1 -- 172.21.15.73:0/1424230153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa130159340 msgr2=0x7fa130150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:28.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa12de00640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa130159340 0x7fa130150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:28.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa12de00640 1 -- 172.21.15.73:0/1424230153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa130159a60 con 0x7fa13006bf90 2024-04-15T15:33:28.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa12de00640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 0x7fa13014d210 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa12000c420 tx=0x7fa12000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:28.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa126000640 1 -- 172.21.15.73:0/1424230153 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1200052d0 con 0x7fa13006bf90 2024-04-15T15:33:28.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa126000640 1 -- 172.21.15.73:0/1424230153 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120005470 con 0x7fa13006bf90 2024-04-15T15:33:28.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa134e00640 1 -- 172.21.15.73:0/1424230153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa130159d40 con 0x7fa13006bf90 2024-04-15T15:33:28.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa126000640 1 -- 172.21.15.73:0/1424230153 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120007260 con 0x7fa13006bf90 2024-04-15T15:33:28.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa134e00640 1 -- 172.21.15.73:0/1424230153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13015a820 con 0x7fa13006bf90 2024-04-15T15:33:28.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa134e00640 1 -- 172.21.15.73:0/1424230153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa130068b20 con 0x7fa13006bf90 2024-04-15T15:33:28.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa126000640 1 -- 172.21.15.73:0/1424230153 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fa120007400 con 0x7fa13006bf90 2024-04-15T15:33:28.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa126000640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa110068410 0x7fa11006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:28.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.860+0000 7fa126000640 1 -- 172.21.15.73:0/1424230153 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5864+0+0 (secure 0 0 0) 0x7fa120085f40 con 0x7fa13006bf90 2024-04-15T15:33:28.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.864+0000 7fa12d400640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa110068410 0x7fa11006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:28.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.864+0000 7fa12d400640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa110068410 0x7fa11006a8d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa1300b3d10 tx=0x7fa11c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:28.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:28.868+0000 7fa126000640 1 -- 172.21.15.73:0/1424230153 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa120055db0 con 0x7fa13006bf90 2024-04-15T15:33:29.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.024+0000 7fa134e00640 1 -- 172.21.15.73:0/1424230153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa130155160 con 0x7fa13006bf90 2024-04-15T15:33:29.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.684+0000 7fa126000640 1 -- 172.21.15.73:0/1424230153 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) ==== 169+0+0 (secure 0 0 0) 0x7fa12005a0b0 con 0x7fa13006bf90 2024-04-15T15:33:29.688 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-04-15T15:33:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.688+0000 7fa134e00640 1 -- 172.21.15.73:0/1424230153 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa110068410 msgr2=0x7fa11006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.688+0000 7fa134e00640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa110068410 0x7fa11006a8d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa1300b3d10 tx=0x7fa11c008040 comp rx=0 tx=0).stop 2024-04-15T15:33:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.688+0000 7fa134e00640 1 -- 172.21.15.73:0/1424230153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 msgr2=0x7fa13014d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.688+0000 7fa134e00640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 0x7fa13014d210 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa12000c420 tx=0x7fa12000c8e0 comp rx=0 tx=0).stop 2024-04-15T15:33:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.692+0000 7fa134e00640 1 -- 172.21.15.73:0/1424230153 shutdown_connections 2024-04-15T15:33:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.692+0000 7fa134e00640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa110068410 0x7fa11006a8d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.692+0000 7fa134e00640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa13015c890 0x7fa130150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.692+0000 7fa134e00640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa130159340 0x7fa130150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.692+0000 7fa134e00640 1 --2- 172.21.15.73:0/1424230153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa13006bf90 0x7fa13014d210 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.692+0000 7fa134e00640 1 -- 172.21.15.73:0/1424230153 >> 172.21.15.73:0/1424230153 conn(0x7fa130067e30 msgr2=0x7fa130157950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.692+0000 7fa134e00640 1 -- 172.21.15.73:0/1424230153 shutdown_connections 2024-04-15T15:33:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.692+0000 7fa134e00640 1 -- 172.21.15.73:0/1424230153 wait complete. 2024-04-15T15:33:29.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-15T15:33:29.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.860+0000 7fa7c2000640 1 Processor -- start 2024-04-15T15:33:29.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.860+0000 7fa7c2000640 1 -- start start 2024-04-15T15:33:29.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7c2000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7bc0af440 0x7fa7bc162390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:29.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7c2000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7bc0adab0 con 0x7fa7bc0b2310 2024-04-15T15:33:29.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7c2000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7bc162a90 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7c2000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa7bc0b3770 con 0x7fa7bc0af440 2024-04-15T15:33:29.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7b2a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7bc0af440 0x7fa7bc162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:29.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7bb400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa7bc0b2310 0x7fa7bc15e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37298/0 (socket says 172.21.15.73:37298) 2024-04-15T15:33:29.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7bb400640 1 -- 172.21.15.73:0/177364289 learned_addr learned my addr 172.21.15.73:0/177364289 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7baa00640 1 -- 172.21.15.73:0/177364289 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721435332 0 0) 0x7fa7bc0adab0 con 0x7fa7bc0b2310 2024-04-15T15:33:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7b2a00640 1 -- 172.21.15.73:0/177364289 >> v1:172.21.15.118:6789/0 conn(0x7fa7bc0b26f0 legacy=0x7fa7bc0ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7b2a00640 1 -- 172.21.15.73:0/177364289 >> v1:172.21.15.73:6789/0 conn(0x7fa7bc0b2310 legacy=0x7fa7bc15e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7b2a00640 1 -- 172.21.15.73:0/177364289 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc162d70 con 0x7fa7bc0af440 2024-04-15T15:33:29.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.864+0000 7fa7b2a00640 1 --2- 172.21.15.73:0/177364289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0af440 0x7fa7bc162390 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40097c0 tx=0x7fa7a401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b179b4fc14ce0814 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:29.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7baa00640 1 -- 172.21.15.73:0/177364289 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40b0070 con 0x7fa7bc0af440 2024-04-15T15:33:29.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7baa00640 1 -- 172.21.15.73:0/177364289 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a40ab600 con 0x7fa7bc0af440 2024-04-15T15:33:29.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7baa00640 1 -- 172.21.15.73:0/177364289 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40ab9d0 con 0x7fa7bc0af440 2024-04-15T15:33:29.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 -- 172.21.15.73:0/177364289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0af440 msgr2=0x7fa7bc162390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 --2- 172.21.15.73:0/177364289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0af440 0x7fa7bc162390 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40097c0 tx=0x7fa7a401c460 comp rx=0 tx=0).stop 2024-04-15T15:33:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 -- 172.21.15.73:0/177364289 shutdown_connections 2024-04-15T15:33:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 --2- 172.21.15.73:0/177364289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0af440 0x7fa7bc162390 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 -- 172.21.15.73:0/177364289 >> 172.21.15.73:0/177364289 conn(0x7fa7bc067dd0 msgr2=0x7fa7bc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 -- 172.21.15.73:0/177364289 shutdown_connections 2024-04-15T15:33:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 -- 172.21.15.73:0/177364289 wait complete. 2024-04-15T15:33:29.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 Processor -- start 2024-04-15T15:33:29.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 -- start start 2024-04-15T15:33:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7bc0af440 0x7fa7bc14ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7bc0b2310 0x7fa7bc15ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0b26f0 0x7fa7bc15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc16c8c0 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc16c740 con 0x7fa7bc0b2310 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7c2000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa7bc16ca40 con 0x7fa7bc0af440 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0b26f0 0x7fa7bc15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0b26f0 0x7fa7bc15bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38144/0 (socket says 172.21.15.73:38144) 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.868+0000 7fa7bbe00640 1 -- 172.21.15.73:0/2485204395 learned_addr learned my addr 172.21.15.73:0/2485204395 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7bbe00640 1 -- 172.21.15.73:0/2485204395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7bc0af440 msgr2=0x7fa7bc14ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7bbe00640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7bc0af440 0x7fa7bc14ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7bbe00640 1 -- 172.21.15.73:0/2485204395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7bc0b2310 msgr2=0x7fa7bc15ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7bbe00640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7bc0b2310 0x7fa7bc15ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7bbe00640 1 -- 172.21.15.73:0/2485204395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc1542e0 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7bbe00640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0b26f0 0x7fa7bc15bfb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400b440 tx=0x7fa7b400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7b3e00640 1 -- 172.21.15.73:0/2485204395 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4015020 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7b3e00640 1 -- 172.21.15.73:0/2485204395 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b4011850 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7b3e00640 1 -- 172.21.15.73:0/2485204395 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4011c40 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7c2000640 1 -- 172.21.15.73:0/2485204395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc153760 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7c2000640 1 -- 172.21.15.73:0/2485204395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc153d20 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7c2000640 1 -- 172.21.15.73:0/2485204395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7bc068ab0 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7b3e00640 1 -- 172.21.15.73:0/2485204395 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fa7b4018020 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7b3e00640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa798068410 0x7fa79806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7b3e00640 1 -- 172.21.15.73:0/2485204395 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fa7b4086890 con 0x7fa7bc0b26f0 2024-04-15T15:33:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.872+0000 7fa7bb400640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa798068410 0x7fa79806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:29.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.876+0000 7fa7bb400640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa798068410 0x7fa79806a8d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac005c10 tx=0x7fa7ac0016a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:29.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:29.876+0000 7fa7b3e00640 1 -- 172.21.15.73:0/2485204395 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7b401f020 con 0x7fa7bc0b26f0 2024-04-15T15:33:30.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.036+0000 7fa7c2000640 1 -- 172.21.15.73:0/2485204395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fa7bc0aff80 con 0x7fa7bc0b26f0 2024-04-15T15:33:30.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7b3e00640 1 -- 172.21.15.73:0/2485204395 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fa7b40172c0 con 0x7fa7bc0b26f0 2024-04-15T15:33:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 -- 172.21.15.73:0/2485204395 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa798068410 msgr2=0x7fa79806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa798068410 0x7fa79806a8d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac005c10 tx=0x7fa7ac0016a0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 -- 172.21.15.73:0/2485204395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0b26f0 msgr2=0x7fa7bc15bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0b26f0 0x7fa7bc15bfb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400b440 tx=0x7fa7b400b900 comp rx=0 tx=0).stop 2024-04-15T15:33:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 -- 172.21.15.73:0/2485204395 shutdown_connections 2024-04-15T15:33:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7bc0b26f0 0x7fa7bc15bfb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7bc0b2310 0x7fa7bc15ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fa798068410 0x7fa79806a8d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 --2- 172.21.15.73:0/2485204395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7bc0af440 0x7fa7bc14ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 -- 172.21.15.73:0/2485204395 >> 172.21.15.73:0/2485204395 conn(0x7fa7bc067dd0 msgr2=0x7fa7bc06eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 -- 172.21.15.73:0/2485204395 shutdown_connections 2024-04-15T15:33:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.040+0000 7fa7c2000640 1 -- 172.21.15.73:0/2485204395 wait complete. 2024-04-15T15:33:30.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds debug_mds 2024-04-15T15:33:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.196+0000 7f600ea00640 1 Processor -- start 2024-04-15T15:33:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.196+0000 7f600ea00640 1 -- start start 2024-04-15T15:33:30.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60080b27c0 0x7f600815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60080b3e30 0x7f60080b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ea00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6008070160 con 0x7f600815b5d0 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ea00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f600815b9b0 con 0x7f60080b3e30 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ea00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f600815f1f0 con 0x7f60080b27c0 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60080b3e30 0x7f60080b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60080b3e30 0x7f60080b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38148/0 (socket says 172.21.15.73:38148) 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ca00640 1 -- 172.21.15.73:0/1612688273 learned_addr learned my addr 172.21.15.73:0/1612688273 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f6007400640 1 --2- 172.21.15.73:0/1612688273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60080b27c0 0x7f600815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ca00640 1 -- 172.21.15.73:0/1612688273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60080b27c0 msgr2=0x7f600815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ca00640 1 --2- 172.21.15.73:0/1612688273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60080b27c0 0x7f600815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ca00640 1 -- 172.21.15.73:0/1612688273 >> v1:172.21.15.118:6789/0 conn(0x7f600815b5d0 legacy=0x7f60080b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.200+0000 7f600ca00640 1 -- 172.21.15.73:0/1612688273 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600806fe80 con 0x7f60080b3e30 2024-04-15T15:33:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ca00640 1 --2- 172.21.15.73:0/1612688273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 0x7f60080b4740 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6000009e50 tx=0x7f600001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2fb376c2a0366d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f6006a00640 1 -- 172.21.15.73:0/1612688273 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60000090d0 con 0x7f60080b3e30 2024-04-15T15:33:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f6006a00640 1 -- 172.21.15.73:0/1612688273 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60000a5720 con 0x7f60080b3e30 2024-04-15T15:33:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f6006a00640 1 -- 172.21.15.73:0/1612688273 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000009270 con 0x7f60080b3e30 2024-04-15T15:33:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 -- 172.21.15.73:0/1612688273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 msgr2=0x7f60080b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 --2- 172.21.15.73:0/1612688273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 0x7f60080b4740 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6000009e50 tx=0x7f600001c8a0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 -- 172.21.15.73:0/1612688273 shutdown_connections 2024-04-15T15:33:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 --2- 172.21.15.73:0/1612688273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 0x7f60080b4740 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 --2- 172.21.15.73:0/1612688273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60080b27c0 0x7f600815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 -- 172.21.15.73:0/1612688273 >> 172.21.15.73:0/1612688273 conn(0x7f6008067dd0 msgr2=0x7f60080d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 -- 172.21.15.73:0/1612688273 shutdown_connections 2024-04-15T15:33:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 -- 172.21.15.73:0/1612688273 wait complete. 2024-04-15T15:33:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 Processor -- start 2024-04-15T15:33:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 -- start start 2024-04-15T15:33:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60080b27c0 0x7f6008151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 0x7f60081f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f600815b5d0 0x7f60081f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f600806faa0 con 0x7f60080b3e30 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f60080cfd00 con 0x7f600815b5d0 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f600ea00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f600806fc20 con 0x7f60080b27c0 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f6007400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 0x7f60081f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f6007400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 0x7f60081f70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38160/0 (socket says 172.21.15.73:38160) 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.204+0000 7f6007400640 1 -- 172.21.15.73:0/1163597260 learned_addr learned my addr 172.21.15.73:0/1163597260 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f6007e00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60080b27c0 0x7f6008151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f600ca00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f600815b5d0 0x7f60081f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f6007400640 1 -- 172.21.15.73:0/1163597260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60080b27c0 msgr2=0x7f6008151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f6007400640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60080b27c0 0x7f6008151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f6007400640 1 -- 172.21.15.73:0/1163597260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f600815b5d0 msgr2=0x7f60081f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f6007400640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f600815b5d0 0x7f60081f7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f6007400640 1 -- 172.21.15.73:0/1163597260 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60080aea40 con 0x7f60080b3e30 2024-04-15T15:33:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f6007400640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 0x7f60081f70d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400d620 tx=0x7f5ff400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f5fffe00640 1 -- 172.21.15.73:0/1163597260 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400b620 con 0x7f60080b3e30 2024-04-15T15:33:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f5fffe00640 1 -- 172.21.15.73:0/1163597260 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff4019070 con 0x7f60080b3e30 2024-04-15T15:33:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f600ea00640 1 -- 172.21.15.73:0/1163597260 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6008159540 con 0x7f60080b3e30 2024-04-15T15:33:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f5fffe00640 1 -- 172.21.15.73:0/1163597260 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400b9e0 con 0x7f60080b3e30 2024-04-15T15:33:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f600ea00640 1 -- 172.21.15.73:0/1163597260 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60080ae480 con 0x7f60080b3e30 2024-04-15T15:33:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f600ea00640 1 -- 172.21.15.73:0/1163597260 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6008068ab0 con 0x7f60080b3e30 2024-04-15T15:33:30.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f5fffe00640 1 -- 172.21.15.73:0/1163597260 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f5ff400bb80 con 0x7f60080b3e30 2024-04-15T15:33:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f5fffe00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5fe8068410 0x7f5fe806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f5fffe00640 1 -- 172.21.15.73:0/1163597260 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f5ff4086c90 con 0x7f60080b3e30 2024-04-15T15:33:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.208+0000 7f6007e00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5fe8068410 0x7f5fe806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.212+0000 7f6007e00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5fe8068410 0x7f5fe806a8d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8007fd0 tx=0x7f5ff8007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.212+0000 7f5fffe00640 1 -- 172.21.15.73:0/1163597260 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ff4056c30 con 0x7f60080b3e30 2024-04-15T15:33:30.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.372+0000 7f600ea00640 1 -- 172.21.15.73:0/1163597260 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "debug_mds"} v 0) -- 0x7f600806f370 con 0x7f60080b3e30 2024-04-15T15:33:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f5fffe00640 1 -- 172.21.15.73:0/1163597260 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "debug_mds"}]=0 v14) ==== 92+0+0 (secure 0 0 0) 0x7f5ff405af30 con 0x7f60080b3e30 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 -- 172.21.15.73:0/1163597260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5fe8068410 msgr2=0x7f5fe806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5fe8068410 0x7f5fe806a8d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8007fd0 tx=0x7f5ff8007e40 comp rx=0 tx=0).stop 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 -- 172.21.15.73:0/1163597260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 msgr2=0x7f60081f70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 0x7f60081f70d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400d620 tx=0x7f5ff400dae0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 -- 172.21.15.73:0/1163597260 shutdown_connections 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f600815b5d0 0x7f60081f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60080b3e30 0x7f60081f70d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5fe8068410 0x7f5fe806a8d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 --2- 172.21.15.73:0/1163597260 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60080b27c0 0x7f6008151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 -- 172.21.15.73:0/1163597260 >> 172.21.15.73:0/1163597260 conn(0x7f6008067dd0 msgr2=0x7f60080d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 -- 172.21.15.73:0/1163597260 shutdown_connections 2024-04-15T15:33:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.376+0000 7f600ea00640 1 -- 172.21.15.73:0/1163597260 wait complete. 2024-04-15T15:33:30.398 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_quiesce_splitauth 2024-04-15T15:33:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.532+0000 7fe57e200640 1 Processor -- start 2024-04-15T15:33:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.532+0000 7fe57e200640 1 -- start start 2024-04-15T15:33:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe57e200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5780b27c0 0x7fe57815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe57e200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe578070160 con 0x7fe5780b3e30 2024-04-15T15:33:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe57e200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe57815f1f0 con 0x7fe57815b5d0 2024-04-15T15:33:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe57e200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe57815b9b0 con 0x7fe5780b27c0 2024-04-15T15:33:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe577e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe5780b3e30 0x7fe5780b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37300/0 (socket says 172.21.15.73:37300) 2024-04-15T15:33:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe577e00640 1 -- 172.21.15.73:0/3129113917 learned_addr learned my addr 172.21.15.73:0/3129113917 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576a00640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5780b27c0 0x7fe57815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449743994 0 0) 0x7fe578070160 con 0x7fe5780b3e30 2024-04-15T15:33:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe55c005740 con 0x7fe5780b3e30 2024-04-15T15:33:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1709745503 0 0) 0x7fe55c005740 con 0x7fe5780b3e30 2024-04-15T15:33:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5780b27c0 msgr2=0x7fe57815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5780b27c0 0x7fe57815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 >> v1:172.21.15.118:6789/0 conn(0x7fe57815b5d0 legacy=0x7fe5780b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57806fe80 con 0x7fe5780b3e30 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7fe570001a00 con 0x7fe5780b3e30 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576a00640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5780b27c0 0x7fe57815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 >> v1:172.21.15.73:6789/0 conn(0x7fe5780b3e30 legacy=0x7fe5780b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 0x7fe55c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5780b27c0 0x7fe55c006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe55c006f60 0x7fe55c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c00dce0 con 0x7fe55c005c00 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c00de90 con 0x7fe55c006f60 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe55c00e090 con 0x7fe5780b27c0 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe577400640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 0x7fe55c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe576a00640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5780b27c0 0x7fe55c006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe577e00640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe55c006f60 0x7fe55c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe577400640 1 -- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5780b27c0 msgr2=0x7fe55c006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe577400640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5780b27c0 0x7fe55c006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe577400640 1 -- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe55c006f60 msgr2=0x7fe55c0073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe577400640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe55c006f60 0x7fe55c0073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.536+0000 7fe577400640 1 -- 172.21.15.73:0/3129113917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c005740 con 0x7fe55c005c00 2024-04-15T15:33:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe577400640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 0x7fe55c005fe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe568001860 tx=0x7fe56801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afaa8c378d0fafec server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5680b0070 con 0x7fe55c005c00 2024-04-15T15:33:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5680ab600 con 0x7fe55c005c00 2024-04-15T15:33:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe576000640 1 -- 172.21.15.73:0/3129113917 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568001460 con 0x7fe55c005c00 2024-04-15T15:33:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe57e200640 1 -- 172.21.15.73:0/3129113917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 msgr2=0x7fe55c005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe57e200640 1 --2- 172.21.15.73:0/3129113917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 0x7fe55c005fe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe568001860 tx=0x7fe56801c4f0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe577e00640 1 -- 172.21.15.73:0/3129113917 reap_dead start 2024-04-15T15:33:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe57e200640 1 -- 172.21.15.73:0/3129113917 shutdown_connections 2024-04-15T15:33:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe57e200640 1 -- 172.21.15.73:0/3129113917 >> 172.21.15.73:0/3129113917 conn(0x7fe578067dd0 msgr2=0x7fe5780d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe57e200640 1 -- 172.21.15.73:0/3129113917 shutdown_connections 2024-04-15T15:33:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.540+0000 7fe57e200640 1 -- 172.21.15.73:0/3129113917 wait complete. 2024-04-15T15:33:30.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 Processor -- start 2024-04-15T15:33:30.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 -- start start 2024-04-15T15:33:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 0x7fe5780b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5781555e0 0x7fe5781479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe578147ee0 0x7fe57815cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe57806faa0 con 0x7fe55c005c00 2024-04-15T15:33:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe5780b4240 con 0x7fe5781555e0 2024-04-15T15:33:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe57806fc20 con 0x7fe578147ee0 2024-04-15T15:33:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe577400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 0x7fe5780b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe577400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 0x7fe5780b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38180/0 (socket says 172.21.15.73:38180) 2024-04-15T15:33:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe577400640 1 -- 172.21.15.73:0/323218207 learned_addr learned my addr 172.21.15.73:0/323218207 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe576a00640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5781555e0 0x7fe5781479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe577e00640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe578147ee0 0x7fe57815cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe577400640 1 -- 172.21.15.73:0/323218207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe578147ee0 msgr2=0x7fe57815cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe577400640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe578147ee0 0x7fe57815cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe577400640 1 -- 172.21.15.73:0/323218207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5781555e0 msgr2=0x7fe5781479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe577400640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5781555e0 0x7fe5781479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe577400640 1 -- 172.21.15.73:0/323218207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe578154820 con 0x7fe55c005c00 2024-04-15T15:33:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe577400640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 0x7fe5780b1340 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe568001860 tx=0x7fe55c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe56f400640 1 -- 172.21.15.73:0/323218207 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5680bc070 con 0x7fe55c005c00 2024-04-15T15:33:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe56f400640 1 -- 172.21.15.73:0/323218207 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe568005070 con 0x7fe55c005c00 2024-04-15T15:33:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe56f400640 1 -- 172.21.15.73:0/323218207 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5680b0040 con 0x7fe55c005c00 2024-04-15T15:33:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 -- 172.21.15.73:0/323218207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe578154b00 con 0x7fe55c005c00 2024-04-15T15:33:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 -- 172.21.15.73:0/323218207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5781550c0 con 0x7fe55c005c00 2024-04-15T15:33:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.544+0000 7fe57e200640 1 -- 172.21.15.73:0/323218207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe578068ab0 con 0x7fe55c005c00 2024-04-15T15:33:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.548+0000 7fe56f400640 1 -- 172.21.15.73:0/323218207 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fe5680bf070 con 0x7fe55c005c00 2024-04-15T15:33:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.548+0000 7fe56f400640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe558068410 0x7fe55806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.548+0000 7fe56f400640 1 -- 172.21.15.73:0/323218207 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fe56811ff40 con 0x7fe55c005c00 2024-04-15T15:33:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.548+0000 7fe576a00640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe558068410 0x7fe55806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.548+0000 7fe576a00640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe558068410 0x7fe55806a8d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe564009580 tx=0x7fe564008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.556+0000 7fe56f400640 1 -- 172.21.15.73:0/323218207 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe568016230 con 0x7fe55c005c00 2024-04-15T15:33:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.712+0000 7fe57e200640 1 -- 172.21.15.73:0/323218207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_quiesce_splitauth"} v 0) -- 0x7fe5780cca00 con 0x7fe55c005c00 2024-04-15T15:33:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe56f400640 1 -- 172.21.15.73:0/323218207 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_quiesce_splitauth"}]=0 v15) ==== 110+0+0 (secure 0 0 0) 0x7fe5680efdd0 con 0x7fe55c005c00 2024-04-15T15:33:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 -- 172.21.15.73:0/323218207 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe558068410 msgr2=0x7fe55806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe558068410 0x7fe55806a8d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe564009580 tx=0x7fe564008040 comp rx=0 tx=0).stop 2024-04-15T15:33:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 -- 172.21.15.73:0/323218207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 msgr2=0x7fe5780b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 0x7fe5780b1340 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe568001860 tx=0x7fe55c007a50 comp rx=0 tx=0).stop 2024-04-15T15:33:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 -- 172.21.15.73:0/323218207 shutdown_connections 2024-04-15T15:33:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe558068410 0x7fe55806a8d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe578147ee0 0x7fe57815cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5781555e0 0x7fe5781479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 --2- 172.21.15.73:0/323218207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c005c00 0x7fe5780b1340 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 -- 172.21.15.73:0/323218207 >> 172.21.15.73:0/323218207 conn(0x7fe578067dd0 msgr2=0x7fe5780cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:30.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 -- 172.21.15.73:0/323218207 shutdown_connections 2024-04-15T15:33:30.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.716+0000 7fe57e200640 1 -- 172.21.15.73:0/323218207 wait complete. 2024-04-15T15:33:30.737 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quiesce.TestQuiesce.test_quiesce_blocked' 2024-04-15T15:33:30.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.872+0000 7fba72000640 1 Processor -- start 2024-04-15T15:33:30.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.872+0000 7fba72000640 1 -- start start 2024-04-15T15:33:30.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba72000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba6c15b7c0 0x7fba6c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba72000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba6c0cef10 con 0x7fba6c0c5790 2024-04-15T15:33:30.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba72000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba6c0cec30 con 0x7fba6c0cf5b0 2024-04-15T15:33:30.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba72000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fba6c0cc1e0 con 0x7fba6c15b7c0 2024-04-15T15:33:30.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6be00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fba6c0c5790 0x7fba6c0cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37314/0 (socket says 172.21.15.73:37314) 2024-04-15T15:33:30.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6be00640 1 -- 172.21.15.73:0/2604722294 learned_addr learned my addr 172.21.15.73:0/2604722294 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:30.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6b400640 1 --2- 172.21.15.73:0/2604722294 >> v2:172.21.15.118:3300/0 conn(0x7fba6c15b7c0 0x7fba6c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2122523324 0 0) 0x7fba6c0cef10 con 0x7fba6c0c5790 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba50005740 con 0x7fba6c0c5790 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3288850698 0 0) 0x7fba50005740 con 0x7fba6c0c5790 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 >> v2:172.21.15.118:3300/0 conn(0x7fba6c15b7c0 msgr2=0x7fba6c0cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 --2- 172.21.15.73:0/2604722294 >> v2:172.21.15.118:3300/0 conn(0x7fba6c15b7c0 0x7fba6c0cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 >> v1:172.21.15.118:6789/0 conn(0x7fba6c0cf5b0 legacy=0x7fba6c0c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c0cc4c0 con 0x7fba6c0c5790 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 729394911 0 0) 0x7fba64001a00 con 0x7fba6c0c5790 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 >> v1:172.21.15.73:6789/0 conn(0x7fba6c0c5790 legacy=0x7fba6c0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba50005bd0 0x7fba50005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba50006a20 0x7fba50006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba500073e0 0x7fba5000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c0cc1e0 con 0x7fba50006a20 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fba5000e280 con 0x7fba50005bd0 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fba5000e480 con 0x7fba500073e0 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6aa00640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba50006a20 0x7fba50006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6b400640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba50005bd0 0x7fba50005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6be00640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba500073e0 0x7fba5000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6aa00640 1 -- 172.21.15.73:0/2604722294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba500073e0 msgr2=0x7fba5000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6aa00640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba500073e0 0x7fba5000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6aa00640 1 -- 172.21.15.73:0/2604722294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba50005bd0 msgr2=0x7fba50005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6aa00640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba50005bd0 0x7fba50005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6aa00640 1 -- 172.21.15.73:0/2604722294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba50005740 con 0x7fba50006a20 2024-04-15T15:33:30.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.876+0000 7fba6be00640 1 -- 172.21.15.73:0/2604722294 reap_dead start 2024-04-15T15:33:30.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba6aa00640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba50006a20 0x7fba50006ea0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fba58001780 tx=0x7fba5801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92547b2c8775c201 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:30.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba580013a0 con 0x7fba50006a20 2024-04-15T15:33:30.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba580052f0 con 0x7fba50006a20 2024-04-15T15:33:30.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba6a000640 1 -- 172.21.15.73:0/2604722294 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58003840 con 0x7fba50006a20 2024-04-15T15:33:30.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba72000640 1 -- 172.21.15.73:0/2604722294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba50006a20 msgr2=0x7fba50006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba72000640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba50006a20 0x7fba50006ea0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fba58001780 tx=0x7fba5801c400 comp rx=0 tx=0).stop 2024-04-15T15:33:30.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba72000640 1 -- 172.21.15.73:0/2604722294 shutdown_connections 2024-04-15T15:33:30.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba72000640 1 --2- 172.21.15.73:0/2604722294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba50006a20 0x7fba50006ea0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba72000640 1 -- 172.21.15.73:0/2604722294 >> 172.21.15.73:0/2604722294 conn(0x7fba6c09aa60 msgr2=0x7fba6c0d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:30.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba72000640 1 -- 172.21.15.73:0/2604722294 shutdown_connections 2024-04-15T15:33:30.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba72000640 1 -- 172.21.15.73:0/2604722294 wait complete. 2024-04-15T15:33:30.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba72000640 1 Processor -- start 2024-04-15T15:33:30.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.880+0000 7fba72000640 1 -- start start 2024-04-15T15:33:30.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba72000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba50006a20 0x7fba6c0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba72000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba6c0cb170 0x7fba6c0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba72000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0b6ca0 0x7fba6c153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba72000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c0cfa30 con 0x7fba6c0cb170 2024-04-15T15:33:30.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba72000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c15bba0 con 0x7fba6c0b6ca0 2024-04-15T15:33:30.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba72000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fba6c0cfbb0 con 0x7fba50006a20 2024-04-15T15:33:30.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba6c0cb170 0x7fba6c0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba6c0cb170 0x7fba6c0b6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38204/0 (socket says 172.21.15.73:38204) 2024-04-15T15:33:30.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6aa00640 1 -- 172.21.15.73:0/3977947677 learned_addr learned my addr 172.21.15.73:0/3977947677 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:30.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6b400640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba50006a20 0x7fba6c0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6be00640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0b6ca0 0x7fba6c153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6aa00640 1 -- 172.21.15.73:0/3977947677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba50006a20 msgr2=0x7fba6c0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6aa00640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba50006a20 0x7fba6c0c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6aa00640 1 -- 172.21.15.73:0/3977947677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0b6ca0 msgr2=0x7fba6c153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:30.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6aa00640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0b6ca0 0x7fba6c153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:30.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6aa00640 1 -- 172.21.15.73:0/3977947677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c0b71b0 con 0x7fba6c0cb170 2024-04-15T15:33:30.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6be00640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0b6ca0 0x7fba6c153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:30.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba6aa00640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba6c0cb170 0x7fba6c0b6760 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fba58005040 tx=0x7fba50007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:30.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba63400640 1 -- 172.21.15.73:0/3977947677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba580013a0 con 0x7fba6c0cb170 2024-04-15T15:33:30.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba63400640 1 -- 172.21.15.73:0/3977947677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba580ba070 con 0x7fba6c0cb170 2024-04-15T15:33:30.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba63400640 1 -- 172.21.15.73:0/3977947677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58007a40 con 0x7fba6c0cb170 2024-04-15T15:33:30.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba72000640 1 -- 172.21.15.73:0/3977947677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c15d930 con 0x7fba6c0cb170 2024-04-15T15:33:30.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba72000640 1 -- 172.21.15.73:0/3977947677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c0c8b40 con 0x7fba6c0cb170 2024-04-15T15:33:30.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.884+0000 7fba72000640 1 -- 172.21.15.73:0/3977947677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6c15db00 con 0x7fba6c0cb170 2024-04-15T15:33:30.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.888+0000 7fba63400640 1 -- 172.21.15.73:0/3977947677 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fba580052f0 con 0x7fba6c0cb170 2024-04-15T15:33:30.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.888+0000 7fba63400640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fba4c068410 0x7fba4c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:30.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.888+0000 7fba63400640 1 -- 172.21.15.73:0/3977947677 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fba58120fe0 con 0x7fba6c0cb170 2024-04-15T15:33:30.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.888+0000 7fba6b400640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fba4c068410 0x7fba4c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:30.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.888+0000 7fba6b400640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fba4c068410 0x7fba4c06a8d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fba6c069160 tx=0x7fba5c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:30.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:30.892+0000 7fba63400640 1 -- 172.21.15.73:0/3977947677 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fba58016110 con 0x7fba6c0cb170 2024-04-15T15:33:31.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.104+0000 7fba72000640 1 -- 172.21.15.73:0/3977947677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quiesce.TestQuiesce.test_quiesce_blocked"]} v 0) -- 0x7fba6c068ab0 con 0x7fba6c0cb170 2024-04-15T15:33:31.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.688+0000 7fba63400640 1 -- 172.21.15.73:0/3977947677 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quiesce.TestQuiesce.test_quiesce_blocked"]}]=0 v141) ==== 137+0+0 (secure 0 0 0) 0x7fba580f14e0 con 0x7fba6c0cb170 2024-04-15T15:33:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 -- 172.21.15.73:0/3977947677 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fba4c068410 msgr2=0x7fba4c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fba4c068410 0x7fba4c06a8d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fba6c069160 tx=0x7fba5c009190 comp rx=0 tx=0).stop 2024-04-15T15:33:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 -- 172.21.15.73:0/3977947677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba6c0cb170 msgr2=0x7fba6c0b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba6c0cb170 0x7fba6c0b6760 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fba58005040 tx=0x7fba50007a50 comp rx=0 tx=0).stop 2024-04-15T15:33:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 -- 172.21.15.73:0/3977947677 shutdown_connections 2024-04-15T15:33:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0b6ca0 0x7fba6c153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba6c0cb170 0x7fba6c0b6760 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fba4c068410 0x7fba4c06a8d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 --2- 172.21.15.73:0/3977947677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba50006a20 0x7fba6c0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 -- 172.21.15.73:0/3977947677 >> 172.21.15.73:0/3977947677 conn(0x7fba6c09aa60 msgr2=0x7fba6c0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 -- 172.21.15.73:0/3977947677 shutdown_connections 2024-04-15T15:33:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:31.692+0000 7fba72000640 1 -- 172.21.15.73:0/3977947677 wait complete. 2024-04-15T15:33:31.716 INFO:tasks.cephfs_test_runner:That a file with ceph.quiesce.block is not quiesced. ... FAIL 2024-04-15T15:33:31.717 INFO:tasks.cephfs_test_runner: 2024-04-15T15:33:31.717 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-15T15:33:31.717 INFO:tasks.cephfs_test_runner:FAIL: test_quiesce_blocked (tasks.cephfs.test_quiesce.TestQuiesce) 2024-04-15T15:33:31.717 INFO:tasks.cephfs_test_runner:That a file with ceph.quiesce.block is not quiesced. 2024-04-15T15:33:31.717 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-15T15:33:31.717 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-15T15:33:31.717 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa/tasks/cephfs/test_quiesce.py", line 541, in test_quiesce_blocked 2024-04-15T15:33:31.717 INFO:tasks.cephfs_test_runner: self._verify_quiesce(root=self.subvolume) 2024-04-15T15:33:31.717 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa/tasks/cephfs/test_quiesce.py", line 138, in _verify_quiesce 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner: return self._verify_quiesce_wrapped(rank, status, root, root_inode, ops, cache, splitauth) 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa/tasks/cephfs/test_quiesce.py", line 272, in _verify_quiesce_wrapped 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner: self.assertFalse(lock_type.startswith("i")) 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner:AssertionError: True is not false 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner: 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner:Ran 1 test in 71.001s 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner: 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner: 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner:FAIL: test_quiesce_blocked (tasks.cephfs.test_quiesce.TestQuiesce) 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner:That a file with ceph.quiesce.block is not quiesced. 2024-04-15T15:33:31.718 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-15T15:33:31.719 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-15T15:33:31.719 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa/tasks/cephfs/test_quiesce.py", line 541, in test_quiesce_blocked 2024-04-15T15:33:31.719 INFO:tasks.cephfs_test_runner: self._verify_quiesce(root=self.subvolume) 2024-04-15T15:33:31.719 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa/tasks/cephfs/test_quiesce.py", line 138, in _verify_quiesce 2024-04-15T15:33:31.719 INFO:tasks.cephfs_test_runner: return self._verify_quiesce_wrapped(rank, status, root, root_inode, ops, cache, splitauth) 2024-04-15T15:33:31.719 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa/tasks/cephfs/test_quiesce.py", line 272, in _verify_quiesce_wrapped 2024-04-15T15:33:31.719 INFO:tasks.cephfs_test_runner: self.assertFalse(lock_type.startswith("i")) 2024-04-15T15:33:31.719 INFO:tasks.cephfs_test_runner:AssertionError: True is not false 2024-04-15T15:33:31.719 INFO:tasks.cephfs_test_runner: 2024-04-15T15:33:31.719 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_quiesce_blocked (tasks.cephfs.test_quiesce.TestQuiesce) 2024-04-15T15:33:31.985 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f854d3ea6fc14274971dec34263b56fe Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9bf1c4ba967dd24077be6e5b87edda4ca87a6e14/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_quiesce_blocked (tasks.cephfs.test_quiesce.TestQuiesce) 2024-04-15T15:33:31.987 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-15T15:33:31.997 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-15T15:33:32.006 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-15T15:33:32.006 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:33:32.006 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:32.021 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2940 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-15T15:33:32.022 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-15T15:33:32.022 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:32.072 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2940 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-15T15:33:32.072 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:33:32.072 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:32.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=447 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-15T15:33:32.083 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-04-15T15:33:32.083 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T15:33:32.132 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=447 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-15T15:33:32.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.132 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-15T15:33:32.142 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-15T15:33:32.142 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-15T15:33:32.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T15:33:32.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-15T15:33:32.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-04-15T15:33:32.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.403 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-15T15:33:32.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-04-15T15:33:32.483 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-04-15T15:33:32.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:33:32.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.485 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-04-15T15:33:32.495 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-15T15:33:32.495 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-15T15:33:32.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.496 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T15:33:32.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.563 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-15T15:33:32.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.634 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-04-15T15:33:32.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.779 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-04-15T15:33:32.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T15:33:32.788 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-04-15T15:33:32.853 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2024-04-15T15:33:32.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:33:32.855 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-15T15:33:32.865 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T15:33:32.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:33:33.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefdc200640 1 Processor -- start 2024-04-15T15:33:33.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefdc200640 1 -- start start 2024-04-15T15:33:33.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefdc200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fefd415c850 0x7fefd415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefdc200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fefd40b3ab0 0x7fefd415e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefdc200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd415dcf0 con 0x7fefd406ba50 2024-04-15T15:33:33.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefdc200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fefd40cde20 con 0x7fefd415c850 2024-04-15T15:33:33.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefdc200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fefd40cd210 con 0x7fefd40b3ab0 2024-04-15T15:33:33.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefda200640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fefd406ba50 0x7fefd40ce2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37322/0 (socket says 172.21.15.73:37322) 2024-04-15T15:33:33.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefda200640 1 -- 172.21.15.73:0/3496828035 learned_addr learned my addr 172.21.15.73:0/3496828035 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:33.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefd9800640 1 --2- 172.21.15.73:0/3496828035 >> v2:172.21.15.73:3300/0 conn(0x7fefd415c850 0x7fefd415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefd8e00640 1 --2- 172.21.15.73:0/3496828035 >> v2:172.21.15.118:3300/0 conn(0x7fefd40b3ab0 0x7fefd415e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefd9800640 1 -- 172.21.15.73:0/3496828035 >> v2:172.21.15.118:3300/0 conn(0x7fefd40b3ab0 msgr2=0x7fefd415e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:33.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefd9800640 1 --2- 172.21.15.73:0/3496828035 >> v2:172.21.15.118:3300/0 conn(0x7fefd40b3ab0 0x7fefd415e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefd9800640 1 -- 172.21.15.73:0/3496828035 >> v1:172.21.15.73:6789/0 conn(0x7fefd406ba50 legacy=0x7fefd40ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.000+0000 7fefd9800640 1 -- 172.21.15.73:0/3496828035 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd40cd4f0 con 0x7fefd415c850 2024-04-15T15:33:33.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefd9800640 1 --2- 172.21.15.73:0/3496828035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 0x7fefd415d7b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fefd40d2540 tx=0x7fefc801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d534dd99aeb6ec0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:33.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefd3e00640 1 -- 172.21.15.73:0/3496828035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc80b2070 con 0x7fefd415c850 2024-04-15T15:33:33.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefd3e00640 1 -- 172.21.15.73:0/3496828035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc80a5870 con 0x7fefd415c850 2024-04-15T15:33:33.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefd3e00640 1 -- 172.21.15.73:0/3496828035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc80a5c40 con 0x7fefd415c850 2024-04-15T15:33:33.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefdc200640 1 -- 172.21.15.73:0/3496828035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 msgr2=0x7fefd415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefdc200640 1 --2- 172.21.15.73:0/3496828035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 0x7fefd415d7b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fefd40d2540 tx=0x7fefc801c8a0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefdc200640 1 -- 172.21.15.73:0/3496828035 shutdown_connections 2024-04-15T15:33:33.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefdc200640 1 --2- 172.21.15.73:0/3496828035 >> v2:172.21.15.118:3300/0 conn(0x7fefd40b3ab0 0x7fefd415e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefdc200640 1 --2- 172.21.15.73:0/3496828035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 0x7fefd415d7b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefdc200640 1 -- 172.21.15.73:0/3496828035 >> 172.21.15.73:0/3496828035 conn(0x7fefd40b2f90 msgr2=0x7fefd40b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:33.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefdc200640 1 -- 172.21.15.73:0/3496828035 shutdown_connections 2024-04-15T15:33:33.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.004+0000 7fefdc200640 1 -- 172.21.15.73:0/3496828035 wait complete. 2024-04-15T15:33:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 Processor -- start 2024-04-15T15:33:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 -- start start 2024-04-15T15:33:33.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd406ba50 0x7fefd41561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd40b3ab0 0x7fefd4153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 0x7fefd40c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fefd415e7c0 con 0x7fefd415c850 2024-04-15T15:33:33.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fefd415e640 con 0x7fefd406ba50 2024-04-15T15:33:33.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fefd4169ed0 con 0x7fefd40b3ab0 2024-04-15T15:33:33.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefda200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 0x7fefd40c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefda200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 0x7fefd40c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38216/0 (socket says 172.21.15.73:38216) 2024-04-15T15:33:33.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefda200640 1 -- 172.21.15.73:0/1255637569 learned_addr learned my addr 172.21.15.73:0/1255637569 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:33.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefd9800640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd406ba50 0x7fefd41561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefda200640 1 -- 172.21.15.73:0/1255637569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd40b3ab0 msgr2=0x7fefd4153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefd8e00640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd40b3ab0 0x7fefd4153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefda200640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd40b3ab0 0x7fefd4153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefda200640 1 -- 172.21.15.73:0/1255637569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd406ba50 msgr2=0x7fefd41561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefda200640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd406ba50 0x7fefd41561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefda200640 1 -- 172.21.15.73:0/1255637569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd40c8c10 con 0x7fefd415c850 2024-04-15T15:33:33.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefd8e00640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd40b3ab0 0x7fefd4153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:33.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefd9800640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd406ba50 0x7fefd41561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:33.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefda200640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 0x7fefd40c9890 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00c430 tx=0x7fefcc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:33.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefd1600640 1 -- 172.21.15.73:0/1255637569 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc017070 con 0x7fefd415c850 2024-04-15T15:33:33.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefd1600640 1 -- 172.21.15.73:0/1255637569 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefcc005cf0 con 0x7fefd415c850 2024-04-15T15:33:33.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefd1600640 1 -- 172.21.15.73:0/1255637569 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0072d0 con 0x7fefd415c850 2024-04-15T15:33:33.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 -- 172.21.15.73:0/1255637569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd4155100 con 0x7fefd415c850 2024-04-15T15:33:33.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 -- 172.21.15.73:0/1255637569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd41559a0 con 0x7fefd415c850 2024-04-15T15:33:33.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.008+0000 7fefdc200640 1 -- 172.21.15.73:0/1255637569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd4068ab0 con 0x7fefd415c850 2024-04-15T15:33:33.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.012+0000 7fefd1600640 1 -- 172.21.15.73:0/1255637569 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fefcc01a070 con 0x7fefd415c850 2024-04-15T15:33:33.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.012+0000 7fefd1600640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fefb4068410 0x7fefb406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.012+0000 7fefd1600640 1 -- 172.21.15.73:0/1255637569 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fefcc085bb0 con 0x7fefd415c850 2024-04-15T15:33:33.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.012+0000 7fefd9800640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fefb4068410 0x7fefb406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.012+0000 7fefd9800640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fefb4068410 0x7fefb406a8d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fefc80af000 tx=0x7fefc80a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:33.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.016+0000 7fefd1600640 1 -- 172.21.15.73:0/1255637569 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fefcc055be0 con 0x7fefd415c850 2024-04-15T15:33:33.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.168+0000 7fefdc200640 1 -- 172.21.15.73:0/1255637569 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fefd40b73c0 con 0x7fefb4068410 2024-04-15T15:33:33.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.168+0000 7fefd1600640 1 -- 172.21.15.73:0/1255637569 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13495 (secure 0 0 0) 0x7fefd40b73c0 con 0x7fefb4068410 2024-04-15T15:33:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:33.171 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:33:33.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 -- 172.21.15.73:0/1255637569 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fefb4068410 msgr2=0x7fefb406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fefb4068410 0x7fefb406a8d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fefc80af000 tx=0x7fefc80a7070 comp rx=0 tx=0).stop 2024-04-15T15:33:33.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 -- 172.21.15.73:0/1255637569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 msgr2=0x7fefd40c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 0x7fefd40c9890 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00c430 tx=0x7fefcc00c8f0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 -- 172.21.15.73:0/1255637569 shutdown_connections 2024-04-15T15:33:33.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefd415c850 0x7fefd40c9890 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fefb4068410 0x7fefb406a8d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd40b3ab0 0x7fefd4153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 --2- 172.21.15.73:0/1255637569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd406ba50 0x7fefd41561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 -- 172.21.15.73:0/1255637569 >> 172.21.15.73:0/1255637569 conn(0x7fefd40b2f90 msgr2=0x7fefd40b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:33.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 -- 172.21.15.73:0/1255637569 shutdown_connections 2024-04-15T15:33:33.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.172+0000 7fefdc200640 1 -- 172.21.15.73:0/1255637569 wait complete. 2024-04-15T15:33:33.192 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-04-15T15:33:31.380545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238104,"kb_used_data":5284,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736616,"statfs":{"total":773094113280,"available":772850294784,"internally_reserved":0,"allocated":5410816,"data_stored":3028713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-67834,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-79,"num_read_kb":-130,"num_write":-99,"num_write_kb":-106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001099"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-15T15:33:29.692005+0000","last_change":"2024-04-15T15:31:23.443687+0000","last_active":"2024-04-15T15:33:29.692005+0000","last_peered":"2024-04-15T15:33:29.692005+0000","last_clean":"2024-04-15T15:33:29.692005+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:33:29.692005+0000","last_undegraded":"2024-04-15T15:33:29.692005+0000","last_fullsized":"2024-04-15T15:33:29.692005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_clean_scrub_stamp":"2024-04-15T15:31:22.092427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:28:43.096549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1114112,"data_stored":817680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31692,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340148,"statfs":{"total":96636764160,"available":96604311552,"internally_reserved":0,"allocated":524288,"data_stored":227291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":227179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1126400,"data_stored":823607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:33:33.193 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:33:33.323 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:33:33.326 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:33:33.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56dda00640 1 Processor -- start 2024-04-15T15:33:33.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56dda00640 1 -- start start 2024-04-15T15:33:33.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56dda00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f56d815c680 0x7f56d815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56dda00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f56d80ce4e0 0x7f56d81601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56dda00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d815ca60 con 0x7f56d80b0b40 2024-04-15T15:33:33.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56dda00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f56d80cd010 con 0x7f56d80ce4e0 2024-04-15T15:33:33.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56dda00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f56d80cd2f0 con 0x7f56d815c680 2024-04-15T15:33:33.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56cfe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f56d80b0b40 0x7f56d80cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37336/0 (socket says 172.21.15.73:37336) 2024-04-15T15:33:33.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56cfe00640 1 -- 172.21.15.73:0/3362311580 learned_addr learned my addr 172.21.15.73:0/3362311580 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:33.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56d7e00640 1 --2- 172.21.15.73:0/3362311580 >> v2:172.21.15.118:3300/0 conn(0x7f56d815c680 0x7f56d815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.328+0000 7f56dd000640 1 --2- 172.21.15.73:0/3362311580 >> v2:172.21.15.73:3300/0 conn(0x7f56d80ce4e0 0x7f56d81601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56d7e00640 1 -- 172.21.15.73:0/3362311580 >> v2:172.21.15.73:3300/0 conn(0x7f56d80ce4e0 msgr2=0x7f56d81601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:33.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56d7e00640 1 --2- 172.21.15.73:0/3362311580 >> v2:172.21.15.73:3300/0 conn(0x7f56d80ce4e0 0x7f56d81601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56d7e00640 1 -- 172.21.15.73:0/3362311580 >> v1:172.21.15.73:6789/0 conn(0x7f56d80b0b40 legacy=0x7f56d80cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56d7e00640 1 -- 172.21.15.73:0/3362311580 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d80cd5d0 con 0x7f56d815c680 2024-04-15T15:33:33.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56d7400640 1 -- 172.21.15.73:0/3362311580 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845699548 0 0) 0x7f56d815ca60 con 0x7f56d80b0b40 2024-04-15T15:33:33.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56d7e00640 1 --2- 172.21.15.73:0/3362311580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56d815c680 0x7f56d815d660 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f56d80d2310 tx=0x7f56c801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=743e8b6d1b6ed3fd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:33.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56d7400640 1 -- 172.21.15.73:0/3362311580 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c80b2070 con 0x7f56d815c680 2024-04-15T15:33:33.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56d7400640 1 -- 172.21.15.73:0/3362311580 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c80ad680 con 0x7f56d815c680 2024-04-15T15:33:33.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56d7400640 1 -- 172.21.15.73:0/3362311580 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c80ada50 con 0x7f56d815c680 2024-04-15T15:33:33.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56dda00640 1 -- 172.21.15.73:0/3362311580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56d815c680 msgr2=0x7f56d815d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.332+0000 7f56dda00640 1 --2- 172.21.15.73:0/3362311580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56d815c680 0x7f56d815d660 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f56d80d2310 tx=0x7f56c801c3c0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 -- 172.21.15.73:0/3362311580 shutdown_connections 2024-04-15T15:33:33.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 --2- 172.21.15.73:0/3362311580 >> v2:172.21.15.73:3300/0 conn(0x7f56d80ce4e0 0x7f56d81601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 --2- 172.21.15.73:0/3362311580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56d815c680 0x7f56d815d660 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 -- 172.21.15.73:0/3362311580 >> 172.21.15.73:0/3362311580 conn(0x7f56d80b2e90 msgr2=0x7f56d80b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:33.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 -- 172.21.15.73:0/3362311580 shutdown_connections 2024-04-15T15:33:33.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 -- 172.21.15.73:0/3362311580 wait complete. 2024-04-15T15:33:33.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 Processor -- start 2024-04-15T15:33:33.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 -- start start 2024-04-15T15:33:33.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d80b0b40 0x7f56d8155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56d80ce4e0 0x7f56d815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56d815c680 0x7f56d8148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81694c0 con 0x7f56d80b0b40 2024-04-15T15:33:33.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f56d8169340 con 0x7f56d80ce4e0 2024-04-15T15:33:33.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dda00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f56d8169640 con 0x7f56d815c680 2024-04-15T15:33:33.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d80b0b40 0x7f56d8155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d80b0b40 0x7f56d8155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38238/0 (socket says 172.21.15.73:38238) 2024-04-15T15:33:33.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56d7e00640 1 -- 172.21.15.73:0/3715171040 learned_addr learned my addr 172.21.15.73:0/3715171040 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:33.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56cfe00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56d80ce4e0 0x7f56d815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56dd000640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56d815c680 0x7f56d8148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56d7e00640 1 -- 172.21.15.73:0/3715171040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56d815c680 msgr2=0x7f56d8148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56d7e00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56d815c680 0x7f56d8148540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56d7e00640 1 -- 172.21.15.73:0/3715171040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56d80ce4e0 msgr2=0x7f56d815e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56d7e00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56d80ce4e0 0x7f56d815e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56d7e00640 1 -- 172.21.15.73:0/3715171040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d806f210 con 0x7f56d80b0b40 2024-04-15T15:33:33.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56d7e00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d80b0b40 0x7f56d8155d40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f56c8019ff0 tx=0x7f56c801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:33.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.336+0000 7f56d4c00640 1 -- 172.21.15.73:0/3715171040 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c80be070 con 0x7f56d80b0b40 2024-04-15T15:33:33.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.340+0000 7f56d4c00640 1 -- 172.21.15.73:0/3715171040 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c80b3040 con 0x7f56d80b0b40 2024-04-15T15:33:33.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.340+0000 7f56dda00640 1 -- 172.21.15.73:0/3715171040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d815ef00 con 0x7f56d80b0b40 2024-04-15T15:33:33.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.340+0000 7f56d4c00640 1 -- 172.21.15.73:0/3715171040 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c80b2050 con 0x7f56d80b0b40 2024-04-15T15:33:33.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.340+0000 7f56dda00640 1 -- 172.21.15.73:0/3715171040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d815f4c0 con 0x7f56d80b0b40 2024-04-15T15:33:33.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.340+0000 7f56dda00640 1 -- 172.21.15.73:0/3715171040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d804fd60 con 0x7f56d80b0b40 2024-04-15T15:33:33.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.340+0000 7f56d4c00640 1 -- 172.21.15.73:0/3715171040 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f56c80c1070 con 0x7f56d80b0b40 2024-04-15T15:33:33.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.340+0000 7f56d4c00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f56b4068410 0x7f56b406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.340+0000 7f56d4c00640 1 -- 172.21.15.73:0/3715171040 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f56c8120420 con 0x7f56d80b0b40 2024-04-15T15:33:33.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.340+0000 7f56cfe00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f56b4068410 0x7f56b406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.344+0000 7f56cfe00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f56b4068410 0x7f56b406a8d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56d80cca30 tx=0x7f56c0007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:33.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.348+0000 7f56d4c00640 1 -- 172.21.15.73:0/3715171040 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f56c8016070 con 0x7f56d80b0b40 2024-04-15T15:33:33.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.504+0000 7f56dda00640 1 -- 172.21.15.73:0/3715171040 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56d80b71c0 con 0x7f56b4068410 2024-04-15T15:33:33.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.504+0000 7f56d4c00640 1 -- 172.21.15.73:0/3715171040 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13496 (secure 0 0 0) 0x7f56d80b71c0 con 0x7f56b4068410 2024-04-15T15:33:33.506 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:33.506 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:33:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 -- 172.21.15.73:0/3715171040 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f56b4068410 msgr2=0x7f56b406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f56b4068410 0x7f56b406a8d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56d80cca30 tx=0x7f56c0007d60 comp rx=0 tx=0).stop 2024-04-15T15:33:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 -- 172.21.15.73:0/3715171040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d80b0b40 msgr2=0x7f56d8155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d80b0b40 0x7f56d8155d40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f56c8019ff0 tx=0x7f56c801ac00 comp rx=0 tx=0).stop 2024-04-15T15:33:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 -- 172.21.15.73:0/3715171040 shutdown_connections 2024-04-15T15:33:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f56b4068410 0x7f56b406a8d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56d815c680 0x7f56d8148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56d80ce4e0 0x7f56d815e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 --2- 172.21.15.73:0/3715171040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d80b0b40 0x7f56d8155d40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 -- 172.21.15.73:0/3715171040 >> 172.21.15.73:0/3715171040 conn(0x7f56d80b2e90 msgr2=0x7f56d806c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 -- 172.21.15.73:0/3715171040 shutdown_connections 2024-04-15T15:33:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.508+0000 7f56dda00640 1 -- 172.21.15.73:0/3715171040 wait complete. 2024-04-15T15:33:33.527 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-04-15T15:33:33.380827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238104,"kb_used_data":5284,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736616,"statfs":{"total":773094113280,"available":772850294784,"internally_reserved":0,"allocated":5410816,"data_stored":3028713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-73284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-79,"num_read_kb":-130,"num_write":-106,"num_write_kb":-115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.795506"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-15T15:33:29.692005+0000","last_change":"2024-04-15T15:31:23.443687+0000","last_active":"2024-04-15T15:33:29.692005+0000","last_peered":"2024-04-15T15:33:29.692005+0000","last_clean":"2024-04-15T15:33:29.692005+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:33:29.692005+0000","last_undegraded":"2024-04-15T15:33:29.692005+0000","last_fullsized":"2024-04-15T15:33:29.692005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_clean_scrub_stamp":"2024-04-15T15:31:22.092427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:28:43.096549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1114112,"data_stored":817680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31692,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340148,"statfs":{"total":96636764160,"available":96604311552,"internally_reserved":0,"allocated":524288,"data_stored":227291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":227179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1126400,"data_stored":823607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:33:33.528 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T15:33:33.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:33:33.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc87d000640 1 Processor -- start 2024-04-15T15:33:33.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc87d000640 1 -- start start 2024-04-15T15:33:33.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc87d000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc87815c860 0x7fc8780d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc87d000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc8780d1230 0x7fc8780704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc87d000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87809be00 con 0x7fc8780d0670 2024-04-15T15:33:33.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc87d000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc87815cc40 con 0x7fc87815c860 2024-04-15T15:33:33.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc87d000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc878070040 con 0x7fc8780d1230 2024-04-15T15:33:33.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc875e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc87815c860 0x7fc8780d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc875400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc8780d0670 0x7fc8780d0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37344/0 (socket says 172.21.15.73:37344) 2024-04-15T15:33:33.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc875400640 1 -- 172.21.15.73:0/1223182064 learned_addr learned my addr 172.21.15.73:0/1223182064 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:33.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc876800640 1 --2- 172.21.15.73:0/1223182064 >> v2:172.21.15.118:3300/0 conn(0x7fc8780d1230 0x7fc8780704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc875e00640 1 -- 172.21.15.73:0/1223182064 >> v2:172.21.15.118:3300/0 conn(0x7fc8780d1230 msgr2=0x7fc8780704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:33.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc875e00640 1 --2- 172.21.15.73:0/1223182064 >> v2:172.21.15.118:3300/0 conn(0x7fc8780d1230 0x7fc8780704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc875e00640 1 -- 172.21.15.73:0/1223182064 >> v1:172.21.15.73:6789/0 conn(0x7fc8780d0670 legacy=0x7fc8780d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc875e00640 1 -- 172.21.15.73:0/1223182064 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87809b5a0 con 0x7fc87815c860 2024-04-15T15:33:33.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc876800640 1 --2- 172.21.15.73:0/1223182064 >> v2:172.21.15.118:3300/0 conn(0x7fc8780d1230 0x7fc8780704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:33.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.664+0000 7fc874a00640 1 -- 172.21.15.73:0/1223182064 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031264325 0 0) 0x7fc87809be00 con 0x7fc8780d0670 2024-04-15T15:33:33.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc875e00640 1 --2- 172.21.15.73:0/1223182064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 0x7fc8780d0130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc878073640 tx=0x7fc86801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83815a36b49049b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:33.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc874a00640 1 -- 172.21.15.73:0/1223182064 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8680b1070 con 0x7fc87815c860 2024-04-15T15:33:33.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc874a00640 1 -- 172.21.15.73:0/1223182064 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8680ac620 con 0x7fc87815c860 2024-04-15T15:33:33.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc874a00640 1 -- 172.21.15.73:0/1223182064 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8680ac9f0 con 0x7fc87815c860 2024-04-15T15:33:33.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc87d000640 1 -- 172.21.15.73:0/1223182064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 msgr2=0x7fc8780d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc87d000640 1 --2- 172.21.15.73:0/1223182064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 0x7fc8780d0130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc878073640 tx=0x7fc86801c3c0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc87d000640 1 -- 172.21.15.73:0/1223182064 shutdown_connections 2024-04-15T15:33:33.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc87d000640 1 --2- 172.21.15.73:0/1223182064 >> v2:172.21.15.118:3300/0 conn(0x7fc8780d1230 0x7fc8780704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc87d000640 1 --2- 172.21.15.73:0/1223182064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 0x7fc8780d0130 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc87d000640 1 -- 172.21.15.73:0/1223182064 >> 172.21.15.73:0/1223182064 conn(0x7fc8780b4050 msgr2=0x7fc8780b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:33.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc87d000640 1 -- 172.21.15.73:0/1223182064 shutdown_connections 2024-04-15T15:33:33.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc87d000640 1 -- 172.21.15.73:0/1223182064 wait complete. 2024-04-15T15:33:33.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc87d000640 1 Processor -- start 2024-04-15T15:33:33.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.668+0000 7fc87d000640 1 -- start start 2024-04-15T15:33:33.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc87d000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780d0670 0x7fc878155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc87d000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8780d1230 0x7fc878156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc87d000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 0x7fc878156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc87d000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc8780713a0 con 0x7fc87815c860 2024-04-15T15:33:33.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc87d000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc878071220 con 0x7fc8780d1230 2024-04-15T15:33:33.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc87d000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc878071520 con 0x7fc8780d0670 2024-04-15T15:33:33.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc876800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 0x7fc878156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc876800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 0x7fc878156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38266/0 (socket says 172.21.15.73:38266) 2024-04-15T15:33:33.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc876800640 1 -- 172.21.15.73:0/34043058 learned_addr learned my addr 172.21.15.73:0/34043058 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:33.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc875400640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8780d1230 0x7fc878156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc875e00640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780d0670 0x7fc878155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc876800640 1 -- 172.21.15.73:0/34043058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780d0670 msgr2=0x7fc878155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc876800640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780d0670 0x7fc878155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc876800640 1 -- 172.21.15.73:0/34043058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8780d1230 msgr2=0x7fc878156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc876800640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8780d1230 0x7fc878156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc876800640 1 -- 172.21.15.73:0/34043058 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc878067c00 con 0x7fc87815c860 2024-04-15T15:33:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc876800640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 0x7fc878156a90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc870007ec0 tx=0x7fc87000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc86e000640 1 -- 172.21.15.73:0/34043058 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87001a070 con 0x7fc87815c860 2024-04-15T15:33:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc86e000640 1 -- 172.21.15.73:0/34043058 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc870015600 con 0x7fc87815c860 2024-04-15T15:33:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc87d000640 1 -- 172.21.15.73:0/34043058 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc878167100 con 0x7fc87815c860 2024-04-15T15:33:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc86e000640 1 -- 172.21.15.73:0/34043058 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8700159f0 con 0x7fc87815c860 2024-04-15T15:33:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc87d000640 1 -- 172.21.15.73:0/34043058 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87815fa60 con 0x7fc87815c860 2024-04-15T15:33:33.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc87d000640 1 -- 172.21.15.73:0/34043058 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc878068ab0 con 0x7fc87815c860 2024-04-15T15:33:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.672+0000 7fc86e000640 1 -- 172.21.15.73:0/34043058 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fc87001d070 con 0x7fc87815c860 2024-04-15T15:33:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.676+0000 7fc86e000640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc858068410 0x7fc85806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.676+0000 7fc86e000640 1 -- 172.21.15.73:0/34043058 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fc870086c60 con 0x7fc87815c860 2024-04-15T15:33:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.676+0000 7fc875e00640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc858068410 0x7fc85806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.676+0000 7fc875e00640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc858068410 0x7fc85806a8d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8680ae000 tx=0x7fc868008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:33.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.680+0000 7fc86e000640 1 -- 172.21.15.73:0/34043058 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc878167100 con 0x7fc87815c860 2024-04-15T15:33:33.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.836+0000 7fc87d000640 1 -- 172.21.15.73:0/34043058 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc87815a630 con 0x7fc858068410 2024-04-15T15:33:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.836+0000 7fc86e000640 1 -- 172.21.15.73:0/34043058 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13496 (secure 0 0 0) 0x7fc87815a630 con 0x7fc858068410 2024-04-15T15:33:33.839 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:33:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 -- 172.21.15.73:0/34043058 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc858068410 msgr2=0x7fc85806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc858068410 0x7fc85806a8d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8680ae000 tx=0x7fc868008040 comp rx=0 tx=0).stop 2024-04-15T15:33:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 -- 172.21.15.73:0/34043058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 msgr2=0x7fc878156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 0x7fc878156a90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc870007ec0 tx=0x7fc87000d4a0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 -- 172.21.15.73:0/34043058 shutdown_connections 2024-04-15T15:33:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc87815c860 0x7fc878156a90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8780d1230 0x7fc878156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fc858068410 0x7fc85806a8d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 --2- 172.21.15.73:0/34043058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780d0670 0x7fc878155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 -- 172.21.15.73:0/34043058 >> 172.21.15.73:0/34043058 conn(0x7fc8780b4050 msgr2=0x7fc878159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:33.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 -- 172.21.15.73:0/34043058 shutdown_connections 2024-04-15T15:33:33.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.840+0000 7fc87d000640 1 -- 172.21.15.73:0/34043058 wait complete. 2024-04-15T15:33:33.860 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-04-15T15:33:33.380827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238104,"kb_used_data":5284,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736616,"statfs":{"total":773094113280,"available":772850294784,"internally_reserved":0,"allocated":5410816,"data_stored":3028713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-73284,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-79,"num_read_kb":-130,"num_write":-106,"num_write_kb":-115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.795506"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-15T15:33:29.692005+0000","last_change":"2024-04-15T15:31:23.443687+0000","last_active":"2024-04-15T15:33:29.692005+0000","last_peered":"2024-04-15T15:33:29.692005+0000","last_clean":"2024-04-15T15:33:29.692005+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:33:29.692005+0000","last_undegraded":"2024-04-15T15:33:29.692005+0000","last_fullsized":"2024-04-15T15:33:29.692005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_clean_scrub_stamp":"2024-04-15T15:31:22.092427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:28:43.096549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1114112,"data_stored":817680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31692,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340148,"statfs":{"total":96636764160,"available":96604311552,"internally_reserved":0,"allocated":524288,"data_stored":227291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":227179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1126400,"data_stored":823607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:33:33.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:33:33.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b8800640 1 Processor -- start 2024-04-15T15:33:33.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b8800640 1 -- start start 2024-04-15T15:33:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b8800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3b00b3ab0 0x7fb3b015e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b8800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb3b006ba50 0x7fb3b006beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b8800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b00cd210 con 0x7fb3b015c850 2024-04-15T15:33:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b8800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b006c3f0 con 0x7fb3b00b3ab0 2024-04-15T15:33:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b8800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b00cde20 con 0x7fb3b006ba50 2024-04-15T15:33:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3b00b3ab0 0x7fb3b015e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:33.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3b00b3ab0 0x7fb3b015e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38270/0 (socket says 172.21.15.73:38270) 2024-04-15T15:33:33.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b5400640 1 -- 172.21.15.73:0/248131546 learned_addr learned my addr 172.21.15.73:0/248131546 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:33.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b6800640 1 --2- 172.21.15.73:0/248131546 >> v2:172.21.15.118:3300/0 conn(0x7fb3b006ba50 0x7fb3b006beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b5400640 1 -- 172.21.15.73:0/248131546 >> v2:172.21.15.118:3300/0 conn(0x7fb3b006ba50 msgr2=0x7fb3b006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b5400640 1 --2- 172.21.15.73:0/248131546 >> v2:172.21.15.118:3300/0 conn(0x7fb3b006ba50 0x7fb3b006beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b5400640 1 -- 172.21.15.73:0/248131546 >> v1:172.21.15.118:6789/0 conn(0x7fb3b015c850 legacy=0x7fb3b015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b5400640 1 -- 172.21.15.73:0/248131546 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b00cd4f0 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:33.996+0000 7fb3b6800640 1 --2- 172.21.15.73:0/248131546 >> v2:172.21.15.118:3300/0 conn(0x7fb3b006ba50 0x7fb3b006beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b5400640 1 --2- 172.21.15.73:0/248131546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 0x7fb3b015e100 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00b0cc0 tx=0x7fb3a001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61347767f246265e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b4a00640 1 -- 172.21.15.73:0/248131546 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00b0070 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b4a00640 1 -- 172.21.15.73:0/248131546 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a00ab600 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b4a00640 1 -- 172.21.15.73:0/248131546 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00ab9d0 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b8800640 1 -- 172.21.15.73:0/248131546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 msgr2=0x7fb3b015e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b8800640 1 --2- 172.21.15.73:0/248131546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 0x7fb3b015e100 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00b0cc0 tx=0x7fb3a001c450 comp rx=0 tx=0).stop 2024-04-15T15:33:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b8800640 1 -- 172.21.15.73:0/248131546 shutdown_connections 2024-04-15T15:33:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b8800640 1 --2- 172.21.15.73:0/248131546 >> v2:172.21.15.118:3300/0 conn(0x7fb3b006ba50 0x7fb3b006beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b8800640 1 --2- 172.21.15.73:0/248131546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 0x7fb3b015e100 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b8800640 1 -- 172.21.15.73:0/248131546 >> 172.21.15.73:0/248131546 conn(0x7fb3b00b2f90 msgr2=0x7fb3b00b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b8800640 1 -- 172.21.15.73:0/248131546 shutdown_connections 2024-04-15T15:33:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.000+0000 7fb3b8800640 1 -- 172.21.15.73:0/248131546 wait complete. 2024-04-15T15:33:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 Processor -- start 2024-04-15T15:33:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 -- start start 2024-04-15T15:33:34.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3b006ba50 0x7fb3b0156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:34.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 0x7fb3b00b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:34.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3b015c850 0x7fb3b00b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b00cec40 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b00ceac0 con 0x7fb3b006ba50 2024-04-15T15:33:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b01696c0 con 0x7fb3b015c850 2024-04-15T15:33:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b5400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 0x7fb3b00b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b5400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 0x7fb3b00b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38282/0 (socket says 172.21.15.73:38282) 2024-04-15T15:33:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b5400640 1 -- 172.21.15.73:0/173145525 learned_addr learned my addr 172.21.15.73:0/173145525 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b5e00640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3b006ba50 0x7fb3b0156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b6800640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3b015c850 0x7fb3b00b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b5400640 1 -- 172.21.15.73:0/173145525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3b015c850 msgr2=0x7fb3b00b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b5400640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3b015c850 0x7fb3b00b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b5400640 1 -- 172.21.15.73:0/173145525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3b006ba50 msgr2=0x7fb3b0156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b5400640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3b006ba50 0x7fb3b0156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b5400640 1 -- 172.21.15.73:0/173145525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b00c7370 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b5400640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 0x7fb3b00b4130 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb3a001c930 tx=0x7fb3a00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3aa000640 1 -- 172.21.15.73:0/173145525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00bb070 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3aa000640 1 -- 172.21.15.73:0/173145525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a00b6640 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 -- 172.21.15.73:0/173145525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b00c62d0 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3aa000640 1 -- 172.21.15.73:0/173145525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00b0040 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 -- 172.21.15.73:0/173145525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b00c6890 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.004+0000 7fb3b8800640 1 -- 172.21.15.73:0/173145525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b0068ab0 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.008+0000 7fb3aa000640 1 -- 172.21.15.73:0/173145525 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fb3a00be070 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.008+0000 7fb3aa000640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb394068410 0x7fb39406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.008+0000 7fb3aa000640 1 -- 172.21.15.73:0/173145525 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fb3a01204e0 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.008+0000 7fb3b5e00640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb394068410 0x7fb39406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.008+0000 7fb3b5e00640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb394068410 0x7fb39406a8d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0158190 tx=0x7fb3a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:34.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.012+0000 7fb3aa000640 1 -- 172.21.15.73:0/173145525 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb3a00160d0 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.168+0000 7fb3b8800640 1 -- 172.21.15.73:0/173145525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3b006eb10 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.168+0000 7fb3aa000640 1 -- 172.21.15.73:0/173145525 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+13401 (secure 0 0 0) 0x7fb3a00f0b60 con 0x7fb3b00b3ab0 2024-04-15T15:33:34.171 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:34.171 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":45,"fsid":"a72de584-7db8-4f62-b310-5ee655143eeb","created":"2024-04-15T15:31:08.340013+0000","modified":"2024-04-15T15:33:29.685625+0000","last_up_change":"2024-04-15T15:31:20.087132+0000","last_in_change":"2024-04-15T15:31:10.867993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T15:31:21.381557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29d58176-fa13-4426-aed4-b6df16d11210","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6801","nonce":3735416960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6803","nonce":3735416960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6807","nonce":3735416960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3735416960},{"type":"v1","addr":"172.21.15.73:6805","nonce":3735416960}]},"public_addr":"172.21.15.73:6801/3735416960","cluster_addr":"172.21.15.73:6803/3735416960","heartbeat_back_addr":"172.21.15.73:6807/3735416960","heartbeat_front_addr":"172.21.15.73:6805/3735416960","state":["exists","up"]},{"osd":1,"uuid":"16127a63-1be1-42e9-87df-eeedf3d20fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6825","nonce":721226997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6827","nonce":721226997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6831","nonce":721226997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":721226997},{"type":"v1","addr":"172.21.15.73:6829","nonce":721226997}]},"public_addr":"172.21.15.73:6825/721226997","cluster_addr":"172.21.15.73:6827/721226997","heartbeat_back_addr":"172.21.15.73:6831/721226997","heartbeat_front_addr":"172.21.15.73:6829/721226997","state":["exists","up"]},{"osd":2,"uuid":"21acd3fb-727a-4df5-a3e8-e3133372fb52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6817","nonce":81233902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6819","nonce":81233902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6823","nonce":81233902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":81233902},{"type":"v1","addr":"172.21.15.73:6821","nonce":81233902}]},"public_addr":"172.21.15.73:6817/81233902","cluster_addr":"172.21.15.73:6819/81233902","heartbeat_back_addr":"172.21.15.73:6823/81233902","heartbeat_front_addr":"172.21.15.73:6821/81233902","state":["exists","up"]},{"osd":3,"uuid":"4fe5e16a-be17-4938-839f-b9919f34ca8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6809","nonce":4025456322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6811","nonce":4025456322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6815","nonce":4025456322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":4025456322},{"type":"v1","addr":"172.21.15.73:6813","nonce":4025456322}]},"public_addr":"172.21.15.73:6809/4025456322","cluster_addr":"172.21.15.73:6811/4025456322","heartbeat_back_addr":"172.21.15.73:6815/4025456322","heartbeat_front_addr":"172.21.15.73:6813/4025456322","state":["exists","up"]},{"osd":4,"uuid":"94ce89f6-dd6f-4736-82fc-a2950adffe0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6811","nonce":2483912134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6815","nonce":2483912134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6823","nonce":2483912134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":2483912134},{"type":"v1","addr":"172.21.15.118:6819","nonce":2483912134}]},"public_addr":"172.21.15.118:6811/2483912134","cluster_addr":"172.21.15.118:6815/2483912134","heartbeat_back_addr":"172.21.15.118:6823/2483912134","heartbeat_front_addr":"172.21.15.118:6819/2483912134","state":["exists","up"]},{"osd":5,"uuid":"19eab2f9-771c-408b-85d0-410f2d6fae55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6801","nonce":3386675201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6803","nonce":3386675201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6807","nonce":3386675201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3386675201},{"type":"v1","addr":"172.21.15.118:6805","nonce":3386675201}]},"public_addr":"172.21.15.118:6801/3386675201","cluster_addr":"172.21.15.118:6803/3386675201","heartbeat_back_addr":"172.21.15.118:6807/3386675201","heartbeat_front_addr":"172.21.15.118:6805/3386675201","state":["exists","up"]},{"osd":6,"uuid":"91f47132-e5ff-4534-b430-71da6b5d571b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6810","nonce":1779259058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6814","nonce":1779259058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6822","nonce":1779259058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1779259058},{"type":"v1","addr":"172.21.15.118:6818","nonce":1779259058}]},"public_addr":"172.21.15.118:6810/1779259058","cluster_addr":"172.21.15.118:6814/1779259058","heartbeat_back_addr":"172.21.15.118:6822/1779259058","heartbeat_front_addr":"172.21.15.118:6818/1779259058","state":["exists","up"]},{"osd":7,"uuid":"7914a713-2763-40cd-8ea6-f1a55fc3128b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6825","nonce":2597178366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6827","nonce":2597178366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6831","nonce":2597178366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2597178366},{"type":"v1","addr":"172.21.15.118:6829","nonce":2597178366}]},"public_addr":"172.21.15.118:6825/2597178366","cluster_addr":"172.21.15.118:6827/2597178366","heartbeat_back_addr":"172.21.15.118:6831/2597178366","heartbeat_front_addr":"172.21.15.118:6829/2597178366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.537591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.501625+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.659899+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.477182+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.568720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.420627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.553552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T15:31:16.661624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6834/1374015509":"2024-04-16T15:33:26.582480+0000","172.21.15.73:6836/1374015509":"2024-04-16T15:33:26.582480+0000","172.21.15.118:6834/2635966606":"2024-04-16T15:33:09.602425+0000","172.21.15.118:6832/2635966606":"2024-04-16T15:33:09.602425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:33:34.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 -- 172.21.15.73:0/173145525 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb394068410 msgr2=0x7fb39406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:34.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb394068410 0x7fb39406a8d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0158190 tx=0x7fb3a4008040 comp rx=0 tx=0).stop 2024-04-15T15:33:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 -- 172.21.15.73:0/173145525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 msgr2=0x7fb3b00b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 0x7fb3b00b4130 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb3a001c930 tx=0x7fb3a00191f0 comp rx=0 tx=0).stop 2024-04-15T15:33:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 -- 172.21.15.73:0/173145525 shutdown_connections 2024-04-15T15:33:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fb394068410 0x7fb39406a8d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3b015c850 0x7fb3b00b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b00b3ab0 0x7fb3b00b4130 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 --2- 172.21.15.73:0/173145525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3b006ba50 0x7fb3b0156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:34.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 -- 172.21.15.73:0/173145525 >> 172.21.15.73:0/173145525 conn(0x7fb3b00b2f90 msgr2=0x7fb3b015ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:34.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 -- 172.21.15.73:0/173145525 shutdown_connections 2024-04-15T15:33:34.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:34.172+0000 7fb3b8800640 1 -- 172.21.15.73:0/173145525 wait complete. 2024-04-15T15:33:35.194 INFO:tasks.ceph:Scrubbing osd.0 2024-04-15T15:33:35.195 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:33:35.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.340+0000 7f9b72e00640 1 Processor -- start 2024-04-15T15:33:35.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.340+0000 7f9b72e00640 1 -- start start 2024-04-15T15:33:35.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b72e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b6c142c90 0x7f9b6c0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b72e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b6c143070 0x7f9b6c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b72e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b6c06ba50 0x7f9b6c0cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b72e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9b6c0b4ae0 con 0x7f9b6c06ba50 2024-04-15T15:33:35.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b72e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f9b6c06c5d0 con 0x7f9b6c142c90 2024-04-15T15:33:35.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b72e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6c06c010 con 0x7f9b6c143070 2024-04-15T15:33:35.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b70e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b6c06ba50 0x7f9b6c0cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b70e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b6c06ba50 0x7f9b6c0cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38286/0 (socket says 172.21.15.73:38286) 2024-04-15T15:33:35.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b70e00640 1 -- 172.21.15.73:0/3514585863 learned_addr learned my addr 172.21.15.73:0/3514585863 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:35.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b6b400640 1 --2- 172.21.15.73:0/3514585863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b6c143070 0x7f9b6c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b6be00640 1 --2- 172.21.15.73:0/3514585863 >> v2:172.21.15.118:3300/0 conn(0x7f9b6c142c90 0x7f9b6c0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b70e00640 1 -- 172.21.15.73:0/3514585863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b6c143070 msgr2=0x7f9b6c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:35.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b70e00640 1 --2- 172.21.15.73:0/3514585863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b6c143070 0x7f9b6c0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b70e00640 1 -- 172.21.15.73:0/3514585863 >> v2:172.21.15.118:3300/0 conn(0x7f9b6c142c90 msgr2=0x7f9b6c0b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:35.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b70e00640 1 --2- 172.21.15.73:0/3514585863 >> v2:172.21.15.118:3300/0 conn(0x7f9b6c142c90 0x7f9b6c0b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.344+0000 7f9b70e00640 1 -- 172.21.15.73:0/3514585863 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6c06c2f0 con 0x7f9b6c06ba50 2024-04-15T15:33:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b70e00640 1 --2- 172.21.15.73:0/3514585863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6c06ba50 0x7f9b6c0cfd50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c06c220 tx=0x7f9b6401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c1aa73383622f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b6aa00640 1 -- 172.21.15.73:0/3514585863 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640aa430 con 0x7f9b6c06ba50 2024-04-15T15:33:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b6aa00640 1 -- 172.21.15.73:0/3514585863 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b640af070 con 0x7f9b6c06ba50 2024-04-15T15:33:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b6aa00640 1 -- 172.21.15.73:0/3514585863 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640aa7f0 con 0x7f9b6c06ba50 2024-04-15T15:33:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 -- 172.21.15.73:0/3514585863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6c06ba50 msgr2=0x7f9b6c0cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 --2- 172.21.15.73:0/3514585863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6c06ba50 0x7f9b6c0cfd50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c06c220 tx=0x7f9b6401c4f0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 -- 172.21.15.73:0/3514585863 shutdown_connections 2024-04-15T15:33:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 --2- 172.21.15.73:0/3514585863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6c06ba50 0x7f9b6c0cfd50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 --2- 172.21.15.73:0/3514585863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b6c143070 0x7f9b6c0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 --2- 172.21.15.73:0/3514585863 >> v2:172.21.15.118:3300/0 conn(0x7f9b6c142c90 0x7f9b6c0b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 -- 172.21.15.73:0/3514585863 >> 172.21.15.73:0/3514585863 conn(0x7f9b6c067e30 msgr2=0x7f9b6c0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 -- 172.21.15.73:0/3514585863 shutdown_connections 2024-04-15T15:33:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 -- 172.21.15.73:0/3514585863 wait complete. 2024-04-15T15:33:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 Processor -- start 2024-04-15T15:33:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.348+0000 7f9b72e00640 1 -- start start 2024-04-15T15:33:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b72e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b6c06ba50 0x7f9b6c1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b72e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6c142c90 0x7f9b6c138d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b72e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b6c143070 0x7f9b6c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b72e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6c0cd630 con 0x7f9b6c142c90 2024-04-15T15:33:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b72e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6c0cd4b0 con 0x7f9b6c06ba50 2024-04-15T15:33:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b72e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6c0cd7b0 con 0x7f9b6c143070 2024-04-15T15:33:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6c142c90 0x7f9b6c138d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6c142c90 0x7f9b6c138d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38294/0 (socket says 172.21.15.73:38294) 2024-04-15T15:33:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6b400640 1 -- 172.21.15.73:0/2276642078 learned_addr learned my addr 172.21.15.73:0/2276642078 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6be00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b6c06ba50 0x7f9b6c1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b70e00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b6c143070 0x7f9b6c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6b400640 1 -- 172.21.15.73:0/2276642078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b6c143070 msgr2=0x7f9b6c15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6b400640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b6c143070 0x7f9b6c15a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6b400640 1 -- 172.21.15.73:0/2276642078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b6c06ba50 msgr2=0x7f9b6c1571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6b400640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b6c06ba50 0x7f9b6c1571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6b400640 1 -- 172.21.15.73:0/2276642078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6c15ac20 con 0x7f9b6c142c90 2024-04-15T15:33:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6be00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b6c06ba50 0x7f9b6c1571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b70e00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b6c143070 0x7f9b6c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b6b400640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6c142c90 0x7f9b6c138d90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800e870 tx=0x7f9b5800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b63e00640 1 -- 172.21.15.73:0/2276642078 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b58017070 con 0x7f9b6c142c90 2024-04-15T15:33:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b63e00640 1 -- 172.21.15.73:0/2276642078 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b5800c940 con 0x7f9b6c142c90 2024-04-15T15:33:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b63e00640 1 -- 172.21.15.73:0/2276642078 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800ccf0 con 0x7f9b6c142c90 2024-04-15T15:33:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b6c157700 con 0x7f9b6c142c90 2024-04-15T15:33:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b6c156400 con 0x7f9b6c142c90 2024-04-15T15:33:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b6c068b20 con 0x7f9b6c142c90 2024-04-15T15:33:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.352+0000 7f9b63e00640 1 -- 172.21.15.73:0/2276642078 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f9b5801a070 con 0x7f9b6c142c90 2024-04-15T15:33:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.356+0000 7f9b63e00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b4c068440 0x7f9b4c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.356+0000 7f9b63e00640 1 -- 172.21.15.73:0/2276642078 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f9b580867b0 con 0x7f9b6c142c90 2024-04-15T15:33:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.356+0000 7f9b63e00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] conn(0x7f9b4c06e980 0x7f9b4c070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.356+0000 7f9b63e00640 1 -- 172.21.15.73:0/2276642078 --> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b5800be50 con 0x7f9b4c06e980 2024-04-15T15:33:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.356+0000 7f9b63e00640 1 -- 172.21.15.73:0/2276642078 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f9b5808d050 con 0x7f9b6c142c90 2024-04-15T15:33:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.356+0000 7f9b6be00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b4c068440 0x7f9b4c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.356+0000 7f9b70e00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] conn(0x7f9b4c06e980 0x7f9b4c070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.356+0000 7f9b6be00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b4c068440 0x7f9b4c06a900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0074c0 tx=0x7f9b5c00d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.356+0000 7f9b70e00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] conn(0x7f9b4c06e980 0x7f9b4c070dc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.356+0000 7f9b63e00640 1 -- 172.21.15.73:0/2276642078 <== osd.0 v2:172.21.15.73:6800/3735416960 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b5800be50 con 0x7f9b4c06e980 2024-04-15T15:33:35.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.368+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 --> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9b6c145960 con 0x7f9b4c06e980 2024-04-15T15:33:35.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.368+0000 7f9b63e00640 1 -- 172.21.15.73:0/2276642078 <== osd.0 v2:172.21.15.73:6800/3735416960 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9b6c145960 con 0x7f9b4c06e980 2024-04-15T15:33:35.371 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:35.372 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:33:35.372 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:35.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.368+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] conn(0x7f9b4c06e980 msgr2=0x7f9b4c070dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.368+0000 7f9b72e00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:6800/3735416960,v1:172.21.15.73:6801/3735416960] conn(0x7f9b4c06e980 0x7f9b4c070dc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.368+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b4c068440 msgr2=0x7f9b4c06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.368+0000 7f9b72e00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9b4c068440 0x7f9b4c06a900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0074c0 tx=0x7f9b5c00d040 comp rx=0 tx=0).stop 2024-04-15T15:33:35.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.368+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6c142c90 msgr2=0x7f9b6c138d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.368+0000 7f9b72e00640 1 --2- 172.21.15.73:0/2276642078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b6c142c90 0x7f9b6c138d90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800e870 tx=0x7f9b5800ec70 comp rx=0 tx=0).stop 2024-04-15T15:33:35.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.372+0000 7f9b70e00640 1 -- 172.21.15.73:0/2276642078 reap_dead start 2024-04-15T15:33:35.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.372+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 shutdown_connections 2024-04-15T15:33:35.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.372+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 >> 172.21.15.73:0/2276642078 conn(0x7f9b6c067e30 msgr2=0x7f9b6c1434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:35.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.372+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 shutdown_connections 2024-04-15T15:33:35.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.372+0000 7f9b72e00640 1 -- 172.21.15.73:0/2276642078 wait complete. 2024-04-15T15:33:35.390 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-15T15:33:35.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.524+0000 7f6078600640 1 Processor -- start 2024-04-15T15:33:35.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.524+0000 7f6078600640 1 -- start start 2024-04-15T15:33:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6078600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60700b27c0 0x7f607015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6078600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60700b3e30 0x7f60700b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6078600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6070070160 con 0x7f607015b5d0 2024-04-15T15:33:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6078600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f607015b9b0 con 0x7f60700b27c0 2024-04-15T15:33:35.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6078600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f607015f1f0 con 0x7f60700b3e30 2024-04-15T15:33:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6075200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60700b27c0 0x7f607015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6075200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60700b27c0 0x7f607015fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38308/0 (socket says 172.21.15.73:38308) 2024-04-15T15:33:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6075200640 1 -- 172.21.15.73:0/1634980084 learned_addr learned my addr 172.21.15.73:0/1634980084 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6076600640 1 --2- 172.21.15.73:0/1634980084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60700b3e30 0x7f60700b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6075200640 1 -- 172.21.15.73:0/1634980084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60700b3e30 msgr2=0x7f60700b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6075200640 1 --2- 172.21.15.73:0/1634980084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60700b3e30 0x7f60700b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6075200640 1 -- 172.21.15.73:0/1634980084 >> v1:172.21.15.118:6789/0 conn(0x7f607015b5d0 legacy=0x7f60700b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6075200640 1 -- 172.21.15.73:0/1634980084 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607006fe80 con 0x7f60700b27c0 2024-04-15T15:33:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f6075200640 1 --2- 172.21.15.73:0/1634980084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 0x7f607015fc90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6064009870 tx=0x7f606401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6963f784a0e79d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f606fe00640 1 -- 172.21.15.73:0/1634980084 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60640ab410 con 0x7f60700b27c0 2024-04-15T15:33:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f606fe00640 1 -- 172.21.15.73:0/1634980084 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60640b0070 con 0x7f60700b27c0 2024-04-15T15:33:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.528+0000 7f606fe00640 1 -- 172.21.15.73:0/1634980084 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60640ab7d0 con 0x7f60700b27c0 2024-04-15T15:33:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 -- 172.21.15.73:0/1634980084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 msgr2=0x7f607015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 --2- 172.21.15.73:0/1634980084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 0x7f607015fc90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6064009870 tx=0x7f606401c410 comp rx=0 tx=0).stop 2024-04-15T15:33:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 -- 172.21.15.73:0/1634980084 shutdown_connections 2024-04-15T15:33:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 --2- 172.21.15.73:0/1634980084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60700b3e30 0x7f60700b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 --2- 172.21.15.73:0/1634980084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 0x7f607015fc90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 -- 172.21.15.73:0/1634980084 >> 172.21.15.73:0/1634980084 conn(0x7f6070067dd0 msgr2=0x7f60700d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 -- 172.21.15.73:0/1634980084 shutdown_connections 2024-04-15T15:33:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 -- 172.21.15.73:0/1634980084 wait complete. 2024-04-15T15:33:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 Processor -- start 2024-04-15T15:33:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 -- start start 2024-04-15T15:33:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 0x7f60700b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60700b3e30 0x7f60701527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f607015b5d0 0x7f6070155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f607006faa0 con 0x7f60700b27c0 2024-04-15T15:33:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f60700b4240 con 0x7f607015b5d0 2024-04-15T15:33:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6078600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f607006fc20 con 0x7f60700b3e30 2024-04-15T15:33:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6075c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 0x7f60700b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6075c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 0x7f60700b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38318/0 (socket says 172.21.15.73:38318) 2024-04-15T15:33:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6075c00640 1 -- 172.21.15.73:0/4107621231 learned_addr learned my addr 172.21.15.73:0/4107621231 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6076600640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f607015b5d0 0x7f6070155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6075200640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60700b3e30 0x7f60701527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6075c00640 1 -- 172.21.15.73:0/4107621231 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60700b3e30 msgr2=0x7f60701527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6075c00640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60700b3e30 0x7f60701527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6075c00640 1 -- 172.21.15.73:0/4107621231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f607015b5d0 msgr2=0x7f6070155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6075c00640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f607015b5d0 0x7f6070155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.532+0000 7f6075c00640 1 -- 172.21.15.73:0/4107621231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60701530c0 con 0x7f60700b27c0 2024-04-15T15:33:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f6075c00640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 0x7f60700b19b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f606000c420 tx=0x7f606000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f606d600640 1 -- 172.21.15.73:0/4107621231 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60600052d0 con 0x7f60700b27c0 2024-04-15T15:33:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f606d600640 1 -- 172.21.15.73:0/4107621231 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6060005470 con 0x7f60700b27c0 2024-04-15T15:33:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f606d600640 1 -- 172.21.15.73:0/4107621231 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060007260 con 0x7f60700b27c0 2024-04-15T15:33:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f6078600640 1 -- 172.21.15.73:0/4107621231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60700b11c0 con 0x7f60700b27c0 2024-04-15T15:33:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f6078600640 1 -- 172.21.15.73:0/4107621231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60700b0ee0 con 0x7f60700b27c0 2024-04-15T15:33:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f6078600640 1 -- 172.21.15.73:0/4107621231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6070068ab0 con 0x7f60700b27c0 2024-04-15T15:33:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f606d600640 1 -- 172.21.15.73:0/4107621231 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f6060007400 con 0x7f60700b27c0 2024-04-15T15:33:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f606d600640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6054068410 0x7f605406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f606d600640 1 -- 172.21.15.73:0/4107621231 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f6060085dd0 con 0x7f60700b27c0 2024-04-15T15:33:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.536+0000 7f6075200640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6054068410 0x7f605406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.540+0000 7f6075200640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6054068410 0x7f605406a8d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f60640af000 tx=0x7f60640a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.540+0000 7f606d600640 1 -- 172.21.15.73:0/4107621231 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60701530c0 con 0x7f60700b27c0 2024-04-15T15:33:35.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 -- 172.21.15.73:0/4107621231 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f60700adde0 con 0x7f6054068410 2024-04-15T15:33:35.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f606d600640 1 -- 172.21.15.73:0/4107621231 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f60700adde0 con 0x7f6054068410 2024-04-15T15:33:35.701 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-04-15T15:33:35.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 -- 172.21.15.73:0/4107621231 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6054068410 msgr2=0x7f605406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6054068410 0x7f605406a8d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f60640af000 tx=0x7f60640a7000 comp rx=0 tx=0).stop 2024-04-15T15:33:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 -- 172.21.15.73:0/4107621231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 msgr2=0x7f60700b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 0x7f60700b19b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f606000c420 tx=0x7f606000c8e0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 -- 172.21.15.73:0/4107621231 shutdown_connections 2024-04-15T15:33:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f607015b5d0 0x7f6070155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6054068410 0x7f605406a8d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60700b3e30 0x7f60701527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 --2- 172.21.15.73:0/4107621231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60700b27c0 0x7f60700b19b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 -- 172.21.15.73:0/4107621231 >> 172.21.15.73:0/4107621231 conn(0x7f6070067dd0 msgr2=0x7f6070159630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:35.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 -- 172.21.15.73:0/4107621231 shutdown_connections 2024-04-15T15:33:35.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.700+0000 7f6078600640 1 -- 172.21.15.73:0/4107621231 wait complete. 2024-04-15T15:33:35.724 INFO:tasks.ceph:Scrubbing osd.1 2024-04-15T15:33:35.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:33:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.860+0000 7f5655e00640 1 Processor -- start 2024-04-15T15:33:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.860+0000 7f5655e00640 1 -- start start 2024-04-15T15:33:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f5655e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5650142c90 0x7f56500b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f5655e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56500cff20 0x7f56500ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f5655e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f565006c010 con 0x7f5650143070 2024-04-15T15:33:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f5655e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f56500b4ae0 con 0x7f5650142c90 2024-04-15T15:33:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f5655e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f565006c5d0 con 0x7f56500cff20 2024-04-15T15:33:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f564e000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5650143070 0x7f56500cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37352/0 (socket says 172.21.15.73:37352) 2024-04-15T15:33:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f564e000640 1 -- 172.21.15.73:0/1185458741 learned_addr learned my addr 172.21.15.73:0/1185458741 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f564ea00640 1 --2- 172.21.15.73:0/1185458741 >> v2:172.21.15.73:3300/0 conn(0x7f5650142c90 0x7f56500b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f564f400640 1 --2- 172.21.15.73:0/1185458741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56500cff20 0x7f56500ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f564ea00640 1 -- 172.21.15.73:0/1185458741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56500cff20 msgr2=0x7f56500ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f564ea00640 1 --2- 172.21.15.73:0/1185458741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56500cff20 0x7f56500ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f564ea00640 1 -- 172.21.15.73:0/1185458741 >> v1:172.21.15.73:6789/0 conn(0x7f5650143070 legacy=0x7f56500cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.864+0000 7f564ea00640 1 -- 172.21.15.73:0/1185458741 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565006c2f0 con 0x7f5650142c90 2024-04-15T15:33:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f564ea00640 1 --2- 172.21.15.73:0/1185458741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5650142c90 0x7f56500b5510 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f56400097c0 tx=0x7f564001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c260cc9d38b2d441 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f564d600640 1 -- 172.21.15.73:0/1185458741 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56400b2070 con 0x7f5650142c90 2024-04-15T15:33:35.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f564d600640 1 -- 172.21.15.73:0/1185458741 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56400ad680 con 0x7f5650142c90 2024-04-15T15:33:35.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f564d600640 1 -- 172.21.15.73:0/1185458741 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56400ada50 con 0x7f5650142c90 2024-04-15T15:33:35.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 -- 172.21.15.73:0/1185458741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5650142c90 msgr2=0x7f56500b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 --2- 172.21.15.73:0/1185458741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5650142c90 0x7f56500b5510 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f56400097c0 tx=0x7f564001c470 comp rx=0 tx=0).stop 2024-04-15T15:33:35.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 -- 172.21.15.73:0/1185458741 shutdown_connections 2024-04-15T15:33:35.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 --2- 172.21.15.73:0/1185458741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56500cff20 0x7f56500ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 --2- 172.21.15.73:0/1185458741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5650142c90 0x7f56500b5510 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 -- 172.21.15.73:0/1185458741 >> 172.21.15.73:0/1185458741 conn(0x7f5650067e30 msgr2=0x7f56500b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:35.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 -- 172.21.15.73:0/1185458741 shutdown_connections 2024-04-15T15:33:35.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 -- 172.21.15.73:0/1185458741 wait complete. 2024-04-15T15:33:35.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 Processor -- start 2024-04-15T15:33:35.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 -- start start 2024-04-15T15:33:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56500cff20 0x7f56501563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5650142c90 0x7f565013ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5650143070 0x7f565013b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5650169620 con 0x7f56500cff20 2024-04-15T15:33:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5650146360 con 0x7f5650142c90 2024-04-15T15:33:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.868+0000 7f5655e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f56501697a0 con 0x7f5650143070 2024-04-15T15:33:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f564ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56500cff20 0x7f56501563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f564ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56500cff20 0x7f56501563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38338/0 (socket says 172.21.15.73:38338) 2024-04-15T15:33:35.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f564ea00640 1 -- 172.21.15.73:0/1402277172 learned_addr learned my addr 172.21.15.73:0/1402277172 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:35.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f564ea00640 1 -- 172.21.15.73:0/1402277172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5650143070 msgr2=0x7f565013b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f564ea00640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5650143070 0x7f565013b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f564ea00640 1 -- 172.21.15.73:0/1402277172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5650142c90 msgr2=0x7f565013ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f564ea00640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5650142c90 0x7f565013ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f564ea00640 1 -- 172.21.15.73:0/1402277172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5650069310 con 0x7f56500cff20 2024-04-15T15:33:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f564ea00640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56500cff20 0x7f56501563c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f564001a0a0 tx=0x7f564001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f5647400640 1 -- 172.21.15.73:0/1402277172 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56400bc020 con 0x7f56500cff20 2024-04-15T15:33:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f5647400640 1 -- 172.21.15.73:0/1402277172 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56400adbb0 con 0x7f56500cff20 2024-04-15T15:33:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f5647400640 1 -- 172.21.15.73:0/1402277172 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56400b2040 con 0x7f56500cff20 2024-04-15T15:33:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5650156c00 con 0x7f56500cff20 2024-04-15T15:33:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5650156900 con 0x7f56500cff20 2024-04-15T15:33:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5650156ee0 con 0x7f56500cff20 2024-04-15T15:33:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f5647400640 1 -- 172.21.15.73:0/1402277172 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f56400bf020 con 0x7f56500cff20 2024-04-15T15:33:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f5647400640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5630068410 0x7f563006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f5647400640 1 -- 172.21.15.73:0/1402277172 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f5640120ff0 con 0x7f56500cff20 2024-04-15T15:33:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.872+0000 7f564e000640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5630068410 0x7f563006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.876+0000 7f5647400640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] conn(0x7f563006e950 0x7f5630070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.876+0000 7f5647400640 1 -- 172.21.15.73:0/1402277172 --> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56400afec0 con 0x7f563006e950 2024-04-15T15:33:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.876+0000 7f5647400640 1 -- 172.21.15.73:0/1402277172 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f5640121420 con 0x7f56500cff20 2024-04-15T15:33:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.876+0000 7f564f400640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] conn(0x7f563006e950 0x7f5630070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.876+0000 7f564e000640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5630068410 0x7f563006a8d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f563c000f70 tx=0x7f563c007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.876+0000 7f564f400640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] conn(0x7f563006e950 0x7f5630070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.876+0000 7f5647400640 1 -- 172.21.15.73:0/1402277172 <== osd.1 v2:172.21.15.73:6824/721226997 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f56400afec0 con 0x7f563006e950 2024-04-15T15:33:35.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 --> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5650068b20 con 0x7f563006e950 2024-04-15T15:33:35.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5647400640 1 -- 172.21.15.73:0/1402277172 <== osd.1 v2:172.21.15.73:6824/721226997 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5650068b20 con 0x7f563006e950 2024-04-15T15:33:35.891 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:35.891 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:33:35.891 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:35.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] conn(0x7f563006e950 msgr2=0x7f5630070d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:6824/721226997,v1:172.21.15.73:6825/721226997] conn(0x7f563006e950 0x7f5630070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5630068410 msgr2=0x7f563006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f5630068410 0x7f563006a8d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f563c000f70 tx=0x7f563c007a80 comp rx=0 tx=0).stop 2024-04-15T15:33:35.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56500cff20 msgr2=0x7f56501563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:35.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 --2- 172.21.15.73:0/1402277172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56500cff20 0x7f56501563c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f564001a0a0 tx=0x7f564001acb0 comp rx=0 tx=0).stop 2024-04-15T15:33:35.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f564f400640 1 -- 172.21.15.73:0/1402277172 reap_dead start 2024-04-15T15:33:35.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 shutdown_connections 2024-04-15T15:33:35.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 >> 172.21.15.73:0/1402277172 conn(0x7f5650067e30 msgr2=0x7f565015c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:35.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 shutdown_connections 2024-04-15T15:33:35.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:35.888+0000 7f5655e00640 1 -- 172.21.15.73:0/1402277172 wait complete. 2024-04-15T15:33:35.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-15T15:33:36.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.044+0000 7f2788200640 1 Processor -- start 2024-04-15T15:33:36.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2788200640 1 -- start start 2024-04-15T15:33:36.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2788200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f27800b20b0 0x7f27800b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2788200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f278015cbd0 0x7f278015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2788200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27800cd3a0 con 0x7f2780146110 2024-04-15T15:33:36.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2788200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f27800b5160 con 0x7f27800b20b0 2024-04-15T15:33:36.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2788200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f27800b40c0 con 0x7f278015cbd0 2024-04-15T15:33:36.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2784e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f27800b20b0 0x7f27800b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2784e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f27800b20b0 0x7f27800b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38340/0 (socket says 172.21.15.73:38340) 2024-04-15T15:33:36.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2784e00640 1 -- 172.21.15.73:0/2594031587 learned_addr learned my addr 172.21.15.73:0/2594031587 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:36.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2786200640 1 --2- 172.21.15.73:0/2594031587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f278015cbd0 0x7f278015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2784e00640 1 -- 172.21.15.73:0/2594031587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f278015cbd0 msgr2=0x7f278015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:36.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2784e00640 1 --2- 172.21.15.73:0/2594031587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f278015cbd0 0x7f278015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2784e00640 1 -- 172.21.15.73:0/2594031587 >> v1:172.21.15.118:6789/0 conn(0x7f2780146110 legacy=0x7f27800cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:36.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2784e00640 1 -- 172.21.15.73:0/2594031587 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27800b43a0 con 0x7f27800b20b0 2024-04-15T15:33:36.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.048+0000 7f2786200640 1 --2- 172.21.15.73:0/2594031587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f278015cbd0 0x7f278015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:36.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2784e00640 1 --2- 172.21.15.73:0/2594031587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27800b20b0 0x7f27800b2530 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f276c009870 tx=0x7f276c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a6c2cdf9e470cd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f277fe00640 1 -- 172.21.15.73:0/2594031587 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c0b1070 con 0x7f27800b20b0 2024-04-15T15:33:36.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f277fe00640 1 -- 172.21.15.73:0/2594031587 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c0ac630 con 0x7f27800b20b0 2024-04-15T15:33:36.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f277fe00640 1 -- 172.21.15.73:0/2594031587 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c0a8050 con 0x7f27800b20b0 2024-04-15T15:33:36.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2788200640 1 -- 172.21.15.73:0/2594031587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27800b20b0 msgr2=0x7f27800b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2788200640 1 --2- 172.21.15.73:0/2594031587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27800b20b0 0x7f27800b2530 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f276c009870 tx=0x7f276c01c520 comp rx=0 tx=0).stop 2024-04-15T15:33:36.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2788200640 1 -- 172.21.15.73:0/2594031587 shutdown_connections 2024-04-15T15:33:36.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2788200640 1 --2- 172.21.15.73:0/2594031587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f278015cbd0 0x7f278015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2788200640 1 --2- 172.21.15.73:0/2594031587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27800b20b0 0x7f27800b2530 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2788200640 1 -- 172.21.15.73:0/2594031587 >> 172.21.15.73:0/2594031587 conn(0x7f2780067dd0 msgr2=0x7f27800d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:36.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2788200640 1 -- 172.21.15.73:0/2594031587 shutdown_connections 2024-04-15T15:33:36.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2788200640 1 -- 172.21.15.73:0/2594031587 wait complete. 2024-04-15T15:33:36.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2788200640 1 Processor -- start 2024-04-15T15:33:36.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.052+0000 7f2788200640 1 -- start start 2024-04-15T15:33:36.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2788200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27800b20b0 0x7f2780137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2788200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2780146110 0x7f2780135ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2788200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278015cbd0 0x7f278013a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2788200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f278006de10 con 0x7f278015cbd0 2024-04-15T15:33:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2788200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f27800b3d70 con 0x7f27800b20b0 2024-04-15T15:33:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2788200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f278006df90 con 0x7f2780146110 2024-04-15T15:33:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2786200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278015cbd0 0x7f278013a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2786200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278015cbd0 0x7f278013a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38346/0 (socket says 172.21.15.73:38346) 2024-04-15T15:33:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2786200640 1 -- 172.21.15.73:0/803988967 learned_addr learned my addr 172.21.15.73:0/803988967 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2784e00640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2780146110 0x7f2780135ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2785800640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27800b20b0 0x7f2780137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2786200640 1 -- 172.21.15.73:0/803988967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2780146110 msgr2=0x7f2780135ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2786200640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2780146110 0x7f2780135ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2786200640 1 -- 172.21.15.73:0/803988967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27800b20b0 msgr2=0x7f2780137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2786200640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27800b20b0 0x7f2780137670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2786200640 1 -- 172.21.15.73:0/803988967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27801556b0 con 0x7f278015cbd0 2024-04-15T15:33:36.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2784e00640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2780146110 0x7f2780135ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:36.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2786200640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278015cbd0 0x7f278013a6a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f277800cd50 tx=0x7f277800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f277d600640 1 -- 172.21.15.73:0/803988967 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277800f680 con 0x7f278015cbd0 2024-04-15T15:33:36.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f277d600640 1 -- 172.21.15.73:0/803988967 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277800f840 con 0x7f278015cbd0 2024-04-15T15:33:36.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f277d600640 1 -- 172.21.15.73:0/803988967 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277800fc30 con 0x7f278015cbd0 2024-04-15T15:33:36.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2788200640 1 -- 172.21.15.73:0/803988967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2780155990 con 0x7f278015cbd0 2024-04-15T15:33:36.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2788200640 1 -- 172.21.15.73:0/803988967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2780155f50 con 0x7f278015cbd0 2024-04-15T15:33:36.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f2788200640 1 -- 172.21.15.73:0/803988967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2780068ab0 con 0x7f278015cbd0 2024-04-15T15:33:36.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.056+0000 7f277d600640 1 -- 172.21.15.73:0/803988967 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f27780213f0 con 0x7f278015cbd0 2024-04-15T15:33:36.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.060+0000 7f277d600640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2760068490 0x7f276006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.060+0000 7f277d600640 1 -- 172.21.15.73:0/803988967 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f2778087710 con 0x7f278015cbd0 2024-04-15T15:33:36.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.060+0000 7f2785800640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2760068490 0x7f276006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.060+0000 7f2785800640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2760068490 0x7f276006a950 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2774004e30 tx=0x7f2774009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.064+0000 7f277d600640 1 -- 172.21.15.73:0/803988967 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2778014030 con 0x7f278015cbd0 2024-04-15T15:33:36.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 -- 172.21.15.73:0/803988967 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f2780154680 con 0x7f2760068490 2024-04-15T15:33:36.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f277d600640 1 -- 172.21.15.73:0/803988967 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2780154680 con 0x7f2760068490 2024-04-15T15:33:36.222 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-04-15T15:33:36.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 -- 172.21.15.73:0/803988967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2760068490 msgr2=0x7f276006a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2760068490 0x7f276006a950 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2774004e30 tx=0x7f2774009040 comp rx=0 tx=0).stop 2024-04-15T15:33:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 -- 172.21.15.73:0/803988967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278015cbd0 msgr2=0x7f278013a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278015cbd0 0x7f278013a6a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f277800cd50 tx=0x7f277800a650 comp rx=0 tx=0).stop 2024-04-15T15:33:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 -- 172.21.15.73:0/803988967 shutdown_connections 2024-04-15T15:33:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278015cbd0 0x7f278013a6a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f2760068490 0x7f276006a950 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2780146110 0x7f2780135ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 --2- 172.21.15.73:0/803988967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27800b20b0 0x7f2780137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.220+0000 7f2788200640 1 -- 172.21.15.73:0/803988967 >> 172.21.15.73:0/803988967 conn(0x7f2780067dd0 msgr2=0x7f27800cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:36.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.224+0000 7f2788200640 1 -- 172.21.15.73:0/803988967 shutdown_connections 2024-04-15T15:33:36.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.224+0000 7f2788200640 1 -- 172.21.15.73:0/803988967 wait complete. 2024-04-15T15:33:36.244 INFO:tasks.ceph:Scrubbing osd.2 2024-04-15T15:33:36.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:33:36.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b04800640 1 Processor -- start 2024-04-15T15:33:36.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b04800640 1 -- start start 2024-04-15T15:33:36.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b04800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4afc09b630 0x7f4afc0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b04800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4afc0b3280 0x7f4afc0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b04800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4afc0d0f90 con 0x7f4afc15ef50 2024-04-15T15:33:36.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b04800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4afc0d0d40 con 0x7f4afc09b630 2024-04-15T15:33:36.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b04800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f4afc0d1270 con 0x7f4afc0b3280 2024-04-15T15:33:36.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b01400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4afc09b630 0x7f4afc0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b01400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4afc09b630 0x7f4afc0d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38356/0 (socket says 172.21.15.73:38356) 2024-04-15T15:33:36.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b01400640 1 -- 172.21.15.73:0/416628291 learned_addr learned my addr 172.21.15.73:0/416628291 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:36.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b02800640 1 --2- 172.21.15.73:0/416628291 >> v2:172.21.15.118:3300/0 conn(0x7f4afc0b3280 0x7f4afc0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b01400640 1 -- 172.21.15.73:0/416628291 >> v2:172.21.15.118:3300/0 conn(0x7f4afc0b3280 msgr2=0x7f4afc0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:36.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b01400640 1 --2- 172.21.15.73:0/416628291 >> v2:172.21.15.118:3300/0 conn(0x7f4afc0b3280 0x7f4afc0b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b01400640 1 -- 172.21.15.73:0/416628291 >> v1:172.21.15.118:6789/0 conn(0x7f4afc15ef50 legacy=0x7f4afc15f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.384+0000 7f4b01400640 1 -- 172.21.15.73:0/416628291 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc0d1550 con 0x7f4afc09b630 2024-04-15T15:33:36.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b01400640 1 --2- 172.21.15.73:0/416628291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4afc09b630 0x7f4afc0d0800 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0c9620 tx=0x7f4aec01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bd841d0b64bc17 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b00a00640 1 -- 172.21.15.73:0/416628291 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0aa650 con 0x7f4afc09b630 2024-04-15T15:33:36.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b00a00640 1 -- 172.21.15.73:0/416628291 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aec0af070 con 0x7f4afc09b630 2024-04-15T15:33:36.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b00a00640 1 -- 172.21.15.73:0/416628291 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0aaa10 con 0x7f4afc09b630 2024-04-15T15:33:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b04800640 1 -- 172.21.15.73:0/416628291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4afc09b630 msgr2=0x7f4afc0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b04800640 1 --2- 172.21.15.73:0/416628291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4afc09b630 0x7f4afc0d0800 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0c9620 tx=0x7f4aec01c4f0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b04800640 1 -- 172.21.15.73:0/416628291 shutdown_connections 2024-04-15T15:33:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b04800640 1 --2- 172.21.15.73:0/416628291 >> v2:172.21.15.118:3300/0 conn(0x7f4afc0b3280 0x7f4afc0b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b04800640 1 --2- 172.21.15.73:0/416628291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4afc09b630 0x7f4afc0d0800 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b04800640 1 -- 172.21.15.73:0/416628291 >> 172.21.15.73:0/416628291 conn(0x7f4afc0b40b0 msgr2=0x7f4afc0b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:36.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b04800640 1 -- 172.21.15.73:0/416628291 shutdown_connections 2024-04-15T15:33:36.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b04800640 1 -- 172.21.15.73:0/416628291 wait complete. 2024-04-15T15:33:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b04800640 1 Processor -- start 2024-04-15T15:33:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.388+0000 7f4b04800640 1 -- start start 2024-04-15T15:33:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b04800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4afc09b630 0x7f4afc14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b04800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4afc0b3280 0x7f4afc15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b04800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4afc15ef50 0x7f4afc14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b04800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc15c830 con 0x7f4afc09b630 2024-04-15T15:33:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b04800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc09bac0 con 0x7f4afc0b3280 2024-04-15T15:33:36.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b04800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4afc153500 con 0x7f4afc15ef50 2024-04-15T15:33:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b01e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4afc09b630 0x7f4afc14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b01e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4afc09b630 0x7f4afc14e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38366/0 (socket says 172.21.15.73:38366) 2024-04-15T15:33:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b01e00640 1 -- 172.21.15.73:0/2745760685 learned_addr learned my addr 172.21.15.73:0/2745760685 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b02800640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4afc15ef50 0x7f4afc14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b01400640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4afc0b3280 0x7f4afc15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b01e00640 1 -- 172.21.15.73:0/2745760685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4afc15ef50 msgr2=0x7f4afc14ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b01e00640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4afc15ef50 0x7f4afc14ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b01e00640 1 -- 172.21.15.73:0/2745760685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4afc0b3280 msgr2=0x7f4afc15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b01e00640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4afc0b3280 0x7f4afc15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b01e00640 1 -- 172.21.15.73:0/2745760685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc1537e0 con 0x7f4afc09b630 2024-04-15T15:33:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b02800640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4afc15ef50 0x7f4afc14ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:36.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b01e00640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4afc09b630 0x7f4afc14e760 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c370 tx=0x7f4af000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4af6000640 1 -- 172.21.15.73:0/2745760685 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00052d0 con 0x7f4afc09b630 2024-04-15T15:33:36.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4af6000640 1 -- 172.21.15.73:0/2745760685 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af0005470 con 0x7f4afc09b630 2024-04-15T15:33:36.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4af6000640 1 -- 172.21.15.73:0/2745760685 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0007260 con 0x7f4afc09b630 2024-04-15T15:33:36.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4afc153ac0 con 0x7f4afc09b630 2024-04-15T15:33:36.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4afc154080 con 0x7f4afc09b630 2024-04-15T15:33:36.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4afc068b20 con 0x7f4afc09b630 2024-04-15T15:33:36.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.392+0000 7f4af6000640 1 -- 172.21.15.73:0/2745760685 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f4af0007400 con 0x7f4afc09b630 2024-04-15T15:33:36.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.396+0000 7f4af6000640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ae0068410 0x7f4ae006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.396+0000 7f4af6000640 1 -- 172.21.15.73:0/2745760685 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f4af0085d20 con 0x7f4afc09b630 2024-04-15T15:33:36.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.396+0000 7f4b01400640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ae0068410 0x7f4ae006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.396+0000 7f4af6000640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] conn(0x7f4ae006e950 0x7f4ae0070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.396+0000 7f4af6000640 1 -- 172.21.15.73:0/2745760685 --> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4af0014e50 con 0x7f4ae006e950 2024-04-15T15:33:36.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.396+0000 7f4af6000640 1 -- 172.21.15.73:0/2745760685 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f4af008b070 con 0x7f4afc09b630 2024-04-15T15:33:36.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.396+0000 7f4b02800640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] conn(0x7f4ae006e950 0x7f4ae0070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.396+0000 7f4b01400640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ae0068410 0x7f4ae006a8d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0ae000 tx=0x7f4aec0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.396+0000 7f4b02800640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] conn(0x7f4ae006e950 0x7f4ae0070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.396+0000 7f4af6000640 1 -- 172.21.15.73:0/2745760685 <== osd.2 v2:172.21.15.73:6816/81233902 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4af0014e50 con 0x7f4ae006e950 2024-04-15T15:33:36.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.408+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 --> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4afc0b4f90 con 0x7f4ae006e950 2024-04-15T15:33:36.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.408+0000 7f4af6000640 1 -- 172.21.15.73:0/2745760685 <== osd.2 v2:172.21.15.73:6816/81233902 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4afc0b4f90 con 0x7f4ae006e950 2024-04-15T15:33:36.414 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:36.415 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:33:36.415 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:36.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.408+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] conn(0x7f4ae006e950 msgr2=0x7f4ae0070d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.408+0000 7f4b04800640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:6816/81233902,v1:172.21.15.73:6817/81233902] conn(0x7f4ae006e950 0x7f4ae0070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.412+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ae0068410 msgr2=0x7f4ae006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.412+0000 7f4b04800640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f4ae0068410 0x7f4ae006a8d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0ae000 tx=0x7f4aec0a7000 comp rx=0 tx=0).stop 2024-04-15T15:33:36.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.412+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4afc09b630 msgr2=0x7f4afc14e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.412+0000 7f4b04800640 1 --2- 172.21.15.73:0/2745760685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4afc09b630 0x7f4afc14e760 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c370 tx=0x7f4af000c830 comp rx=0 tx=0).stop 2024-04-15T15:33:36.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.412+0000 7f4b02800640 1 -- 172.21.15.73:0/2745760685 reap_dead start 2024-04-15T15:33:36.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.412+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 shutdown_connections 2024-04-15T15:33:36.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.412+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 >> 172.21.15.73:0/2745760685 conn(0x7f4afc0b40b0 msgr2=0x7f4afc15cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:36.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.412+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 shutdown_connections 2024-04-15T15:33:36.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.412+0000 7f4b04800640 1 -- 172.21.15.73:0/2745760685 wait complete. 2024-04-15T15:33:36.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-15T15:33:36.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.564+0000 7ff967600640 1 Processor -- start 2024-04-15T15:33:36.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.564+0000 7ff967600640 1 -- start start 2024-04-15T15:33:36.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.564+0000 7ff967600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 0x7ff9600b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.564+0000 7ff967600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff96015cbd0 0x7ff96015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.564+0000 7ff967600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9600cd3a0 con 0x7ff960146110 2024-04-15T15:33:36.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.564+0000 7ff967600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff9600b5160 con 0x7ff96015cbd0 2024-04-15T15:33:36.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.564+0000 7ff967600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff9600b40c0 con 0x7ff9600b20b0 2024-04-15T15:33:36.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.564+0000 7ff964c00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff960146110 0x7ff9600cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37368/0 (socket says 172.21.15.73:37368) 2024-04-15T15:33:36.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.564+0000 7ff964c00640 1 -- 172.21.15.73:0/851624423 learned_addr learned my addr 172.21.15.73:0/851624423 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:36.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.564+0000 7ff965600640 1 --2- 172.21.15.73:0/851624423 >> v2:172.21.15.73:3300/0 conn(0x7ff96015cbd0 0x7ff96015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff95fe00640 1 --2- 172.21.15.73:0/851624423 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 0x7ff9600b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff95f400640 1 -- 172.21.15.73:0/851624423 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 957410151 0 0) 0x7ff9600cd3a0 con 0x7ff960146110 2024-04-15T15:33:36.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff95f400640 1 -- 172.21.15.73:0/851624423 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff944003530 con 0x7ff960146110 2024-04-15T15:33:36.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff965600640 1 -- 172.21.15.73:0/851624423 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 msgr2=0x7ff9600b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:36.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff965600640 1 --2- 172.21.15.73:0/851624423 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 0x7ff9600b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff965600640 1 -- 172.21.15.73:0/851624423 >> v1:172.21.15.73:6789/0 conn(0x7ff960146110 legacy=0x7ff9600cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff965600640 1 -- 172.21.15.73:0/851624423 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9600b43a0 con 0x7ff96015cbd0 2024-04-15T15:33:36.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff965600640 1 --2- 172.21.15.73:0/851624423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 0x7ff96015d060 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff9580097c0 tx=0x7ff95801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc13a33b6a387667 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff95f400640 1 -- 172.21.15.73:0/851624423 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9580b2070 con 0x7ff96015cbd0 2024-04-15T15:33:36.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff95f400640 1 -- 172.21.15.73:0/851624423 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9580ad640 con 0x7ff96015cbd0 2024-04-15T15:33:36.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff95f400640 1 -- 172.21.15.73:0/851624423 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9580ada10 con 0x7ff96015cbd0 2024-04-15T15:33:36.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff967600640 1 -- 172.21.15.73:0/851624423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 msgr2=0x7ff96015d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.568+0000 7ff967600640 1 --2- 172.21.15.73:0/851624423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 0x7ff96015d060 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff9580097c0 tx=0x7ff95801c4a0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 -- 172.21.15.73:0/851624423 shutdown_connections 2024-04-15T15:33:36.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 --2- 172.21.15.73:0/851624423 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 0x7ff9600b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 --2- 172.21.15.73:0/851624423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 0x7ff96015d060 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 -- 172.21.15.73:0/851624423 >> 172.21.15.73:0/851624423 conn(0x7ff960067dd0 msgr2=0x7ff9600d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:36.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 -- 172.21.15.73:0/851624423 shutdown_connections 2024-04-15T15:33:36.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 -- 172.21.15.73:0/851624423 wait complete. 2024-04-15T15:33:36.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 Processor -- start 2024-04-15T15:33:36.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 -- start start 2024-04-15T15:33:36.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 0x7ff96013cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff960146110 0x7ff96015c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 0x7ff9601438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff960169210 con 0x7ff96015cbd0 2024-04-15T15:33:36.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff9600b3d70 con 0x7ff960146110 2024-04-15T15:33:36.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff967600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff960169390 con 0x7ff9600b20b0 2024-04-15T15:33:36.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff965600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 0x7ff9601438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff965600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 0x7ff9601438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38394/0 (socket says 172.21.15.73:38394) 2024-04-15T15:33:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff965600640 1 -- 172.21.15.73:0/2664677200 learned_addr learned my addr 172.21.15.73:0/2664677200 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff964c00640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 0x7ff96013cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff965600640 1 -- 172.21.15.73:0/2664677200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 msgr2=0x7ff96013cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff95fe00640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff960146110 0x7ff96015c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff965600640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 0x7ff96013cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff965600640 1 -- 172.21.15.73:0/2664677200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff960146110 msgr2=0x7ff96015c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff965600640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff960146110 0x7ff96015c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff965600640 1 -- 172.21.15.73:0/2664677200 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96015b180 con 0x7ff96015cbd0 2024-04-15T15:33:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff95fe00640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff960146110 0x7ff96015c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff964c00640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 0x7ff96013cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.572+0000 7ff965600640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 0x7ff9601438d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff9580097c0 tx=0x7ff958019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff95cc00640 1 -- 172.21.15.73:0/2664677200 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9580b2040 con 0x7ff96015cbd0 2024-04-15T15:33:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff95cc00640 1 -- 172.21.15.73:0/2664677200 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9580bc070 con 0x7ff96015cbd0 2024-04-15T15:33:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff95cc00640 1 -- 172.21.15.73:0/2664677200 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958006e20 con 0x7ff96015cbd0 2024-04-15T15:33:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff967600640 1 -- 172.21.15.73:0/2664677200 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96015b460 con 0x7ff96015cbd0 2024-04-15T15:33:36.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff967600640 1 -- 172.21.15.73:0/2664677200 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96015ba20 con 0x7ff96015cbd0 2024-04-15T15:33:36.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff967600640 1 -- 172.21.15.73:0/2664677200 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff960068ab0 con 0x7ff96015cbd0 2024-04-15T15:33:36.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff95cc00640 1 -- 172.21.15.73:0/2664677200 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7ff9580b6630 con 0x7ff96015cbd0 2024-04-15T15:33:36.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff95cc00640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff940068440 0x7ff94006a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff95cc00640 1 -- 172.21.15.73:0/2664677200 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7ff958120790 con 0x7ff96015cbd0 2024-04-15T15:33:36.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff964c00640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff940068440 0x7ff94006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.576+0000 7ff964c00640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff940068440 0x7ff94006a900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff950005c10 tx=0x7ff950009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.580+0000 7ff95cc00640 1 -- 172.21.15.73:0/2664677200 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff958016090 con 0x7ff96015cbd0 2024-04-15T15:33:36.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.740+0000 7ff967600640 1 -- 172.21.15.73:0/2664677200 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ff960072ae0 con 0x7ff940068440 2024-04-15T15:33:36.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.740+0000 7ff95cc00640 1 -- 172.21.15.73:0/2664677200 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff960072ae0 con 0x7ff940068440 2024-04-15T15:33:36.743 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-04-15T15:33:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 -- 172.21.15.73:0/2664677200 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff940068440 msgr2=0x7ff94006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff940068440 0x7ff94006a900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff950005c10 tx=0x7ff950009040 comp rx=0 tx=0).stop 2024-04-15T15:33:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 -- 172.21.15.73:0/2664677200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 msgr2=0x7ff9601438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 0x7ff9601438d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff9580097c0 tx=0x7ff958019240 comp rx=0 tx=0).stop 2024-04-15T15:33:36.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 -- 172.21.15.73:0/2664677200 shutdown_connections 2024-04-15T15:33:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff96015cbd0 0x7ff9601438d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff960146110 0x7ff96015c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7ff940068440 0x7ff94006a900 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 --2- 172.21.15.73:0/2664677200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9600b20b0 0x7ff96013cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 -- 172.21.15.73:0/2664677200 >> 172.21.15.73:0/2664677200 conn(0x7ff960067dd0 msgr2=0x7ff960071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 -- 172.21.15.73:0/2664677200 shutdown_connections 2024-04-15T15:33:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.744+0000 7ff967600640 1 -- 172.21.15.73:0/2664677200 wait complete. 2024-04-15T15:33:36.765 INFO:tasks.ceph:Scrubbing osd.3 2024-04-15T15:33:36.765 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:33:36.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab7cc00640 1 Processor -- start 2024-04-15T15:33:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab7cc00640 1 -- start start 2024-04-15T15:33:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab7cc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 0x7fab780c6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab7cc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fab780cd0d0 0x7fab780b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab7cc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7815b810 con 0x7fab780cc4e0 2024-04-15T15:33:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab7cc00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fab780c61a0 con 0x7fab780cd0d0 2024-04-15T15:33:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab7cc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fab780ca810 con 0x7fab7815b430 2024-04-15T15:33:36.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab77e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fab780cd0d0 0x7fab780b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab77400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 0x7fab780c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab77400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 0x7fab780c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.73:50668/0 (socket says 172.21.15.73:50668) 2024-04-15T15:33:36.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab77400640 1 -- 172.21.15.73:0/663928100 learned_addr learned my addr 172.21.15.73:0/663928100 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:36.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab77e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fab780cd0d0 0x7fab780b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:47456/0 (socket says 172.21.15.73:47456) 2024-04-15T15:33:36.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab77400640 1 -- 172.21.15.73:0/663928100 >> v2:172.21.15.118:3300/0 conn(0x7fab780cd0d0 msgr2=0x7fab780b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:36.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab77400640 1 --2- 172.21.15.73:0/663928100 >> v2:172.21.15.118:3300/0 conn(0x7fab780cd0d0 0x7fab780b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab77400640 1 -- 172.21.15.73:0/663928100 >> v1:172.21.15.118:6789/0 conn(0x7fab780cc4e0 legacy=0x7fab780cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab77400640 1 -- 172.21.15.73:0/663928100 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab780c5590 con 0x7fab7815b430 2024-04-15T15:33:36.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.904+0000 7fab77e00640 1 --2- 172.21.15.73:0/663928100 >> v2:172.21.15.118:3300/0 conn(0x7fab780cd0d0 0x7fab780b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T15:33:36.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab77400640 1 --2- 172.21.15.73:0/663928100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 0x7fab780c6960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab6800d150 tx=0x7fab6801ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc2b1b067377c4e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab76a00640 1 -- 172.21.15.73:0/663928100 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab680a7cd0 con 0x7fab7815b430 2024-04-15T15:33:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab76a00640 1 -- 172.21.15.73:0/663928100 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6800b0d0 con 0x7fab7815b430 2024-04-15T15:33:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab76a00640 1 -- 172.21.15.73:0/663928100 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68009600 con 0x7fab7815b430 2024-04-15T15:33:36.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab7cc00640 1 -- 172.21.15.73:0/663928100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 msgr2=0x7fab780c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab7cc00640 1 --2- 172.21.15.73:0/663928100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 0x7fab780c6960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab6800d150 tx=0x7fab6801ec00 comp rx=0 tx=0).stop 2024-04-15T15:33:36.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab7cc00640 1 -- 172.21.15.73:0/663928100 shutdown_connections 2024-04-15T15:33:36.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab7cc00640 1 --2- 172.21.15.73:0/663928100 >> v2:172.21.15.118:3300/0 conn(0x7fab780cd0d0 0x7fab780b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab7cc00640 1 --2- 172.21.15.73:0/663928100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 0x7fab780c6960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab7cc00640 1 -- 172.21.15.73:0/663928100 >> 172.21.15.73:0/663928100 conn(0x7fab780b1fe0 msgr2=0x7fab780b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab7cc00640 1 -- 172.21.15.73:0/663928100 shutdown_connections 2024-04-15T15:33:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.908+0000 7fab7cc00640 1 -- 172.21.15.73:0/663928100 wait complete. 2024-04-15T15:33:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab7cc00640 1 Processor -- start 2024-04-15T15:33:36.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab7cc00640 1 -- start start 2024-04-15T15:33:36.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab7cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab780cc4e0 0x7fab7814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab7cc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab780cd0d0 0x7fab780ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab7cc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 0x7fab780aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab7cc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fab780c7020 con 0x7fab780cc4e0 2024-04-15T15:33:36.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab7cc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fab780c6ea0 con 0x7fab780cd0d0 2024-04-15T15:33:36.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab7cc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fab780b3e60 con 0x7fab7815b430 2024-04-15T15:33:36.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab77400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab780cc4e0 0x7fab7814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab77400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab780cc4e0 0x7fab7814e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38404/0 (socket says 172.21.15.73:38404) 2024-04-15T15:33:36.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab77400640 1 -- 172.21.15.73:0/341945794 learned_addr learned my addr 172.21.15.73:0/341945794 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:36.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab6ea00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab780cd0d0 0x7fab780ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab77e00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 0x7fab780aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab77400640 1 -- 172.21.15.73:0/341945794 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 msgr2=0x7fab780aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab77400640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab7815b430 0x7fab780aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab77400640 1 -- 172.21.15.73:0/341945794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab780cd0d0 msgr2=0x7fab780ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab77400640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab780cd0d0 0x7fab780ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab77400640 1 -- 172.21.15.73:0/341945794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab78073ab0 con 0x7fab780cc4e0 2024-04-15T15:33:36.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab77400640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab780cc4e0 0x7fab7814e240 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fab680b1040 tx=0x7fab6801b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab6fe00640 1 -- 172.21.15.73:0/341945794 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68009600 con 0x7fab780cc4e0 2024-04-15T15:33:36.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab6fe00640 1 -- 172.21.15.73:0/341945794 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab680097e0 con 0x7fab780cc4e0 2024-04-15T15:33:36.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab6fe00640 1 -- 172.21.15.73:0/341945794 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68009bd0 con 0x7fab780cc4e0 2024-04-15T15:33:36.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab78073210 con 0x7fab780cc4e0 2024-04-15T15:33:36.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.912+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab780737d0 con 0x7fab780cc4e0 2024-04-15T15:33:36.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab78068ab0 con 0x7fab780cc4e0 2024-04-15T15:33:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab6fe00640 1 -- 172.21.15.73:0/341945794 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fab680c0020 con 0x7fab780cc4e0 2024-04-15T15:33:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab6fe00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fab54068410 0x7fab5406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab6fe00640 1 -- 172.21.15.73:0/341945794 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fab681215c0 con 0x7fab780cc4e0 2024-04-15T15:33:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab6ea00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fab54068410 0x7fab5406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab6fe00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] conn(0x7fab5406e950 0x7fab54070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab6fe00640 1 -- 172.21.15.73:0/341945794 --> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab6800ce60 con 0x7fab5406e950 2024-04-15T15:33:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab6fe00640 1 -- 172.21.15.73:0/341945794 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fab68128050 con 0x7fab780cc4e0 2024-04-15T15:33:36.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab77e00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] conn(0x7fab5406e950 0x7fab54070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:36.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab6ea00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fab54068410 0x7fab5406a8d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fab780b1d70 tx=0x7fab60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab77e00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] conn(0x7fab5406e950 0x7fab54070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:36.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.916+0000 7fab6fe00640 1 -- 172.21.15.73:0/341945794 <== osd.3 v2:172.21.15.73:6808/4025456322 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab6800ce60 con 0x7fab5406e950 2024-04-15T15:33:36.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 --> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fab780cb330 con 0x7fab5406e950 2024-04-15T15:33:36.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab6fe00640 1 -- 172.21.15.73:0/341945794 <== osd.3 v2:172.21.15.73:6808/4025456322 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fab780cb330 con 0x7fab5406e950 2024-04-15T15:33:36.934 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:36.934 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:33:36.934 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:36.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] conn(0x7fab5406e950 msgr2=0x7fab54070d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:6808/4025456322,v1:172.21.15.73:6809/4025456322] conn(0x7fab5406e950 0x7fab54070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fab54068410 msgr2=0x7fab5406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fab54068410 0x7fab5406a8d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fab780b1d70 tx=0x7fab60009040 comp rx=0 tx=0).stop 2024-04-15T15:33:36.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab780cc4e0 msgr2=0x7fab7814e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:36.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 --2- 172.21.15.73:0/341945794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab780cc4e0 0x7fab7814e240 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fab680b1040 tx=0x7fab6801b9a0 comp rx=0 tx=0).stop 2024-04-15T15:33:36.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab77e00640 1 -- 172.21.15.73:0/341945794 reap_dead start 2024-04-15T15:33:36.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 shutdown_connections 2024-04-15T15:33:36.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 >> 172.21.15.73:0/341945794 conn(0x7fab780b1fe0 msgr2=0x7fab78074e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:36.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 shutdown_connections 2024-04-15T15:33:36.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:36.932+0000 7fab7cc00640 1 -- 172.21.15.73:0/341945794 wait complete. 2024-04-15T15:33:36.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-15T15:33:37.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.084+0000 7f8f22800640 1 Processor -- start 2024-04-15T15:33:37.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.084+0000 7f8f22800640 1 -- start start 2024-04-15T15:33:37.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f22800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f1c0b27c0 0x7f8f1c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f22800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f1c0b3e30 0x7f8f1c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f22800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1c070160 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f22800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1c15b9b0 con 0x7f8f1c0b3e30 2024-04-15T15:33:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f22800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1c15f1f0 con 0x7f8f1c0b27c0 2024-04-15T15:33:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f1be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f1c0b3e30 0x7f8f1c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f1be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f1c0b3e30 0x7f8f1c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38408/0 (socket says 172.21.15.73:38408) 2024-04-15T15:33:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f1be00640 1 -- 172.21.15.73:0/126778403 learned_addr learned my addr 172.21.15.73:0/126778403 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f1b400640 1 --1- 172.21.15.73:0/126778403 >> v1:172.21.15.118:6789/0 conn(0x7f8f1c15b5d0 0x7f8f1c0b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:58908/0 (socket says 172.21.15.73:58908) 2024-04-15T15:33:37.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f12a00640 1 --2- 172.21.15.73:0/126778403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f1c0b27c0 0x7f8f1c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f1be00640 1 -- 172.21.15.73:0/126778403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f1c0b27c0 msgr2=0x7f8f1c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:37.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f1be00640 1 --2- 172.21.15.73:0/126778403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f1c0b27c0 0x7f8f1c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f1be00640 1 -- 172.21.15.73:0/126778403 >> v1:172.21.15.118:6789/0 conn(0x7f8f1c15b5d0 legacy=0x7f8f1c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.088+0000 7f8f1be00640 1 -- 172.21.15.73:0/126778403 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c06fe80 con 0x7f8f1c0b3e30 2024-04-15T15:33:37.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f1be00640 1 --2- 172.21.15.73:0/126778403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c0b3e30 0x7f8f1c0b4740 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009e50 tx=0x7f8f1401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55e179cf34ae133 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f1aa00640 1 -- 172.21.15.73:0/126778403 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140090d0 con 0x7f8f1c0b3e30 2024-04-15T15:33:37.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f1aa00640 1 -- 172.21.15.73:0/126778403 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f140a57a0 con 0x7f8f1c0b3e30 2024-04-15T15:33:37.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f1aa00640 1 -- 172.21.15.73:0/126778403 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14009270 con 0x7f8f1c0b3e30 2024-04-15T15:33:37.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f22800640 1 -- 172.21.15.73:0/126778403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c0b3e30 msgr2=0x7f8f1c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f22800640 1 --2- 172.21.15.73:0/126778403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c0b3e30 0x7f8f1c0b4740 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009e50 tx=0x7f8f1401c8e0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f22800640 1 -- 172.21.15.73:0/126778403 shutdown_connections 2024-04-15T15:33:37.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f22800640 1 --2- 172.21.15.73:0/126778403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c0b3e30 0x7f8f1c0b4740 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f22800640 1 --2- 172.21.15.73:0/126778403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f1c0b27c0 0x7f8f1c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f22800640 1 -- 172.21.15.73:0/126778403 >> 172.21.15.73:0/126778403 conn(0x7f8f1c067dd0 msgr2=0x7f8f1c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:37.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f22800640 1 -- 172.21.15.73:0/126778403 shutdown_connections 2024-04-15T15:33:37.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f22800640 1 -- 172.21.15.73:0/126778403 wait complete. 2024-04-15T15:33:37.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f22800640 1 Processor -- start 2024-04-15T15:33:37.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.092+0000 7f8f22800640 1 -- start start 2024-04-15T15:33:37.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f22800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f1c0b27c0 0x7f8f1c155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f22800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f1c0b3e30 0x7f8f1c1fb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f22800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15b5d0 0x7f8f1c156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f22800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c06faa0 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f22800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c0cfd00 con 0x7f8f1c0b27c0 2024-04-15T15:33:37.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f22800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1c06fc20 con 0x7f8f1c0b3e30 2024-04-15T15:33:37.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f1be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15b5d0 0x7f8f1c156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f1be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15b5d0 0x7f8f1c156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38414/0 (socket says 172.21.15.73:38414) 2024-04-15T15:33:37.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f1be00640 1 -- 172.21.15.73:0/2771502562 learned_addr learned my addr 172.21.15.73:0/2771502562 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:37.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f1b400640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f1c0b27c0 0x7f8f1c155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f12a00640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f1c0b3e30 0x7f8f1c1fb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f1be00640 1 -- 172.21.15.73:0/2771502562 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f1c0b3e30 msgr2=0x7f8f1c1fb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f1be00640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f1c0b3e30 0x7f8f1c1fb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f1be00640 1 -- 172.21.15.73:0/2771502562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f1c0b27c0 msgr2=0x7f8f1c155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f1be00640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f1c0b27c0 0x7f8f1c155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f1be00640 1 -- 172.21.15.73:0/2771502562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c166280 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f1be00640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15b5d0 0x7f8f1c156860 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8f140af040 tx=0x7f8f14019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f13e00640 1 -- 172.21.15.73:0/2771502562 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140bc020 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f13e00640 1 -- 172.21.15.73:0/2771502562 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f140b8670 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f22800640 1 -- 172.21.15.73:0/2771502562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1c159e90 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f13e00640 1 -- 172.21.15.73:0/2771502562 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140b8a60 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f22800640 1 -- 172.21.15.73:0/2771502562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1c15a450 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f22800640 1 -- 172.21.15.73:0/2771502562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1c068ab0 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.096+0000 7f8f13e00640 1 -- 172.21.15.73:0/2771502562 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f8f140bf020 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.100+0000 7f8f13e00640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ef8068410 0x7f8ef806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.100+0000 7f8f13e00640 1 -- 172.21.15.73:0/2771502562 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f8f141218f0 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.100+0000 7f8f1b400640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ef8068410 0x7f8ef806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.100+0000 7f8f1b400640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ef8068410 0x7f8ef806a8d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c000f70 tx=0x7f8f0c007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.104+0000 7f8f13e00640 1 -- 172.21.15.73:0/2771502562 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f140c6030 con 0x7f8f1c15b5d0 2024-04-15T15:33:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 -- 172.21.15.73:0/2771502562 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f8f1c1563f0 con 0x7f8ef8068410 2024-04-15T15:33:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f13e00640 1 -- 172.21.15.73:0/2771502562 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8f0c004a90 con 0x7f8ef8068410 2024-04-15T15:33:37.261 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-04-15T15:33:37.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 -- 172.21.15.73:0/2771502562 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ef8068410 msgr2=0x7f8ef806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ef8068410 0x7f8ef806a8d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c000f70 tx=0x7f8f0c007e90 comp rx=0 tx=0).stop 2024-04-15T15:33:37.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 -- 172.21.15.73:0/2771502562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15b5d0 msgr2=0x7f8f1c156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15b5d0 0x7f8f1c156860 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8f140af040 tx=0x7f8f14019680 comp rx=0 tx=0).stop 2024-04-15T15:33:37.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 -- 172.21.15.73:0/2771502562 shutdown_connections 2024-04-15T15:33:37.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15b5d0 0x7f8f1c156860 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ef8068410 0x7f8ef806a8d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f1c0b3e30 0x7f8f1c1fb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 --2- 172.21.15.73:0/2771502562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f1c0b27c0 0x7f8f1c155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 -- 172.21.15.73:0/2771502562 >> 172.21.15.73:0/2771502562 conn(0x7f8f1c067dd0 msgr2=0x7f8f1c165b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:37.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 -- 172.21.15.73:0/2771502562 shutdown_connections 2024-04-15T15:33:37.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.260+0000 7f8f22800640 1 -- 172.21.15.73:0/2771502562 wait complete. 2024-04-15T15:33:37.283 INFO:tasks.ceph:Scrubbing osd.4 2024-04-15T15:33:37.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:33:37.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef2e00640 1 Processor -- start 2024-04-15T15:33:37.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef2e00640 1 -- start start 2024-04-15T15:33:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef2e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faeec0cff20 0x7faeec0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef2e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faeec143070 0x7faeec0ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef2e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeec06c010 con 0x7faeec142c90 2024-04-15T15:33:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef2e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7faeec0b4ae0 con 0x7faeec143070 2024-04-15T15:33:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef2e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7faeec06c5d0 con 0x7faeec0cff20 2024-04-15T15:33:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef0e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faeec143070 0x7faeec0ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef0e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faeec143070 0x7faeec0ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53950/0 (socket says 172.21.15.73:53950) 2024-04-15T15:33:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef0e00640 1 -- 172.21.15.73:0/3748888891 learned_addr learned my addr 172.21.15.73:0/3748888891 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faeeb400640 1 --2- 172.21.15.73:0/3748888891 >> v2:172.21.15.118:3300/0 conn(0x7faeec0cff20 0x7faeec0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef0e00640 1 -- 172.21.15.73:0/3748888891 >> v2:172.21.15.118:3300/0 conn(0x7faeec0cff20 msgr2=0x7faeec0b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef0e00640 1 --2- 172.21.15.73:0/3748888891 >> v2:172.21.15.118:3300/0 conn(0x7faeec0cff20 0x7faeec0b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef0e00640 1 -- 172.21.15.73:0/3748888891 >> v1:172.21.15.118:6789/0 conn(0x7faeec142c90 legacy=0x7faeec0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faef0e00640 1 -- 172.21.15.73:0/3748888891 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec06c2f0 con 0x7faeec143070 2024-04-15T15:33:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.424+0000 7faeeb400640 1 --2- 172.21.15.73:0/3748888891 >> v2:172.21.15.118:3300/0 conn(0x7faeec0cff20 0x7faeec0b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:37.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faef0e00640 1 --2- 172.21.15.73:0/3748888891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faeec143070 0x7faeec0ccca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7faeec070280 tx=0x7faee401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8436b2ba356f6dc server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faeeaa00640 1 -- 172.21.15.73:0/3748888891 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee40b1070 con 0x7faeec143070 2024-04-15T15:33:37.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faeeaa00640 1 -- 172.21.15.73:0/3748888891 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee40ac620 con 0x7faeec143070 2024-04-15T15:33:37.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faeeaa00640 1 -- 172.21.15.73:0/3748888891 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee40ac9f0 con 0x7faeec143070 2024-04-15T15:33:37.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faef2e00640 1 -- 172.21.15.73:0/3748888891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faeec143070 msgr2=0x7faeec0ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faef2e00640 1 --2- 172.21.15.73:0/3748888891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faeec143070 0x7faeec0ccca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7faeec070280 tx=0x7faee401c4b0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faef2e00640 1 -- 172.21.15.73:0/3748888891 shutdown_connections 2024-04-15T15:33:37.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faef2e00640 1 --2- 172.21.15.73:0/3748888891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faeec143070 0x7faeec0ccca0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faef2e00640 1 --2- 172.21.15.73:0/3748888891 >> v2:172.21.15.118:3300/0 conn(0x7faeec0cff20 0x7faeec0b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faef2e00640 1 -- 172.21.15.73:0/3748888891 >> 172.21.15.73:0/3748888891 conn(0x7faeec067e30 msgr2=0x7faeec0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:37.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faef2e00640 1 -- 172.21.15.73:0/3748888891 shutdown_connections 2024-04-15T15:33:37.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.428+0000 7faef2e00640 1 -- 172.21.15.73:0/3748888891 wait complete. 2024-04-15T15:33:37.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 Processor -- start 2024-04-15T15:33:37.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 -- start start 2024-04-15T15:33:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faeec0cff20 0x7faeec138110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec142c90 0x7faeec1fb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faeec143070 0x7faeec13f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faeec169620 con 0x7faeec143070 2024-04-15T15:33:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faeec146360 con 0x7faeec142c90 2024-04-15T15:33:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7faeec1697a0 con 0x7faeec0cff20 2024-04-15T15:33:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef0e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faeec143070 0x7faeec13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef0e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faeec143070 0x7faeec13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53952/0 (socket says 172.21.15.73:53952) 2024-04-15T15:33:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef0e00640 1 -- 172.21.15.73:0/1769105348 learned_addr learned my addr 172.21.15.73:0/1769105348 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faeebe00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faeec0cff20 0x7faeec138110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faeeb400640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec142c90 0x7faeec1fb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef0e00640 1 -- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faeec0cff20 msgr2=0x7faeec138110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef0e00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faeec0cff20 0x7faeec138110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef0e00640 1 -- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec142c90 msgr2=0x7faeec1fb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef0e00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec142c90 0x7faeec1fb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef0e00640 1 -- 172.21.15.73:0/1769105348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec1fbdd0 con 0x7faeec143070 2024-04-15T15:33:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faeebe00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faeec0cff20 0x7faeec138110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faeeb400640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec142c90 0x7faeec1fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef0e00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faeec143070 0x7faeec13f420 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7faee40af040 tx=0x7faee401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faee3e00640 1 -- 172.21.15.73:0/1769105348 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee40b1040 con 0x7faeec143070 2024-04-15T15:33:37.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faee3e00640 1 -- 172.21.15.73:0/1769105348 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee40bd070 con 0x7faeec143070 2024-04-15T15:33:37.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeec1fc0b0 con 0x7faeec143070 2024-04-15T15:33:37.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faee3e00640 1 -- 172.21.15.73:0/1769105348 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee40b7880 con 0x7faeec143070 2024-04-15T15:33:37.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeec143970 con 0x7faeec143070 2024-04-15T15:33:37.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.432+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faeec143480 con 0x7faeec143070 2024-04-15T15:33:37.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faee3e00640 1 -- 172.21.15.73:0/1769105348 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7faee40ac4e0 con 0x7faeec143070 2024-04-15T15:33:37.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faee3e00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faec8068410 0x7faec806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faee3e00640 1 -- 172.21.15.73:0/1769105348 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7faee4121950 con 0x7faeec143070 2024-04-15T15:33:37.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faee3e00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] conn(0x7faec806e950 0x7faec8070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faee3e00640 1 -- 172.21.15.73:0/1769105348 --> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faec8071460 con 0x7faec806e950 2024-04-15T15:33:37.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faee3e00640 1 -- 172.21.15.73:0/1769105348 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7faee4121d00 con 0x7faeec143070 2024-04-15T15:33:37.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faeebe00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faec8068410 0x7faec806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faeeb400640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] conn(0x7faec806e950 0x7faec8070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faeebe00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faec8068410 0x7faec806a8d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7faedc007fd0 tx=0x7faedc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faeeb400640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] conn(0x7faec806e950 0x7faec8070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.436+0000 7faee3e00640 1 -- 172.21.15.73:0/1769105348 <== osd.4 v2:172.21.15.118:6809/2483912134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faec8071460 con 0x7faec806e950 2024-04-15T15:33:37.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 --> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faeec068b20 con 0x7faec806e950 2024-04-15T15:33:37.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faee3e00640 1 -- 172.21.15.73:0/1769105348 <== osd.4 v2:172.21.15.118:6809/2483912134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faeec068b20 con 0x7faec806e950 2024-04-15T15:33:37.453 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:37.453 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:33:37.453 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:37.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] conn(0x7faec806e950 msgr2=0x7faec8070d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.118:6809/2483912134,v1:172.21.15.118:6811/2483912134] conn(0x7faec806e950 0x7faec8070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faec8068410 msgr2=0x7faec806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7faec8068410 0x7faec806a8d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7faedc007fd0 tx=0x7faedc009040 comp rx=0 tx=0).stop 2024-04-15T15:33:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faeec143070 msgr2=0x7faeec13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 --2- 172.21.15.73:0/1769105348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faeec143070 0x7faeec13f420 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7faee40af040 tx=0x7faee401acf0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef0e00640 1 -- 172.21.15.73:0/1769105348 reap_dead start 2024-04-15T15:33:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 shutdown_connections 2024-04-15T15:33:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 >> 172.21.15.73:0/1769105348 conn(0x7faeec067e30 msgr2=0x7faeec0cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 shutdown_connections 2024-04-15T15:33:37.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.452+0000 7faef2e00640 1 -- 172.21.15.73:0/1769105348 wait complete. 2024-04-15T15:33:37.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-15T15:33:37.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.604+0000 7f946fa00640 1 Processor -- start 2024-04-15T15:33:37.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.604+0000 7f946fa00640 1 -- start start 2024-04-15T15:33:37.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946fa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f94680b27c0 0x7f946815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946fa00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94680b3e30 0x7f94680b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946fa00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9468070160 con 0x7f946815b5d0 2024-04-15T15:33:37.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946fa00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f946815b9b0 con 0x7f94680b3e30 2024-04-15T15:33:37.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946fa00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f946815f1f0 con 0x7f94680b27c0 2024-04-15T15:33:37.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946da00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94680b3e30 0x7f94680b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946d000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f946815b5d0 0x7f94680b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34176/0 (socket says 172.21.15.73:34176) 2024-04-15T15:33:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946d000640 1 -- 172.21.15.73:0/3449271664 learned_addr learned my addr 172.21.15.73:0/3449271664 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f9467e00640 1 --2- 172.21.15.73:0/3449271664 >> v2:172.21.15.118:3300/0 conn(0x7f94680b27c0 0x7f946815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946da00640 1 -- 172.21.15.73:0/3449271664 >> v2:172.21.15.118:3300/0 conn(0x7f94680b27c0 msgr2=0x7f946815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:37.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946da00640 1 --2- 172.21.15.73:0/3449271664 >> v2:172.21.15.118:3300/0 conn(0x7f94680b27c0 0x7f946815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946da00640 1 -- 172.21.15.73:0/3449271664 >> v1:172.21.15.73:6789/0 conn(0x7f946815b5d0 legacy=0x7f94680b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f946da00640 1 -- 172.21.15.73:0/3449271664 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946806fe80 con 0x7f94680b3e30 2024-04-15T15:33:37.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.608+0000 7f9467400640 1 -- 172.21.15.73:0/3449271664 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185508164 0 0) 0x7f9468070160 con 0x7f946815b5d0 2024-04-15T15:33:37.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946da00640 1 --2- 172.21.15.73:0/3449271664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b3e30 0x7f94680b4740 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f94680b2c50 tx=0x7f946001c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bbfc03244db105 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f9467400640 1 -- 172.21.15.73:0/3449271664 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600b2070 con 0x7f94680b3e30 2024-04-15T15:33:37.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f9467400640 1 -- 172.21.15.73:0/3449271664 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94600a56a0 con 0x7f94680b3e30 2024-04-15T15:33:37.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f9467400640 1 -- 172.21.15.73:0/3449271664 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600a5a70 con 0x7f94680b3e30 2024-04-15T15:33:37.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946fa00640 1 -- 172.21.15.73:0/3449271664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b3e30 msgr2=0x7f94680b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946fa00640 1 --2- 172.21.15.73:0/3449271664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b3e30 0x7f94680b4740 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f94680b2c50 tx=0x7f946001c7e0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946fa00640 1 -- 172.21.15.73:0/3449271664 shutdown_connections 2024-04-15T15:33:37.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946fa00640 1 --2- 172.21.15.73:0/3449271664 >> v2:172.21.15.118:3300/0 conn(0x7f94680b27c0 0x7f946815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946fa00640 1 --2- 172.21.15.73:0/3449271664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b3e30 0x7f94680b4740 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946fa00640 1 -- 172.21.15.73:0/3449271664 >> 172.21.15.73:0/3449271664 conn(0x7f9468067dd0 msgr2=0x7f94680d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:37.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946fa00640 1 -- 172.21.15.73:0/3449271664 shutdown_connections 2024-04-15T15:33:37.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946fa00640 1 -- 172.21.15.73:0/3449271664 wait complete. 2024-04-15T15:33:37.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946fa00640 1 Processor -- start 2024-04-15T15:33:37.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.612+0000 7f946fa00640 1 -- start start 2024-04-15T15:33:37.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946fa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b27c0 0x7f946814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946fa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94680b3e30 0x7f946814f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946fa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f946815b5d0 0x7f94680b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946fa00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f946806faa0 con 0x7f94680b27c0 2024-04-15T15:33:37.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946fa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f94680b4240 con 0x7f946815b5d0 2024-04-15T15:33:37.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946fa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f946806fc20 con 0x7f94680b3e30 2024-04-15T15:33:37.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946d000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b27c0 0x7f946814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946d000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b27c0 0x7f946814fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53974/0 (socket says 172.21.15.73:53974) 2024-04-15T15:33:37.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946d000640 1 -- 172.21.15.73:0/1558388381 learned_addr learned my addr 172.21.15.73:0/1558388381 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:37.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946da00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f946815b5d0 0x7f94680b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946d000640 1 -- 172.21.15.73:0/1558388381 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94680b3e30 msgr2=0x7f946814f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946d000640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94680b3e30 0x7f946814f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946d000640 1 -- 172.21.15.73:0/1558388381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f946815b5d0 msgr2=0x7f94680b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946d000640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f946815b5d0 0x7f94680b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946d000640 1 -- 172.21.15.73:0/1558388381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946815aba0 con 0x7f94680b27c0 2024-04-15T15:33:37.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946da00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f946815b5d0 0x7f94680b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:37.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946d000640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b27c0 0x7f946814fbc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f94500011f0 tx=0x7f945000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f9464c00640 1 -- 172.21.15.73:0/1558388381 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450018070 con 0x7f94680b27c0 2024-04-15T15:33:37.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f9464c00640 1 -- 172.21.15.73:0/1558388381 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94500074e0 con 0x7f94680b27c0 2024-04-15T15:33:37.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946fa00640 1 -- 172.21.15.73:0/1558388381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946815a5e0 con 0x7f94680b27c0 2024-04-15T15:33:37.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f9464c00640 1 -- 172.21.15.73:0/1558388381 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450004a30 con 0x7f94680b27c0 2024-04-15T15:33:37.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946fa00640 1 -- 172.21.15.73:0/1558388381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94680b0100 con 0x7f94680b27c0 2024-04-15T15:33:37.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f946fa00640 1 -- 172.21.15.73:0/1558388381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9468068ab0 con 0x7f94680b27c0 2024-04-15T15:33:37.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.616+0000 7f9464c00640 1 -- 172.21.15.73:0/1558388381 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f945001b070 con 0x7f94680b27c0 2024-04-15T15:33:37.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.620+0000 7f9464c00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9444068440 0x7f944406a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.620+0000 7f9464c00640 1 -- 172.21.15.73:0/1558388381 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f9450085cd0 con 0x7f94680b27c0 2024-04-15T15:33:37.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.620+0000 7f9467e00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9444068440 0x7f944406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.620+0000 7f9467e00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9444068440 0x7f944406a900 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9458006aa0 tx=0x7f9458006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.624+0000 7f9464c00640 1 -- 172.21.15.73:0/1558388381 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f94500562c0 con 0x7f94680b27c0 2024-04-15T15:33:37.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 -- 172.21.15.73:0/1558388381 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f94680b02d0 con 0x7f9444068440 2024-04-15T15:33:37.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f9464c00640 1 -- 172.21.15.73:0/1558388381 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f94680b02d0 con 0x7f9444068440 2024-04-15T15:33:37.785 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2024-04-15T15:33:37.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 -- 172.21.15.73:0/1558388381 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9444068440 msgr2=0x7f944406a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9444068440 0x7f944406a900 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9458006aa0 tx=0x7f9458006a30 comp rx=0 tx=0).stop 2024-04-15T15:33:37.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 -- 172.21.15.73:0/1558388381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b27c0 msgr2=0x7f946814fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b27c0 0x7f946814fbc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f94500011f0 tx=0x7f945000c9b0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 -- 172.21.15.73:0/1558388381 shutdown_connections 2024-04-15T15:33:37.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f946815b5d0 0x7f94680b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f9444068440 0x7f944406a900 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94680b3e30 0x7f946814f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 --2- 172.21.15.73:0/1558388381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680b27c0 0x7f946814fbc0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 -- 172.21.15.73:0/1558388381 >> 172.21.15.73:0/1558388381 conn(0x7f9468067dd0 msgr2=0x7f9468157770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:37.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 -- 172.21.15.73:0/1558388381 shutdown_connections 2024-04-15T15:33:37.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.784+0000 7f946fa00640 1 -- 172.21.15.73:0/1558388381 wait complete. 2024-04-15T15:33:37.806 INFO:tasks.ceph:Scrubbing osd.5 2024-04-15T15:33:37.806 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:33:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.944+0000 7f37e3800640 1 Processor -- start 2024-04-15T15:33:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.944+0000 7f37e3800640 1 -- start start 2024-04-15T15:33:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.944+0000 7f37e3800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37dc15c890 0x7f37dc06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.944+0000 7f37e3800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37dc15be20 con 0x7f37dc159340 2024-04-15T15:33:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.944+0000 7f37e3800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37dc06c3b0 con 0x7f37dc06bf90 2024-04-15T15:33:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.944+0000 7f37e3800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc15ccf0 con 0x7f37dc15c890 2024-04-15T15:33:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.944+0000 7f37e0e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f37dc159340 0x7f37dc0ceb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34180/0 (socket says 172.21.15.73:34180) 2024-04-15T15:33:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.944+0000 7f37e0e00640 1 -- 172.21.15.73:0/1116650276 learned_addr learned my addr 172.21.15.73:0/1116650276 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:37.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.944+0000 7f37d3e00640 1 --2- 172.21.15.73:0/1116650276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37dc15c890 0x7f37dc06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37dbe00640 1 -- 172.21.15.73:0/1116650276 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485685249 0 0) 0x7f37dc15be20 con 0x7f37dc159340 2024-04-15T15:33:37.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37dbe00640 1 -- 172.21.15.73:0/1116650276 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c0005740 con 0x7f37dc159340 2024-04-15T15:33:37.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37dbe00640 1 -- 172.21.15.73:0/1116650276 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483810015 0 0) 0x7f37dc06c3b0 con 0x7f37dc06bf90 2024-04-15T15:33:37.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37dbe00640 1 -- 172.21.15.73:0/1116650276 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37dc15be20 con 0x7f37dc06bf90 2024-04-15T15:33:37.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37d3e00640 1 -- 172.21.15.73:0/1116650276 >> v1:172.21.15.118:6789/0 conn(0x7f37dc06bf90 legacy=0x7f37dc0b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37d3e00640 1 -- 172.21.15.73:0/1116650276 >> v1:172.21.15.73:6789/0 conn(0x7f37dc159340 legacy=0x7f37dc0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37dbe00640 1 -- 172.21.15.73:0/1116650276 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 679841610 0 0) 0x7f37c0005740 con 0x7f37dc159340 2024-04-15T15:33:37.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37d3e00640 1 -- 172.21.15.73:0/1116650276 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc159720 con 0x7f37dc15c890 2024-04-15T15:33:37.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37d3e00640 1 --2- 172.21.15.73:0/1116650276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37dc15c890 0x7f37dc06ba50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f37c40097f0 tx=0x7f37c401c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb018ec25a849f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37dbe00640 1 -- 172.21.15.73:0/1116650276 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c40b0070 con 0x7f37dc15c890 2024-04-15T15:33:37.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37dbe00640 1 -- 172.21.15.73:0/1116650276 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c40ab400 con 0x7f37dc15c890 2024-04-15T15:33:37.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.948+0000 7f37dbe00640 1 -- 172.21.15.73:0/1116650276 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc001a00 con 0x7f37dc15c890 2024-04-15T15:33:37.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 -- 172.21.15.73:0/1116650276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37dc15c890 msgr2=0x7f37dc06ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 --2- 172.21.15.73:0/1116650276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37dc15c890 0x7f37dc06ba50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f37c40097f0 tx=0x7f37c401c340 comp rx=0 tx=0).stop 2024-04-15T15:33:37.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 -- 172.21.15.73:0/1116650276 shutdown_connections 2024-04-15T15:33:37.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 --2- 172.21.15.73:0/1116650276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37dc15c890 0x7f37dc06ba50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 -- 172.21.15.73:0/1116650276 >> 172.21.15.73:0/1116650276 conn(0x7f37dc067e30 msgr2=0x7f37dc0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:37.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 -- 172.21.15.73:0/1116650276 shutdown_connections 2024-04-15T15:33:37.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 -- 172.21.15.73:0/1116650276 wait complete. 2024-04-15T15:33:37.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 Processor -- start 2024-04-15T15:33:37.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 -- start start 2024-04-15T15:33:37.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37dc06bf90 0x7f37dc144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37dc159340 0x7f37dc14ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37dc15c890 0x7f37dc14c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc0cf990 con 0x7f37dc159340 2024-04-15T15:33:37.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc15c3f0 con 0x7f37dc15c890 2024-04-15T15:33:37.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e3800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc0cf250 con 0x7f37dc06bf90 2024-04-15T15:33:37.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37d3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37dc159340 0x7f37dc14ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37d3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37dc159340 0x7f37dc14ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53982/0 (socket says 172.21.15.73:53982) 2024-04-15T15:33:37.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37d3e00640 1 -- 172.21.15.73:0/43163476 learned_addr learned my addr 172.21.15.73:0/43163476 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:37.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e0e00640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37dc06bf90 0x7f37dc144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e1800640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37dc15c890 0x7f37dc14c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37d3e00640 1 -- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37dc06bf90 msgr2=0x7f37dc144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37d3e00640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37dc06bf90 0x7f37dc144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37d3e00640 1 -- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37dc15c890 msgr2=0x7f37dc14c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37d3e00640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37dc15c890 0x7f37dc14c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37d3e00640 1 -- 172.21.15.73:0/43163476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc14a9b0 con 0x7f37dc159340 2024-04-15T15:33:37.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.952+0000 7f37e1800640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37dc15c890 0x7f37dc14c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:37.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37d3e00640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37dc159340 0x7f37dc14ba50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009740 tx=0x7f37c40190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37d9600640 1 -- 172.21.15.73:0/43163476 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c40bd020 con 0x7f37dc159340 2024-04-15T15:33:37.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37d9600640 1 -- 172.21.15.73:0/43163476 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c4004020 con 0x7f37dc159340 2024-04-15T15:33:37.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37d9600640 1 -- 172.21.15.73:0/43163476 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c40b0040 con 0x7f37dc159340 2024-04-15T15:33:37.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc14ac90 con 0x7f37dc159340 2024-04-15T15:33:37.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc14b250 con 0x7f37dc159340 2024-04-15T15:33:37.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37dc068b20 con 0x7f37dc159340 2024-04-15T15:33:37.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37d9600640 1 -- 172.21.15.73:0/43163476 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f37c40c0070 con 0x7f37dc159340 2024-04-15T15:33:37.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37d9600640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f37b8068410 0x7f37b806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37d9600640 1 -- 172.21.15.73:0/43163476 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f37c4120180 con 0x7f37dc159340 2024-04-15T15:33:37.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37e0e00640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f37b8068410 0x7f37b806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37d9600640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] conn(0x7f37b806e950 0x7f37b8070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:37.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37d9600640 1 -- 172.21.15.73:0/43163476 --> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37b8071460 con 0x7f37b806e950 2024-04-15T15:33:37.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.956+0000 7f37d9600640 1 -- 172.21.15.73:0/43163476 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f37c4127050 con 0x7f37dc159340 2024-04-15T15:33:37.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.960+0000 7f37e0e00640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f37b8068410 0x7f37b806a8d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f37cc001360 tx=0x7f37cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.960+0000 7f37e1800640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] conn(0x7f37b806e950 0x7f37b8070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:37.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.960+0000 7f37e1800640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] conn(0x7f37b806e950 0x7f37b8070d90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:37.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.960+0000 7f37d9600640 1 -- 172.21.15.73:0/43163476 <== osd.5 v2:172.21.15.118:6800/3386675201 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f37b8071460 con 0x7f37b806e950 2024-04-15T15:33:37.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 --> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f37dc0afaa0 con 0x7f37b806e950 2024-04-15T15:33:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37d9600640 1 -- 172.21.15.73:0/43163476 <== osd.5 v2:172.21.15.118:6800/3386675201 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f37dc0afaa0 con 0x7f37b806e950 2024-04-15T15:33:37.975 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:37.976 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:33:37.976 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:37.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] conn(0x7f37b806e950 msgr2=0x7f37b8070d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.118:6800/3386675201,v1:172.21.15.118:6801/3386675201] conn(0x7f37b806e950 0x7f37b8070d90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f37b8068410 msgr2=0x7f37b806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f37b8068410 0x7f37b806a8d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f37cc001360 tx=0x7f37cc009040 comp rx=0 tx=0).stop 2024-04-15T15:33:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37dc159340 msgr2=0x7f37dc14ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 --2- 172.21.15.73:0/43163476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37dc159340 0x7f37dc14ba50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009740 tx=0x7f37c40190e0 comp rx=0 tx=0).stop 2024-04-15T15:33:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e1800640 1 -- 172.21.15.73:0/43163476 reap_dead start 2024-04-15T15:33:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 shutdown_connections 2024-04-15T15:33:37.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 >> 172.21.15.73:0/43163476 conn(0x7f37dc067e30 msgr2=0x7f37dc0cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:37.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 shutdown_connections 2024-04-15T15:33:37.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:37.972+0000 7f37e3800640 1 -- 172.21.15.73:0/43163476 wait complete. 2024-04-15T15:33:37.993 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-15T15:33:38.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c8a00640 1 Processor -- start 2024-04-15T15:33:38.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c8a00640 1 -- start start 2024-04-15T15:33:38.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c8a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16c415c860 0x7f16c40d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c8a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c409be00 con 0x7f16c40d1230 2024-04-15T15:33:38.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c8a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c409b5a0 con 0x7f16c40d0670 2024-04-15T15:33:38.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c8a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f16c415cc40 con 0x7f16c415c860 2024-04-15T15:33:38.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c2800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f16c40d1230 0x7f16c40704d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34194/0 (socket says 172.21.15.73:34194) 2024-04-15T15:33:38.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c2800640 1 -- 172.21.15.73:0/915053065 learned_addr learned my addr 172.21.15.73:0/915053065 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:38.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c1e00640 1 --2- 172.21.15.73:0/915053065 >> v2:172.21.15.73:3300/0 conn(0x7f16c415c860 0x7f16c40d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c0a00640 1 -- 172.21.15.73:0/915053065 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 696307880 0 0) 0x7f16c409be00 con 0x7f16c40d1230 2024-04-15T15:33:38.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c0a00640 1 -- 172.21.15.73:0/915053065 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16a8003530 con 0x7f16c40d1230 2024-04-15T15:33:38.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c1e00640 1 -- 172.21.15.73:0/915053065 >> v1:172.21.15.118:6789/0 conn(0x7f16c40d0670 legacy=0x7f16c40d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c1e00640 1 -- 172.21.15.73:0/915053065 >> v1:172.21.15.73:6789/0 conn(0x7f16c40d1230 legacy=0x7f16c40704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.128+0000 7f16c1e00640 1 -- 172.21.15.73:0/915053065 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c409b840 con 0x7f16c415c860 2024-04-15T15:33:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c1e00640 1 --2- 172.21.15.73:0/915053065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c415c860 0x7f16c40d0130 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009d90 tx=0x7f16b401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ef74a30be9e5e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c0a00640 1 -- 172.21.15.73:0/915053065 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b40b2070 con 0x7f16c415c860 2024-04-15T15:33:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c0a00640 1 -- 172.21.15.73:0/915053065 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b40a58b0 con 0x7f16c415c860 2024-04-15T15:33:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c0a00640 1 -- 172.21.15.73:0/915053065 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b40a5c80 con 0x7f16c415c860 2024-04-15T15:33:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c8a00640 1 -- 172.21.15.73:0/915053065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c415c860 msgr2=0x7f16c40d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c8a00640 1 --2- 172.21.15.73:0/915053065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c415c860 0x7f16c40d0130 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009d90 tx=0x7f16b401c8e0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c8a00640 1 -- 172.21.15.73:0/915053065 shutdown_connections 2024-04-15T15:33:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c8a00640 1 --2- 172.21.15.73:0/915053065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c415c860 0x7f16c40d0130 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c8a00640 1 -- 172.21.15.73:0/915053065 >> 172.21.15.73:0/915053065 conn(0x7f16c40b4050 msgr2=0x7f16c40b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c8a00640 1 -- 172.21.15.73:0/915053065 shutdown_connections 2024-04-15T15:33:38.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.132+0000 7f16c8a00640 1 -- 172.21.15.73:0/915053065 wait complete. 2024-04-15T15:33:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 Processor -- start 2024-04-15T15:33:38.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 -- start start 2024-04-15T15:33:38.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16c40d0670 0x7f16c4150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c40d1230 0x7f16c41543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16c415c860 0x7f16c4154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f16c4071800 con 0x7f16c40d1230 2024-04-15T15:33:38.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f16c4071680 con 0x7f16c40d0670 2024-04-15T15:33:38.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f16c416a330 con 0x7f16c415c860 2024-04-15T15:33:38.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c1400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c40d1230 0x7f16c41543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c1400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c40d1230 0x7f16c41543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53996/0 (socket says 172.21.15.73:53996) 2024-04-15T15:33:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c1400640 1 -- 172.21.15.73:0/390860266 learned_addr learned my addr 172.21.15.73:0/390860266 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c1e00640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16c40d0670 0x7f16c4150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c2800640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16c415c860 0x7f16c4154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c1400640 1 -- 172.21.15.73:0/390860266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16c415c860 msgr2=0x7f16c4154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c1400640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16c415c860 0x7f16c4154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c1400640 1 -- 172.21.15.73:0/390860266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16c40d0670 msgr2=0x7f16c4150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c1400640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16c40d0670 0x7f16c4150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c1400640 1 -- 172.21.15.73:0/390860266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c40b76f0 con 0x7f16c40d1230 2024-04-15T15:33:38.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c2800640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16c415c860 0x7f16c4154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:38.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c1400640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c40d1230 0x7f16c41543d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f16b000c340 tx=0x7f16b000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16ba000640 1 -- 172.21.15.73:0/390860266 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00052d0 con 0x7f16c40d1230 2024-04-15T15:33:38.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16ba000640 1 -- 172.21.15.73:0/390860266 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b0005470 con 0x7f16c40d1230 2024-04-15T15:33:38.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16ba000640 1 -- 172.21.15.73:0/390860266 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0007260 con 0x7f16c40d1230 2024-04-15T15:33:38.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 -- 172.21.15.73:0/390860266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c40b4f30 con 0x7f16c40d1230 2024-04-15T15:33:38.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 -- 172.21.15.73:0/390860266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c40b54f0 con 0x7f16c40d1230 2024-04-15T15:33:38.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.136+0000 7f16c8a00640 1 -- 172.21.15.73:0/390860266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c4068ab0 con 0x7f16c40d1230 2024-04-15T15:33:38.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.140+0000 7f16ba000640 1 -- 172.21.15.73:0/390860266 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f16b0007400 con 0x7f16c40d1230 2024-04-15T15:33:38.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.140+0000 7f16ba000640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16a4068410 0x7f16a406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.140+0000 7f16ba000640 1 -- 172.21.15.73:0/390860266 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f16b0085d20 con 0x7f16c40d1230 2024-04-15T15:33:38.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.140+0000 7f16c1e00640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16a4068410 0x7f16a406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.140+0000 7f16c1e00640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16a4068410 0x7f16a406a8d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f16b40af000 tx=0x7f16b40a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.144+0000 7f16ba000640 1 -- 172.21.15.73:0/390860266 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f16b008a070 con 0x7f16c40d1230 2024-04-15T15:33:38.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.300+0000 7f16c8a00640 1 -- 172.21.15.73:0/390860266 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f16c4075150 con 0x7f16a4068410 2024-04-15T15:33:38.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.300+0000 7f16ba000640 1 -- 172.21.15.73:0/390860266 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f16c4075150 con 0x7f16a4068410 2024-04-15T15:33:38.303 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2024-04-15T15:33:38.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 -- 172.21.15.73:0/390860266 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16a4068410 msgr2=0x7f16a406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16a4068410 0x7f16a406a8d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f16b40af000 tx=0x7f16b40a7070 comp rx=0 tx=0).stop 2024-04-15T15:33:38.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 -- 172.21.15.73:0/390860266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c40d1230 msgr2=0x7f16c41543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c40d1230 0x7f16c41543d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f16b000c340 tx=0x7f16b000c800 comp rx=0 tx=0).stop 2024-04-15T15:33:38.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 -- 172.21.15.73:0/390860266 shutdown_connections 2024-04-15T15:33:38.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f16a4068410 0x7f16a406a8d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16c415c860 0x7f16c4154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c40d1230 0x7f16c41543d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 --2- 172.21.15.73:0/390860266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16c40d0670 0x7f16c4150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 -- 172.21.15.73:0/390860266 >> 172.21.15.73:0/390860266 conn(0x7f16c40b4050 msgr2=0x7f16c4158200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:38.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 -- 172.21.15.73:0/390860266 shutdown_connections 2024-04-15T15:33:38.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.304+0000 7f16c8a00640 1 -- 172.21.15.73:0/390860266 wait complete. 2024-04-15T15:33:38.323 INFO:tasks.ceph:Scrubbing osd.6 2024-04-15T15:33:38.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:33:38.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a3e00640 1 Processor -- start 2024-04-15T15:33:38.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a3e00640 1 -- start start 2024-04-15T15:33:38.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f67a415e950 0x7f67a40d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67a406d520 0x7f67a4162370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a3e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f67a406d980 0x7f67a41628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a3e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f67a40d0590 con 0x7f67a415e950 2024-04-15T15:33:38.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a3e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f67a406df30 con 0x7f67a406d980 2024-04-15T15:33:38.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a3e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f67a40d07f0 con 0x7f67a406d520 2024-04-15T15:33:38.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a2a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f67a415e950 0x7f67a40d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a2a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f67a415e950 0x7f67a40d15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54008/0 (socket says 172.21.15.73:54008) 2024-04-15T15:33:38.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a2a00640 1 -- 172.21.15.73:0/3926781276 learned_addr learned my addr 172.21.15.73:0/3926781276 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:38.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a3400640 1 --2- 172.21.15.73:0/3926781276 >> v2:172.21.15.118:3300/0 conn(0x7f67a406d980 0x7f67a41628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a2000640 1 --2- 172.21.15.73:0/3926781276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67a406d520 0x7f67a4162370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a2a00640 1 -- 172.21.15.73:0/3926781276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67a406d520 msgr2=0x7f67a4162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:38.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a2a00640 1 --2- 172.21.15.73:0/3926781276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67a406d520 0x7f67a4162370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a2a00640 1 -- 172.21.15.73:0/3926781276 >> v2:172.21.15.118:3300/0 conn(0x7f67a406d980 msgr2=0x7f67a41628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:38.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a2a00640 1 --2- 172.21.15.73:0/3926781276 >> v2:172.21.15.118:3300/0 conn(0x7f67a406d980 0x7f67a41628b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a2a00640 1 -- 172.21.15.73:0/3926781276 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a40d0ad0 con 0x7f67a415e950 2024-04-15T15:33:38.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.464+0000 7f67a3400640 1 --2- 172.21.15.73:0/3926781276 >> v2:172.21.15.118:3300/0 conn(0x7f67a406d980 0x7f67a41628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:38.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a2a00640 1 --2- 172.21.15.73:0/3926781276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67a415e950 0x7f67a40d15b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f67a4073150 tx=0x7f679401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153e35a7f970d201 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a1600640 1 -- 172.21.15.73:0/3926781276 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940b1070 con 0x7f67a415e950 2024-04-15T15:33:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a1600640 1 -- 172.21.15.73:0/3926781276 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67940ac630 con 0x7f67a415e950 2024-04-15T15:33:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a1600640 1 -- 172.21.15.73:0/3926781276 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940a8050 con 0x7f67a415e950 2024-04-15T15:33:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 -- 172.21.15.73:0/3926781276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67a415e950 msgr2=0x7f67a40d15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 --2- 172.21.15.73:0/3926781276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67a415e950 0x7f67a40d15b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f67a4073150 tx=0x7f679401c520 comp rx=0 tx=0).stop 2024-04-15T15:33:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 -- 172.21.15.73:0/3926781276 shutdown_connections 2024-04-15T15:33:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 --2- 172.21.15.73:0/3926781276 >> v2:172.21.15.118:3300/0 conn(0x7f67a406d980 0x7f67a41628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 --2- 172.21.15.73:0/3926781276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67a406d520 0x7f67a4162370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 --2- 172.21.15.73:0/3926781276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67a415e950 0x7f67a40d15b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 -- 172.21.15.73:0/3926781276 >> 172.21.15.73:0/3926781276 conn(0x7f67a40b3ef0 msgr2=0x7f67a40b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 -- 172.21.15.73:0/3926781276 shutdown_connections 2024-04-15T15:33:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 -- 172.21.15.73:0/3926781276 wait complete. 2024-04-15T15:33:38.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 Processor -- start 2024-04-15T15:33:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.468+0000 7f67a3e00640 1 -- start start 2024-04-15T15:33:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67a406d520 0x7f67a40b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67a406d980 0x7f67a40b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67a415e950 0x7f67a41616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a3e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f67a40cd3e0 con 0x7f67a406d980 2024-04-15T15:33:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a3e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f67a40cd260 con 0x7f67a415e950 2024-04-15T15:33:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a3e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f67a40cd560 con 0x7f67a406d520 2024-04-15T15:33:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67a406d980 0x7f67a40b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67a406d980 0x7f67a40b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54022/0 (socket says 172.21.15.73:54022) 2024-04-15T15:33:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a2000640 1 -- 172.21.15.73:0/4192245521 learned_addr learned my addr 172.21.15.73:0/4192245521 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a2a00640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67a406d520 0x7f67a40b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a3400640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67a415e950 0x7f67a41616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a2000640 1 -- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67a406d520 msgr2=0x7f67a40b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a2000640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67a406d520 0x7f67a40b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a2000640 1 -- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67a415e950 msgr2=0x7f67a41616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a2000640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67a415e950 0x7f67a41616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a2000640 1 -- 172.21.15.73:0/4192245521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a40b7de0 con 0x7f67a406d980 2024-04-15T15:33:38.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a2000640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67a406d980 0x7f67a40b78a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f679000d800 tx=0x7f679000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f679b400640 1 -- 172.21.15.73:0/4192245521 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790018020 con 0x7f67a406d980 2024-04-15T15:33:38.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f679b400640 1 -- 172.21.15.73:0/4192245521 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67900096a0 con 0x7f67a406d980 2024-04-15T15:33:38.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a40b5640 con 0x7f67a406d980 2024-04-15T15:33:38.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f679b400640 1 -- 172.21.15.73:0/4192245521 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790009a50 con 0x7f67a406d980 2024-04-15T15:33:38.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a40aff60 con 0x7f67a406d980 2024-04-15T15:33:38.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67a4068ab0 con 0x7f67a406d980 2024-04-15T15:33:38.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.472+0000 7f679b400640 1 -- 172.21.15.73:0/4192245521 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f679001b020 con 0x7f67a406d980 2024-04-15T15:33:38.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.476+0000 7f679b400640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6784068410 0x7f678406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.476+0000 7f679b400640 1 -- 172.21.15.73:0/4192245521 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f67900874b0 con 0x7f67a406d980 2024-04-15T15:33:38.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.476+0000 7f679b400640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] conn(0x7f678406e950 0x7f6784070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.476+0000 7f67a2a00640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6784068410 0x7f678406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.476+0000 7f679b400640 1 -- 172.21.15.73:0/4192245521 --> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6790001d40 con 0x7f678406e950 2024-04-15T15:33:38.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.476+0000 7f679b400640 1 -- 172.21.15.73:0/4192245521 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f6790087860 con 0x7f67a406d980 2024-04-15T15:33:38.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.476+0000 7f67a3400640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] conn(0x7f678406e950 0x7f6784070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.476+0000 7f67a2a00640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6784068410 0x7f678406a8d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f67940ae000 tx=0x7f6794009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.476+0000 7f67a3400640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] conn(0x7f678406e950 0x7f6784070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.476+0000 7f679b400640 1 -- 172.21.15.73:0/4192245521 <== osd.6 v2:172.21.15.118:6808/1779259058 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6790001d40 con 0x7f678406e950 2024-04-15T15:33:38.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 --> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f67a40b8380 con 0x7f678406e950 2024-04-15T15:33:38.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f679b400640 1 -- 172.21.15.73:0/4192245521 <== osd.6 v2:172.21.15.118:6808/1779259058 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f67a40b8380 con 0x7f678406e950 2024-04-15T15:33:38.493 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:38.493 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:33:38.494 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:38.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] conn(0x7f678406e950 msgr2=0x7f6784070d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.118:6808/1779259058,v1:172.21.15.118:6810/1779259058] conn(0x7f678406e950 0x7f6784070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6784068410 msgr2=0x7f678406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f6784068410 0x7f678406a8d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f67940ae000 tx=0x7f6794009040 comp rx=0 tx=0).stop 2024-04-15T15:33:38.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67a406d980 msgr2=0x7f67a40b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 --2- 172.21.15.73:0/4192245521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67a406d980 0x7f67a40b78a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f679000d800 tx=0x7f679000dcc0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3400640 1 -- 172.21.15.73:0/4192245521 reap_dead start 2024-04-15T15:33:38.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 shutdown_connections 2024-04-15T15:33:38.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 >> 172.21.15.73:0/4192245521 conn(0x7f67a40b3ef0 msgr2=0x7f67a40cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:38.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 shutdown_connections 2024-04-15T15:33:38.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.492+0000 7f67a3e00640 1 -- 172.21.15.73:0/4192245521 wait complete. 2024-04-15T15:33:38.511 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-15T15:33:38.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66fdc00640 1 Processor -- start 2024-04-15T15:33:38.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66fdc00640 1 -- start start 2024-04-15T15:33:38.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66fdc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66f80d08b0 0x7f66f809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66fdc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66f809afa0 0x7f66f815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66fdc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f80d1000 con 0x7f66f80b17a0 2024-04-15T15:33:38.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66fdc00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f66f80d12e0 con 0x7f66f809afa0 2024-04-15T15:33:38.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66fdc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f66f80d15c0 con 0x7f66f80d08b0 2024-04-15T15:33:38.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66f7400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66f809afa0 0x7f66f815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66f6a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f66f80b17a0 0x7f66f806dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.73:40306/0 (socket says 172.21.15.73:40306) 2024-04-15T15:33:38.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66ee000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66f80d08b0 0x7f66f809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66f7400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66f809afa0 0x7f66f815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:60488/0 (socket says 172.21.15.73:60488) 2024-04-15T15:33:38.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66f6a00640 1 -- 172.21.15.73:0/2686530999 learned_addr learned my addr 172.21.15.73:0/2686530999 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:38.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66f7400640 1 -- 172.21.15.73:0/2686530999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66f80d08b0 msgr2=0x7f66f809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:38.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66f7400640 1 --2- 172.21.15.73:0/2686530999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66f80d08b0 0x7f66f809aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66f7400640 1 -- 172.21.15.73:0/2686530999 >> v1:172.21.15.118:6789/0 conn(0x7f66f80b17a0 legacy=0x7f66f806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66f7400640 1 -- 172.21.15.73:0/2686530999 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f80d18a0 con 0x7f66f809afa0 2024-04-15T15:33:38.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.648+0000 7f66f6000640 1 -- 172.21.15.73:0/2686530999 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1195599331 0 0) 0x7f66f80d1000 con 0x7f66f80b17a0 2024-04-15T15:33:38.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66f7400640 1 --2- 172.21.15.73:0/2686530999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66f809afa0 0x7f66f815e160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2205a336382675ce server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66f6000640 1 -- 172.21.15.73:0/2686530999 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f00b2070 con 0x7f66f809afa0 2024-04-15T15:33:38.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66f6000640 1 -- 172.21.15.73:0/2686530999 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f00a5880 con 0x7f66f809afa0 2024-04-15T15:33:38.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66f6000640 1 -- 172.21.15.73:0/2686530999 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f00a5c50 con 0x7f66f809afa0 2024-04-15T15:33:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66fdc00640 1 -- 172.21.15.73:0/2686530999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66f809afa0 msgr2=0x7f66f815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66fdc00640 1 --2- 172.21.15.73:0/2686530999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66f809afa0 0x7f66f815e160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f001c970 comp rx=0 tx=0).stop 2024-04-15T15:33:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66fdc00640 1 -- 172.21.15.73:0/2686530999 shutdown_connections 2024-04-15T15:33:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66fdc00640 1 --2- 172.21.15.73:0/2686530999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66f809afa0 0x7f66f815e160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66fdc00640 1 --2- 172.21.15.73:0/2686530999 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66f80d08b0 0x7f66f809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66fdc00640 1 -- 172.21.15.73:0/2686530999 >> 172.21.15.73:0/2686530999 conn(0x7f66f80b3fe0 msgr2=0x7f66f80b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66fdc00640 1 -- 172.21.15.73:0/2686530999 shutdown_connections 2024-04-15T15:33:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.652+0000 7f66fdc00640 1 -- 172.21.15.73:0/2686530999 wait complete. 2024-04-15T15:33:38.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 Processor -- start 2024-04-15T15:33:38.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 -- start start 2024-04-15T15:33:38.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66f809afa0 0x7f66f80b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f80b17a0 0x7f66f814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66f80d08b0 0x7f66f8162740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f66f806fed0 con 0x7f66f80b17a0 2024-04-15T15:33:38.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f66f80b1d90 con 0x7f66f80d08b0 2024-04-15T15:33:38.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f66f8070050 con 0x7f66f809afa0 2024-04-15T15:33:38.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ee000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f80b17a0 0x7f66f814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ee000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f80b17a0 0x7f66f814c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54038/0 (socket says 172.21.15.73:54038) 2024-04-15T15:33:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ee000640 1 -- 172.21.15.73:0/1615465312 learned_addr learned my addr 172.21.15.73:0/1615465312 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66f6a00640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66f809afa0 0x7f66f80b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66f7400640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66f80d08b0 0x7f66f8162740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ee000640 1 -- 172.21.15.73:0/1615465312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66f809afa0 msgr2=0x7f66f80b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ee000640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66f809afa0 0x7f66f80b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ee000640 1 -- 172.21.15.73:0/1615465312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66f80d08b0 msgr2=0x7f66f8162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ee000640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66f80d08b0 0x7f66f8162740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ee000640 1 -- 172.21.15.73:0/1615465312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f80b63f0 con 0x7f66f80b17a0 2024-04-15T15:33:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ee000640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f80b17a0 0x7f66f814c990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f66e000e870 tx=0x7f66e000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ef400640 1 -- 172.21.15.73:0/1615465312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0017070 con 0x7f66f80b17a0 2024-04-15T15:33:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ef400640 1 -- 172.21.15.73:0/1615465312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e000c940 con 0x7f66f80b17a0 2024-04-15T15:33:38.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 -- 172.21.15.73:0/1615465312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f815f420 con 0x7f66f80b17a0 2024-04-15T15:33:38.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66ef400640 1 -- 172.21.15.73:0/1615465312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e000ccf0 con 0x7f66f80b17a0 2024-04-15T15:33:38.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 -- 172.21.15.73:0/1615465312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f815f9e0 con 0x7f66f80b17a0 2024-04-15T15:33:38.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.656+0000 7f66fdc00640 1 -- 172.21.15.73:0/1615465312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f8068ab0 con 0x7f66f80b17a0 2024-04-15T15:33:38.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.660+0000 7f66ef400640 1 -- 172.21.15.73:0/1615465312 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f66e001a070 con 0x7f66f80b17a0 2024-04-15T15:33:38.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.660+0000 7f66ef400640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f66d4068410 0x7f66d406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.660+0000 7f66ef400640 1 -- 172.21.15.73:0/1615465312 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f66e0086700 con 0x7f66f80b17a0 2024-04-15T15:33:38.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.660+0000 7f66f6a00640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f66d4068410 0x7f66d406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.660+0000 7f66f6a00640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f66d4068410 0x7f66d406a8d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f66e8007a20 tx=0x7f66e80079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.664+0000 7f66ef400640 1 -- 172.21.15.73:0/1615465312 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f66e0056730 con 0x7f66f80b17a0 2024-04-15T15:33:38.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.824+0000 7f66fdc00640 1 -- 172.21.15.73:0/1615465312 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f66f80d22b0 con 0x7f66d4068410 2024-04-15T15:33:38.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.824+0000 7f66ef400640 1 -- 172.21.15.73:0/1615465312 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f66f80d22b0 con 0x7f66d4068410 2024-04-15T15:33:38.826 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 6 to deep-scrub 2024-04-15T15:33:38.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 -- 172.21.15.73:0/1615465312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f66d4068410 msgr2=0x7f66d406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f66d4068410 0x7f66d406a8d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f66e8007a20 tx=0x7f66e80079b0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 -- 172.21.15.73:0/1615465312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f80b17a0 msgr2=0x7f66f814c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f80b17a0 0x7f66f814c990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f66e000e870 tx=0x7f66e000ec70 comp rx=0 tx=0).stop 2024-04-15T15:33:38.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 -- 172.21.15.73:0/1615465312 shutdown_connections 2024-04-15T15:33:38.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66f80d08b0 0x7f66f8162740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66f80b17a0 0x7f66f814c990 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f66d4068410 0x7f66d406a8d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 --2- 172.21.15.73:0/1615465312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66f809afa0 0x7f66f80b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 -- 172.21.15.73:0/1615465312 >> 172.21.15.73:0/1615465312 conn(0x7f66f80b3fe0 msgr2=0x7f66f80b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:38.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 -- 172.21.15.73:0/1615465312 shutdown_connections 2024-04-15T15:33:38.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.828+0000 7f66fdc00640 1 -- 172.21.15.73:0/1615465312 wait complete. 2024-04-15T15:33:38.848 INFO:tasks.ceph:Scrubbing osd.7 2024-04-15T15:33:38.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:33:38.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.984+0000 7fe09a200640 1 Processor -- start 2024-04-15T15:33:38.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.984+0000 7fe09a200640 1 -- start start 2024-04-15T15:33:38.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.984+0000 7fe09a200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe094159340 0x7fe09415c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.984+0000 7fe09a200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe0940ceb40 0x7fe0940cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.984+0000 7fe09a200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe09406ba50 0x7fe09406be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.984+0000 7fe09a200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe09415be20 con 0x7fe09406ba50 2024-04-15T15:33:38.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.984+0000 7fe09a200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fe09406c3b0 con 0x7fe0940ceb40 2024-04-15T15:33:38.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.984+0000 7fe09a200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe094159720 con 0x7fe094159340 2024-04-15T15:33:38.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe093e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe09406ba50 0x7fe09406be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe093e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe09406ba50 0x7fe09406be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54052/0 (socket says 172.21.15.73:54052) 2024-04-15T15:33:38.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe093e00640 1 -- 172.21.15.73:0/2285105163 learned_addr learned my addr 172.21.15.73:0/2285105163 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:38.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe08aa00640 1 --2- 172.21.15.73:0/2285105163 >> v2:172.21.15.118:3300/0 conn(0x7fe0940ceb40 0x7fe0940cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe093400640 1 --2- 172.21.15.73:0/2285105163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe094159340 0x7fe09415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe093e00640 1 -- 172.21.15.73:0/2285105163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe094159340 msgr2=0x7fe09415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:38.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe093e00640 1 --2- 172.21.15.73:0/2285105163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe094159340 0x7fe09415c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe093e00640 1 -- 172.21.15.73:0/2285105163 >> v2:172.21.15.118:3300/0 conn(0x7fe0940ceb40 msgr2=0x7fe0940cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:38.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe093e00640 1 --2- 172.21.15.73:0/2285105163 >> v2:172.21.15.118:3300/0 conn(0x7fe0940ceb40 0x7fe0940cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe093e00640 1 -- 172.21.15.73:0/2285105163 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0940cf6b0 con 0x7fe09406ba50 2024-04-15T15:33:38.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe08aa00640 1 --2- 172.21.15.73:0/2285105163 >> v2:172.21.15.118:3300/0 conn(0x7fe0940ceb40 0x7fe0940cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:38.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe093e00640 1 --2- 172.21.15.73:0/2285105163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe09406ba50 0x7fe09406be70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe094072de0 tx=0x7fe08c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27932157ba9815af server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe092a00640 1 -- 172.21.15.73:0/2285105163 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00b2d0 con 0x7fe09406ba50 2024-04-15T15:33:38.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe092a00640 1 -- 172.21.15.73:0/2285105163 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe08c00b470 con 0x7fe09406ba50 2024-04-15T15:33:38.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.988+0000 7fe092a00640 1 -- 172.21.15.73:0/2285105163 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0a7b90 con 0x7fe09406ba50 2024-04-15T15:33:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 -- 172.21.15.73:0/2285105163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe09406ba50 msgr2=0x7fe09406be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 --2- 172.21.15.73:0/2285105163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe09406ba50 0x7fe09406be70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe094072de0 tx=0x7fe08c01ebf0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 -- 172.21.15.73:0/2285105163 shutdown_connections 2024-04-15T15:33:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 --2- 172.21.15.73:0/2285105163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe09406ba50 0x7fe09406be70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 --2- 172.21.15.73:0/2285105163 >> v2:172.21.15.118:3300/0 conn(0x7fe0940ceb40 0x7fe0940cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 --2- 172.21.15.73:0/2285105163 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe094159340 0x7fe09415c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 -- 172.21.15.73:0/2285105163 >> 172.21.15.73:0/2285105163 conn(0x7fe094067e30 msgr2=0x7fe0940b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:38.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 -- 172.21.15.73:0/2285105163 shutdown_connections 2024-04-15T15:33:38.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 -- 172.21.15.73:0/2285105163 wait complete. 2024-04-15T15:33:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 Processor -- start 2024-04-15T15:33:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 -- start start 2024-04-15T15:33:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe09406ba50 0x7fe09414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0940ceb40 0x7fe0940a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe094159340 0x7fe094157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:38.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe0940b4280 con 0x7fe094159340 2024-04-15T15:33:38.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe0940cf990 con 0x7fe0940ceb40 2024-04-15T15:33:38.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe09a200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe0940b4400 con 0x7fe09406ba50 2024-04-15T15:33:38.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe093e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe094159340 0x7fe094157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe093e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe094159340 0x7fe094157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54066/0 (socket says 172.21.15.73:54066) 2024-04-15T15:33:38.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe093e00640 1 -- 172.21.15.73:0/3444712141 learned_addr learned my addr 172.21.15.73:0/3444712141 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:38.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe08aa00640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0940ceb40 0x7fe0940a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe093400640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe09406ba50 0x7fe09414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe093e00640 1 -- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe09406ba50 msgr2=0x7fe09414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe093e00640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe09406ba50 0x7fe09414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe093e00640 1 -- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0940ceb40 msgr2=0x7fe0940a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe093e00640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0940ceb40 0x7fe0940a97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.992+0000 7fe093e00640 1 -- 172.21.15.73:0/3444712141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe094156f50 con 0x7fe094159340 2024-04-15T15:33:38.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe093e00640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe094159340 0x7fe094157950 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0b1040 tx=0x7fe08c01b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:38.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe08be00640 1 -- 172.21.15.73:0/3444712141 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0be020 con 0x7fe094159340 2024-04-15T15:33:39.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe08be00640 1 -- 172.21.15.73:0/3444712141 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe08c009800 con 0x7fe094159340 2024-04-15T15:33:39.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe08be00640 1 -- 172.21.15.73:0/3444712141 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c009bd0 con 0x7fe094159340 2024-04-15T15:33:39.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe094156c70 con 0x7fe094159340 2024-04-15T15:33:39.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe094150c90 con 0x7fe094159340 2024-04-15T15:33:39.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe094151070 con 0x7fe094159340 2024-04-15T15:33:39.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe08be00640 1 -- 172.21.15.73:0/3444712141 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fe08c0c1020 con 0x7fe094159340 2024-04-15T15:33:39.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe08be00640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe070068410 0x7fe07006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe08be00640 1 -- 172.21.15.73:0/3444712141 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fe08c123b00 con 0x7fe094159340 2024-04-15T15:33:39.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe093400640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe070068410 0x7fe07006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe08be00640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] conn(0x7fe07006e950 0x7fe070070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe08be00640 1 -- 172.21.15.73:0/3444712141 --> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe070071460 con 0x7fe07006e950 2024-04-15T15:33:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:38.996+0000 7fe08be00640 1 -- 172.21.15.73:0/3444712141 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fe08c1282a0 con 0x7fe094159340 2024-04-15T15:33:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.000+0000 7fe08aa00640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] conn(0x7fe07006e950 0x7fe070070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.000+0000 7fe093400640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe070068410 0x7fe07006a8d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe094150490 tx=0x7fe084008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:39.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.000+0000 7fe08aa00640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] conn(0x7fe07006e950 0x7fe070070d90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:39.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.000+0000 7fe08be00640 1 -- 172.21.15.73:0/3444712141 <== osd.7 v2:172.21.15.118:6824/2597178366 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe070071460 con 0x7fe07006e950 2024-04-15T15:33:39.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 --> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe094068b20 con 0x7fe07006e950 2024-04-15T15:33:39.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe08be00640 1 -- 172.21.15.73:0/3444712141 <== osd.7 v2:172.21.15.118:6824/2597178366 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe094068b20 con 0x7fe07006e950 2024-04-15T15:33:39.015 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-15T15:33:39.015 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:33:39.015 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-15T15:33:39.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] conn(0x7fe07006e950 msgr2=0x7fe070070d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.118:6824/2597178366,v1:172.21.15.118:6825/2597178366] conn(0x7fe07006e950 0x7fe070070d90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe070068410 msgr2=0x7fe07006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7fe070068410 0x7fe07006a8d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe094150490 tx=0x7fe084008040 comp rx=0 tx=0).stop 2024-04-15T15:33:39.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe094159340 msgr2=0x7fe094157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 --2- 172.21.15.73:0/3444712141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe094159340 0x7fe094157950 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0b1040 tx=0x7fe08c01b990 comp rx=0 tx=0).stop 2024-04-15T15:33:39.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe093e00640 1 -- 172.21.15.73:0/3444712141 reap_dead start 2024-04-15T15:33:39.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 shutdown_connections 2024-04-15T15:33:39.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 >> 172.21.15.73:0/3444712141 conn(0x7fe094067e30 msgr2=0x7fe0940b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:39.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 shutdown_connections 2024-04-15T15:33:39.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.012+0000 7fe09a200640 1 -- 172.21.15.73:0/3444712141 wait complete. 2024-04-15T15:33:39.033 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-15T15:33:39.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.168+0000 7f7b29000640 1 Processor -- start 2024-04-15T15:33:39.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.168+0000 7f7b29000640 1 -- start start 2024-04-15T15:33:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.168+0000 7f7b29000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b27c0 0x7f7b2415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.168+0000 7f7b29000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b240b3e30 0x7f7b240b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.168+0000 7f7b29000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b24070160 con 0x7f7b2415b5d0 2024-04-15T15:33:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.168+0000 7f7b29000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2415b9b0 con 0x7f7b240b3e30 2024-04-15T15:33:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.168+0000 7f7b29000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2415f1f0 con 0x7f7b240b27c0 2024-04-15T15:33:39.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.168+0000 7f7b22800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b240b3e30 0x7f7b240b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.168+0000 7f7b21e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7b2415b5d0 0x7f7b240b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34208/0 (socket says 172.21.15.73:34208) 2024-04-15T15:33:39.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.168+0000 7f7b21e00640 1 -- 172.21.15.73:0/838025932 learned_addr learned my addr 172.21.15.73:0/838025932 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:39.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b19400640 1 --2- 172.21.15.73:0/838025932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b27c0 0x7f7b2415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b22800640 1 -- 172.21.15.73:0/838025932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b27c0 msgr2=0x7f7b2415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:39.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b22800640 1 --2- 172.21.15.73:0/838025932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b27c0 0x7f7b2415fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b22800640 1 -- 172.21.15.73:0/838025932 >> v1:172.21.15.73:6789/0 conn(0x7f7b2415b5d0 legacy=0x7f7b240b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b22800640 1 -- 172.21.15.73:0/838025932 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2406fe80 con 0x7f7b240b3e30 2024-04-15T15:33:39.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b21400640 1 -- 172.21.15.73:0/838025932 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 798733077 0 0) 0x7f7b24070160 con 0x7f7b2415b5d0 2024-04-15T15:33:39.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b19400640 1 --2- 172.21.15.73:0/838025932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b27c0 0x7f7b2415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b22800640 1 --2- 172.21.15.73:0/838025932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b240b3e30 0x7f7b240b4740 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0097c0 tx=0x7f7b1c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d916924f51505 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b21400640 1 -- 172.21.15.73:0/838025932 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0b0070 con 0x7f7b240b3e30 2024-04-15T15:33:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b21400640 1 -- 172.21.15.73:0/838025932 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c004030 con 0x7f7b240b3e30 2024-04-15T15:33:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b21400640 1 -- 172.21.15.73:0/838025932 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c004400 con 0x7f7b240b3e30 2024-04-15T15:33:39.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b29000640 1 -- 172.21.15.73:0/838025932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b240b3e30 msgr2=0x7f7b240b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.172+0000 7f7b29000640 1 --2- 172.21.15.73:0/838025932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b240b3e30 0x7f7b240b4740 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0097c0 tx=0x7f7b1c01c350 comp rx=0 tx=0).stop 2024-04-15T15:33:39.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 -- 172.21.15.73:0/838025932 shutdown_connections 2024-04-15T15:33:39.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 --2- 172.21.15.73:0/838025932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b27c0 0x7f7b2415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 --2- 172.21.15.73:0/838025932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b240b3e30 0x7f7b240b4740 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 -- 172.21.15.73:0/838025932 >> 172.21.15.73:0/838025932 conn(0x7f7b24067dd0 msgr2=0x7f7b240d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:39.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 -- 172.21.15.73:0/838025932 shutdown_connections 2024-04-15T15:33:39.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 -- 172.21.15.73:0/838025932 wait complete. 2024-04-15T15:33:39.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 Processor -- start 2024-04-15T15:33:39.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 -- start start 2024-04-15T15:33:39.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b240b27c0 0x7f7b241fae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b3e30 0x7f7b241526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2415b5d0 0x7f7b24165140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2406faa0 con 0x7f7b2415b5d0 2024-04-15T15:33:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7b240cfd00 con 0x7f7b240b27c0 2024-04-15T15:33:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2406fc20 con 0x7f7b240b3e30 2024-04-15T15:33:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b22800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2415b5d0 0x7f7b24165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b22800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2415b5d0 0x7f7b24165140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54080/0 (socket says 172.21.15.73:54080) 2024-04-15T15:33:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b22800640 1 -- 172.21.15.73:0/1767424309 learned_addr learned my addr 172.21.15.73:0/1767424309 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b21e00640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b240b27c0 0x7f7b241fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b22800640 1 -- 172.21.15.73:0/1767424309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b3e30 msgr2=0x7f7b241526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b19400640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b3e30 0x7f7b241526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b22800640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b3e30 0x7f7b241526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b22800640 1 -- 172.21.15.73:0/1767424309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b240b27c0 msgr2=0x7f7b241fae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b22800640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b240b27c0 0x7f7b241fae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b22800640 1 -- 172.21.15.73:0/1767424309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b24152db0 con 0x7f7b2415b5d0 2024-04-15T15:33:39.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b21e00640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b240b27c0 0x7f7b241fae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:39.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b19400640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b3e30 0x7f7b241526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T15:33:39.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b22800640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2415b5d0 0x7f7b24165140 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0ae040 tx=0x7f7b1c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:39.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b1aa00640 1 -- 172.21.15.73:0/1767424309 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0b9070 con 0x7f7b2415b5d0 2024-04-15T15:33:39.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b1aa00640 1 -- 172.21.15.73:0/1767424309 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c003bc0 con 0x7f7b2415b5d0 2024-04-15T15:33:39.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b1aa00640 1 -- 172.21.15.73:0/1767424309 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0b0040 con 0x7f7b2415b5d0 2024-04-15T15:33:39.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.176+0000 7f7b29000640 1 -- 172.21.15.73:0/1767424309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b24153090 con 0x7f7b2415b5d0 2024-04-15T15:33:39.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.180+0000 7f7b29000640 1 -- 172.21.15.73:0/1767424309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b24153650 con 0x7f7b2415b5d0 2024-04-15T15:33:39.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.180+0000 7f7b29000640 1 -- 172.21.15.73:0/1767424309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b24068ab0 con 0x7f7b2415b5d0 2024-04-15T15:33:39.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.180+0000 7f7b1aa00640 1 -- 172.21.15.73:0/1767424309 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f7b1c0bc070 con 0x7f7b2415b5d0 2024-04-15T15:33:39.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.180+0000 7f7b1aa00640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b00068410 0x7f7b0006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.180+0000 7f7b1aa00640 1 -- 172.21.15.73:0/1767424309 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f7b1c120f90 con 0x7f7b2415b5d0 2024-04-15T15:33:39.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.180+0000 7f7b21e00640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b00068410 0x7f7b0006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.180+0000 7f7b21e00640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b00068410 0x7f7b0006a8d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7b14007fd0 tx=0x7f7b14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:39.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.184+0000 7f7b1aa00640 1 -- 172.21.15.73:0/1767424309 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b1c016090 con 0x7f7b2415b5d0 2024-04-15T15:33:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.340+0000 7f7b29000640 1 -- 172.21.15.73:0/1767424309 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f7b2406c340 con 0x7f7b00068410 2024-04-15T15:33:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.340+0000 7f7b1aa00640 1 -- 172.21.15.73:0/1767424309 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7b2406c340 con 0x7f7b00068410 2024-04-15T15:33:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 7 to deep-scrub 2024-04-15T15:33:39.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 -- 172.21.15.73:0/1767424309 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b00068410 msgr2=0x7f7b0006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b00068410 0x7f7b0006a8d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7b14007fd0 tx=0x7f7b14009040 comp rx=0 tx=0).stop 2024-04-15T15:33:39.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 -- 172.21.15.73:0/1767424309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2415b5d0 msgr2=0x7f7b24165140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2415b5d0 0x7f7b24165140 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0ae040 tx=0x7f7b1c0190f0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 -- 172.21.15.73:0/1767424309 shutdown_connections 2024-04-15T15:33:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2415b5d0 0x7f7b24165140 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b00068410 0x7f7b0006a8d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b240b3e30 0x7f7b241526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 --2- 172.21.15.73:0/1767424309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b240b27c0 0x7f7b241fae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 -- 172.21.15.73:0/1767424309 >> 172.21.15.73:0/1767424309 conn(0x7f7b24067dd0 msgr2=0x7f7b240b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 -- 172.21.15.73:0/1767424309 shutdown_connections 2024-04-15T15:33:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.344+0000 7f7b29000640 1 -- 172.21.15.73:0/1767424309 wait complete. 2024-04-15T15:33:39.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:33:39.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7bae200640 1 Processor -- start 2024-04-15T15:33:39.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7bae200640 1 -- start start 2024-04-15T15:33:39.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7bae200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ba80d0390 0x7f7ba80cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7bae200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba80d1f30 0x7f7ba80cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7bae200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ba815cf50 con 0x7f7ba806ba50 2024-04-15T15:33:39.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7bae200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7ba80d23c0 con 0x7f7ba80d0390 2024-04-15T15:33:39.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7bae200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba815d230 con 0x7f7ba80d1f30 2024-04-15T15:33:39.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7ba6a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ba80d0390 0x7f7ba80cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7ba7400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7ba806ba50 0x7f7ba806be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34210/0 (socket says 172.21.15.73:34210) 2024-04-15T15:33:39.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7ba7400640 1 -- 172.21.15.73:0/106935797 learned_addr learned my addr 172.21.15.73:0/106935797 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:33:39.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7ba7e00640 1 --2- 172.21.15.73:0/106935797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba80d1f30 0x7f7ba80cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7ba6a00640 1 -- 172.21.15.73:0/106935797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba80d1f30 msgr2=0x7f7ba80cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:39.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7ba6a00640 1 --2- 172.21.15.73:0/106935797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba80d1f30 0x7f7ba80cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7ba6a00640 1 -- 172.21.15.73:0/106935797 >> v1:172.21.15.73:6789/0 conn(0x7f7ba806ba50 legacy=0x7f7ba806be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7ba6a00640 1 -- 172.21.15.73:0/106935797 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba815d510 con 0x7f7ba80d0390 2024-04-15T15:33:39.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.500+0000 7f7ba6000640 1 -- 172.21.15.73:0/106935797 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522785991 0 0) 0x7f7ba815cf50 con 0x7f7ba806ba50 2024-04-15T15:33:39.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7ba6a00640 1 --2- 172.21.15.73:0/106935797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 0x7f7ba80cd0b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7b980097c0 tx=0x7f7b9801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d148b26db2550350 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:39.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7ba6000640 1 -- 172.21.15.73:0/106935797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b980b0070 con 0x7f7ba80d0390 2024-04-15T15:33:39.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7ba6000640 1 -- 172.21.15.73:0/106935797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b980ab600 con 0x7f7ba80d0390 2024-04-15T15:33:39.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7ba6000640 1 -- 172.21.15.73:0/106935797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b980ab9d0 con 0x7f7ba80d0390 2024-04-15T15:33:39.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7bae200640 1 -- 172.21.15.73:0/106935797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 msgr2=0x7f7ba80cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7bae200640 1 --2- 172.21.15.73:0/106935797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 0x7f7ba80cd0b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7b980097c0 tx=0x7f7b9801c410 comp rx=0 tx=0).stop 2024-04-15T15:33:39.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7bae200640 1 -- 172.21.15.73:0/106935797 shutdown_connections 2024-04-15T15:33:39.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7bae200640 1 --2- 172.21.15.73:0/106935797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba80d1f30 0x7f7ba80cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7bae200640 1 --2- 172.21.15.73:0/106935797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 0x7f7ba80cd0b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7bae200640 1 -- 172.21.15.73:0/106935797 >> 172.21.15.73:0/106935797 conn(0x7f7ba80d1410 msgr2=0x7f7ba80d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:39.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7bae200640 1 -- 172.21.15.73:0/106935797 shutdown_connections 2024-04-15T15:33:39.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.504+0000 7f7bae200640 1 -- 172.21.15.73:0/106935797 wait complete. 2024-04-15T15:33:39.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7bae200640 1 Processor -- start 2024-04-15T15:33:39.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7bae200640 1 -- start start 2024-04-15T15:33:39.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7bae200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba806ba50 0x7f7ba8158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7bae200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 0x7f7ba8159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7bae200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ba80d1f30 0x7f7ba8155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7bae200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba8169980 con 0x7f7ba80d0390 2024-04-15T15:33:39.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7bae200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba8169800 con 0x7f7ba80d1f30 2024-04-15T15:33:39.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7bae200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba8169b00 con 0x7f7ba806ba50 2024-04-15T15:33:39.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba6a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 0x7f7ba8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba6a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 0x7f7ba8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54100/0 (socket says 172.21.15.73:54100) 2024-04-15T15:33:39.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba6a00640 1 -- 172.21.15.73:0/3844671010 learned_addr learned my addr 172.21.15.73:0/3844671010 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:39.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba7e00640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ba80d1f30 0x7f7ba8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba7400640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba806ba50 0x7f7ba8158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba6a00640 1 -- 172.21.15.73:0/3844671010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba806ba50 msgr2=0x7f7ba8158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba6a00640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba806ba50 0x7f7ba8158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba6a00640 1 -- 172.21.15.73:0/3844671010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ba80d1f30 msgr2=0x7f7ba8155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba6a00640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ba80d1f30 0x7f7ba8155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba6a00640 1 -- 172.21.15.73:0/3844671010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba8158590 con 0x7f7ba80d0390 2024-04-15T15:33:39.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba7e00640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ba80d1f30 0x7f7ba8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:39.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba7400640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba806ba50 0x7f7ba8158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:39.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7ba6a00640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 0x7f7ba8159900 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7b980ae040 tx=0x7f7b980191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:39.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7b9f400640 1 -- 172.21.15.73:0/3844671010 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b980b8020 con 0x7f7ba80d0390 2024-04-15T15:33:39.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7b9f400640 1 -- 172.21.15.73:0/3844671010 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b980b4410 con 0x7f7ba80d0390 2024-04-15T15:33:39.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7b9f400640 1 -- 172.21.15.73:0/3844671010 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b980b0040 con 0x7f7ba80d0390 2024-04-15T15:33:39.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7bae200640 1 -- 172.21.15.73:0/3844671010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba8158860 con 0x7f7ba80d0390 2024-04-15T15:33:39.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.508+0000 7f7bae200640 1 -- 172.21.15.73:0/3844671010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba8158e20 con 0x7f7ba80d0390 2024-04-15T15:33:39.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.512+0000 7f7bae200640 1 -- 172.21.15.73:0/3844671010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba8068ab0 con 0x7f7ba80d0390 2024-04-15T15:33:39.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.512+0000 7f7b9f400640 1 -- 172.21.15.73:0/3844671010 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f7b980bb020 con 0x7f7ba80d0390 2024-04-15T15:33:39.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.512+0000 7f7b9f400640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b84068410 0x7f7b8406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:39.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.512+0000 7f7b9f400640 1 -- 172.21.15.73:0/3844671010 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f7b98120620 con 0x7f7ba80d0390 2024-04-15T15:33:39.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.512+0000 7f7ba7400640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b84068410 0x7f7b8406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:39.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.512+0000 7f7ba7400640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b84068410 0x7f7b8406a8d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7b90000f70 tx=0x7f7b90007c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:39.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.516+0000 7f7b9f400640 1 -- 172.21.15.73:0/3844671010 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b980c2030 con 0x7f7ba80d0390 2024-04-15T15:33:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.672+0000 7f7bae200640 1 -- 172.21.15.73:0/3844671010 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ba806e650 con 0x7f7b84068410 2024-04-15T15:33:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.672+0000 7f7b9f400640 1 -- 172.21.15.73:0/3844671010 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13361 (secure 0 0 0) 0x7f7ba806e650 con 0x7f7b84068410 2024-04-15T15:33:39.674 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:33:39.675 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:33:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 -- 172.21.15.73:0/3844671010 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b84068410 msgr2=0x7f7b8406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b84068410 0x7f7b8406a8d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7b90000f70 tx=0x7f7b90007c40 comp rx=0 tx=0).stop 2024-04-15T15:33:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 -- 172.21.15.73:0/3844671010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 msgr2=0x7f7ba8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 0x7f7ba8159900 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7b980ae040 tx=0x7f7b980191b0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 -- 172.21.15.73:0/3844671010 shutdown_connections 2024-04-15T15:33:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ba80d1f30 0x7f7ba8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ba80d0390 0x7f7ba8159900 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f7b84068410 0x7f7b8406a8d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 --2- 172.21.15.73:0/3844671010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ba806ba50 0x7f7ba8158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 -- 172.21.15.73:0/3844671010 >> 172.21.15.73:0/3844671010 conn(0x7f7ba80d1410 msgr2=0x7f7ba80b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 -- 172.21.15.73:0/3844671010 shutdown_connections 2024-04-15T15:33:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:39.676+0000 7f7bae200640 1 -- 172.21.15.73:0/3844671010 wait complete. 2024-04-15T15:33:39.695 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-04-15T15:33:39.381648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238152,"kb_used_data":5320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736568,"statfs":{"total":773094113280,"available":772850245632,"internally_reserved":0,"allocated":5447680,"data_stored":3046648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-133,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001424"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-15T15:33:29.692005+0000","last_change":"2024-04-15T15:31:23.443687+0000","last_active":"2024-04-15T15:33:29.692005+0000","last_peered":"2024-04-15T15:33:29.692005+0000","last_clean":"2024-04-15T15:33:29.692005+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:33:29.692005+0000","last_undegraded":"2024-04-15T15:33:29.692005+0000","last_fullsized":"2024-04-15T15:33:29.692005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:31:22.092427+0000","last_clean_scrub_stamp":"2024-04-15T15:31:22.092427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:28:43.096549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1126400,"data_stored":823607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1126400,"data_stored":823607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:33:39.698 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-15T15:31:22.092427+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=31, tm_sec=22, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=33, tm_sec=34, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:33:39.698 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-15T15:33:59.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:33:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.844+0000 7f2906200640 1 Processor -- start 2024-04-15T15:33:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.844+0000 7f2906200640 1 -- start start 2024-04-15T15:33:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f2906200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f29000b27c0 0x7f290015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f2906200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29000b3e30 0x7f29000b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f2906200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2900070160 con 0x7f290015b5d0 2024-04-15T15:33:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f2906200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f290015b9b0 con 0x7f29000b3e30 2024-04-15T15:33:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f2906200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f290015f1f0 con 0x7f29000b27c0 2024-04-15T15:33:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f28ffe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29000b3e30 0x7f29000b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f28ffe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29000b3e30 0x7f29000b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54304/0 (socket says 172.21.15.73:54304) 2024-04-15T15:33:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f28ffe00640 1 -- 172.21.15.73:0/138821073 learned_addr learned my addr 172.21.15.73:0/138821073 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f28fea00640 1 --2- 172.21.15.73:0/138821073 >> v2:172.21.15.118:3300/0 conn(0x7f29000b27c0 0x7f290015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f28ffe00640 1 -- 172.21.15.73:0/138821073 >> v2:172.21.15.118:3300/0 conn(0x7f29000b27c0 msgr2=0x7f290015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f28ffe00640 1 --2- 172.21.15.73:0/138821073 >> v2:172.21.15.118:3300/0 conn(0x7f29000b27c0 0x7f290015fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f28ffe00640 1 -- 172.21.15.73:0/138821073 >> v1:172.21.15.118:6789/0 conn(0x7f290015b5d0 legacy=0x7f29000b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:33:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f28ffe00640 1 -- 172.21.15.73:0/138821073 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290006fe80 con 0x7f29000b3e30 2024-04-15T15:33:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f28fea00640 1 --2- 172.21.15.73:0/138821073 >> v2:172.21.15.118:3300/0 conn(0x7f29000b27c0 0x7f290015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:33:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.848+0000 7f28ffe00640 1 --2- 172.21.15.73:0/138821073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b3e30 0x7f29000b4740 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f29000b2c50 tx=0x7f28f801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3dd70898ed3708 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:59.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f28fe000640 1 -- 172.21.15.73:0/138821073 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80090d0 con 0x7f29000b3e30 2024-04-15T15:33:59.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f28fe000640 1 -- 172.21.15.73:0/138821073 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f80a5720 con 0x7f29000b3e30 2024-04-15T15:33:59.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f28fe000640 1 -- 172.21.15.73:0/138821073 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8009270 con 0x7f29000b3e30 2024-04-15T15:33:59.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 -- 172.21.15.73:0/138821073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b3e30 msgr2=0x7f29000b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:59.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 --2- 172.21.15.73:0/138821073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b3e30 0x7f29000b4740 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f29000b2c50 tx=0x7f28f801c860 comp rx=0 tx=0).stop 2024-04-15T15:33:59.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 -- 172.21.15.73:0/138821073 shutdown_connections 2024-04-15T15:33:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 --2- 172.21.15.73:0/138821073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b3e30 0x7f29000b4740 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 --2- 172.21.15.73:0/138821073 >> v2:172.21.15.118:3300/0 conn(0x7f29000b27c0 0x7f290015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 -- 172.21.15.73:0/138821073 >> 172.21.15.73:0/138821073 conn(0x7f2900067dd0 msgr2=0x7f29000d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:33:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 -- 172.21.15.73:0/138821073 shutdown_connections 2024-04-15T15:33:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 -- 172.21.15.73:0/138821073 wait complete. 2024-04-15T15:33:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 Processor -- start 2024-04-15T15:33:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 -- start start 2024-04-15T15:33:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b27c0 0x7f2900159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29000b3e30 0x7f29000b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f290015b5d0 0x7f29000b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f290006faa0 con 0x7f29000b27c0 2024-04-15T15:33:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f29000b4240 con 0x7f29000b3e30 2024-04-15T15:33:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f2906200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f290006fc20 con 0x7f290015b5d0 2024-04-15T15:33:59.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f28ff400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b27c0 0x7f2900159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:59.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f28ff400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b27c0 0x7f2900159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54310/0 (socket says 172.21.15.73:54310) 2024-04-15T15:33:59.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f28ff400640 1 -- 172.21.15.73:0/124539653 learned_addr learned my addr 172.21.15.73:0/124539653 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:33:59.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f28fea00640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29000b3e30 0x7f29000b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:59.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.852+0000 7f28ffe00640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f290015b5d0 0x7f29000b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:59.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28ff400640 1 -- 172.21.15.73:0/124539653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f290015b5d0 msgr2=0x7f29000b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:59.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28ff400640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f290015b5d0 0x7f29000b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:59.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28ff400640 1 -- 172.21.15.73:0/124539653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29000b3e30 msgr2=0x7f29000b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:33:59.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28ff400640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29000b3e30 0x7f29000b0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:33:59.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28ff400640 1 -- 172.21.15.73:0/124539653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29001557d0 con 0x7f29000b27c0 2024-04-15T15:33:59.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28ff400640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b27c0 0x7f2900159ce0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f28e800c450 tx=0x7f28e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:59.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28f7400640 1 -- 172.21.15.73:0/124539653 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8012830 con 0x7f29000b27c0 2024-04-15T15:33:59.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28f7400640 1 -- 172.21.15.73:0/124539653 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e8017070 con 0x7f29000b27c0 2024-04-15T15:33:59.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f2906200640 1 -- 172.21.15.73:0/124539653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290015a730 con 0x7f29000b27c0 2024-04-15T15:33:59.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28f7400640 1 -- 172.21.15.73:0/124539653 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8012c30 con 0x7f29000b27c0 2024-04-15T15:33:59.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f2906200640 1 -- 172.21.15.73:0/124539653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2900155a90 con 0x7f29000b27c0 2024-04-15T15:33:59.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f2906200640 1 -- 172.21.15.73:0/124539653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2900068ab0 con 0x7f29000b27c0 2024-04-15T15:33:59.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28f7400640 1 -- 172.21.15.73:0/124539653 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f28e801c460 con 0x7f29000b27c0 2024-04-15T15:33:59.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28f7400640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f28dc068410 0x7f28dc06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:33:59.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28f7400640 1 -- 172.21.15.73:0/124539653 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f28e8086570 con 0x7f29000b27c0 2024-04-15T15:33:59.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.856+0000 7f28fea00640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f28dc068410 0x7f28dc06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:33:59.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.860+0000 7f28fea00640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f28dc068410 0x7f28dc06a8d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f29000cd440 tx=0x7f28f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:33:59.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:33:59.864+0000 7f28f7400640 1 -- 172.21.15.73:0/124539653 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f28e80565a0 con 0x7f29000b27c0 2024-04-15T15:34:00.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.020+0000 7f2906200640 1 -- 172.21.15.73:0/124539653 --> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f290015ac50 con 0x7f28dc068410 2024-04-15T15:34:00.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.020+0000 7f28f7400640 1 -- 172.21.15.73:0/124539653 <== mgr.4107 v2:172.21.15.73:6832/1395331382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7f28f00108a0 con 0x7f28dc068410 2024-04-15T15:34:00.022 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:34:00.023 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-15T15:34:00.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 -- 172.21.15.73:0/124539653 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f28dc068410 msgr2=0x7f28dc06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f28dc068410 0x7f28dc06a8d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f29000cd440 tx=0x7f28f0008040 comp rx=0 tx=0).stop 2024-04-15T15:34:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 -- 172.21.15.73:0/124539653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b27c0 msgr2=0x7f2900159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b27c0 0x7f2900159ce0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f28e800c450 tx=0x7f28e800c910 comp rx=0 tx=0).stop 2024-04-15T15:34:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 -- 172.21.15.73:0/124539653 shutdown_connections 2024-04-15T15:34:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f28dc068410 0x7f28dc06a8d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f290015b5d0 0x7f29000b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29000b3e30 0x7f29000b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 --2- 172.21.15.73:0/124539653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29000b27c0 0x7f2900159ce0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 -- 172.21.15.73:0/124539653 >> 172.21.15.73:0/124539653 conn(0x7f2900067dd0 msgr2=0x7f2900071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:34:00.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 -- 172.21.15.73:0/124539653 shutdown_connections 2024-04-15T15:34:00.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.024+0000 7f2906200640 1 -- 172.21.15.73:0/124539653 wait complete. 2024-04-15T15:34:00.045 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2024-04-15T15:33:59.385988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238136,"kb_used_data":5320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736584,"statfs":{"total":773094113280,"available":772850262016,"internally_reserved":0,"allocated":5447680,"data_stored":3046648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002717"},"pg_stats":[{"pgid":"1.0","version":"45'119","reported_seq":230,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-15T15:33:39.632577+0000","last_change":"2024-04-15T15:33:39.632620+0000","last_active":"2024-04-15T15:33:39.632577+0000","last_peered":"2024-04-15T15:33:39.632577+0000","last_clean":"2024-04-15T15:33:39.632577+0000","last_became_active":"2024-04-15T15:31:23.442360+0000","last_became_peered":"2024-04-15T15:31:23.442360+0000","last_unstale":"2024-04-15T15:33:39.632577+0000","last_undegraded":"2024-04-15T15:33:39.632577+0000","last_fullsized":"2024-04-15T15:33:39.632577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'119","last_scrub_stamp":"2024-04-15T15:33:39.632488+0000","last_deep_scrub":"45'119","last_deep_scrub_stamp":"2024-04-15T15:33:39.632488+0000","last_clean_scrub_stamp":"2024-04-15T15:33:39.632488+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:38:58.555782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1126400,"data_stored":823607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31704,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":233239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1126400,"data_stored":823607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:34:00.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-15T15:34:00.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.180+0000 7f1edca00640 1 Processor -- start 2024-04-15T15:34:00.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.180+0000 7f1edca00640 1 -- start start 2024-04-15T15:34:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1edca00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed806db70 0x7f1ed8169600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1edca00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed80d0c40 con 0x7f1ed80d07a0 2024-04-15T15:34:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1edca00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed80d0f20 con 0x7f1ed809aa60 2024-04-15T15:34:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1edca00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed80d1200 con 0x7f1ed806db70 2024-04-15T15:34:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1ed5400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1ed80d07a0 0x7f1ed809ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44910/0 (socket says 172.21.15.73:44910) 2024-04-15T15:34:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1ed5400640 1 -- 172.21.15.73:0/1544617069 learned_addr learned my addr 172.21.15.73:0/1544617069 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-04-15T15:34:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1ed6800640 1 --2- 172.21.15.73:0/1544617069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed806db70 0x7f1ed8169600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1ed4a00640 1 -- 172.21.15.73:0/1544617069 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741940820 0 0) 0x7f1ed80d0c40 con 0x7f1ed80d07a0 2024-04-15T15:34:00.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1ed4a00640 1 -- 172.21.15.73:0/1544617069 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ebc003530 con 0x7f1ed80d07a0 2024-04-15T15:34:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1ed4a00640 1 -- 172.21.15.73:0/1544617069 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148084520 0 0) 0x7f1ed80d0f20 con 0x7f1ed809aa60 2024-04-15T15:34:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1ed4a00640 1 -- 172.21.15.73:0/1544617069 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ed80d0c40 con 0x7f1ed809aa60 2024-04-15T15:34:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1ed6800640 1 -- 172.21.15.73:0/1544617069 >> v1:172.21.15.118:6789/0 conn(0x7f1ed809aa60 legacy=0x7f1ed815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1ed6800640 1 -- 172.21.15.73:0/1544617069 >> v1:172.21.15.73:6789/0 conn(0x7f1ed80d07a0 legacy=0x7f1ed809ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.184+0000 7f1ed6800640 1 -- 172.21.15.73:0/1544617069 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed80d14e0 con 0x7f1ed806db70 2024-04-15T15:34:00.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1ed6800640 1 --2- 172.21.15.73:0/1544617069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed806db70 0x7f1ed8169600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009dc0 tx=0x7f1ed001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dc39972d211ed14 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:34:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1ed4a00640 1 -- 172.21.15.73:0/1544617069 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed00b2070 con 0x7f1ed806db70 2024-04-15T15:34:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1ed4a00640 1 -- 172.21.15.73:0/1544617069 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed00a5a40 con 0x7f1ed806db70 2024-04-15T15:34:00.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1ed4a00640 1 -- 172.21.15.73:0/1544617069 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed00a5e10 con 0x7f1ed806db70 2024-04-15T15:34:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 -- 172.21.15.73:0/1544617069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed806db70 msgr2=0x7f1ed8169600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 --2- 172.21.15.73:0/1544617069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed806db70 0x7f1ed8169600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009dc0 tx=0x7f1ed001c960 comp rx=0 tx=0).stop 2024-04-15T15:34:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 -- 172.21.15.73:0/1544617069 shutdown_connections 2024-04-15T15:34:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 --2- 172.21.15.73:0/1544617069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed806db70 0x7f1ed8169600 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 -- 172.21.15.73:0/1544617069 >> 172.21.15.73:0/1544617069 conn(0x7f1ed80b4050 msgr2=0x7f1ed80b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:34:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 -- 172.21.15.73:0/1544617069 shutdown_connections 2024-04-15T15:34:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 -- 172.21.15.73:0/1544617069 wait complete. 2024-04-15T15:34:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 Processor -- start 2024-04-15T15:34:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 -- start start 2024-04-15T15:34:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ed806db70 0x7f1ed8156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed809aa60 0x7f1ed80cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ed80d07a0 0x7f1ed80afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed816c770 con 0x7f1ed806db70 2024-04-15T15:34:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed80b1e00 con 0x7f1ed80d07a0 2024-04-15T15:34:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.188+0000 7f1edca00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed816c8f0 con 0x7f1ed809aa60 2024-04-15T15:34:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ed806db70 0x7f1ed8156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ed806db70 0x7f1ed8156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54326/0 (socket says 172.21.15.73:54326) 2024-04-15T15:34:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed5e00640 1 -- 172.21.15.73:0/1767114695 learned_addr learned my addr 172.21.15.73:0/1767114695 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:34:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed5400640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed809aa60 0x7f1ed80cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed6800640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ed80d07a0 0x7f1ed80afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed5e00640 1 -- 172.21.15.73:0/1767114695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed809aa60 msgr2=0x7f1ed80cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed5e00640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed809aa60 0x7f1ed80cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed5e00640 1 -- 172.21.15.73:0/1767114695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ed80d07a0 msgr2=0x7f1ed80afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed5e00640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ed80d07a0 0x7f1ed80afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed5e00640 1 -- 172.21.15.73:0/1767114695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed80b5fb0 con 0x7f1ed806db70 2024-04-15T15:34:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed6800640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ed80d07a0 0x7f1ed80afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T15:34:00.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ed5e00640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ed806db70 0x7f1ed8156320 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800c4c0 tx=0x7f1ec800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:34:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ece000640 1 -- 172.21.15.73:0/1767114695 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80052d0 con 0x7f1ed806db70 2024-04-15T15:34:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ece000640 1 -- 172.21.15.73:0/1767114695 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec8005470 con 0x7f1ed806db70 2024-04-15T15:34:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ece000640 1 -- 172.21.15.73:0/1767114695 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8012870 con 0x7f1ed806db70 2024-04-15T15:34:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1edca00640 1 -- 172.21.15.73:0/1767114695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed80b6290 con 0x7f1ed806db70 2024-04-15T15:34:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1edca00640 1 -- 172.21.15.73:0/1767114695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed80b6850 con 0x7f1ed806db70 2024-04-15T15:34:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1edca00640 1 -- 172.21.15.73:0/1767114695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed8068ab0 con 0x7f1ed806db70 2024-04-15T15:34:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.192+0000 7f1ece000640 1 -- 172.21.15.73:0/1767114695 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f1ec8012a10 con 0x7f1ed806db70 2024-04-15T15:34:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.196+0000 7f1ece000640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1eb8068410 0x7f1eb806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.196+0000 7f1ece000640 1 -- 172.21.15.73:0/1767114695 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f1ec8086530 con 0x7f1ed806db70 2024-04-15T15:34:00.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.196+0000 7f1ed5400640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1eb8068410 0x7f1eb806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.196+0000 7f1ed5400640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1eb8068410 0x7f1eb806a8d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8162bc0 tx=0x7f1ec4007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:34:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.200+0000 7f1ece000640 1 -- 172.21.15.73:0/1767114695 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ec8056bb0 con 0x7f1ed806db70 2024-04-15T15:34:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.356+0000 7f1edca00640 1 -- 172.21.15.73:0/1767114695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1ed80b4b70 con 0x7f1ed806db70 2024-04-15T15:34:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.360+0000 7f1ece000640 1 -- 172.21.15.73:0/1767114695 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7f1ec80564b0 con 0x7f1ed806db70 2024-04-15T15:34:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.360+0000 7f1ece000640 1 -- 172.21.15.73:0/1767114695 <== mon.0 v2:172.21.15.73:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ec805a860 con 0x7f1ed806db70 2024-04-15T15:34:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 -- 172.21.15.73:0/1767114695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1eb8068410 msgr2=0x7f1eb806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1eb8068410 0x7f1eb806a8d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8162bc0 tx=0x7f1ec4007d40 comp rx=0 tx=0).stop 2024-04-15T15:34:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 -- 172.21.15.73:0/1767114695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ed806db70 msgr2=0x7f1ed8156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ed806db70 0x7f1ed8156320 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800c4c0 tx=0x7f1ec800c980 comp rx=0 tx=0).stop 2024-04-15T15:34:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 -- 172.21.15.73:0/1767114695 shutdown_connections 2024-04-15T15:34:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ed80d07a0 0x7f1ed80afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f1eb8068410 0x7f1eb806a8d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ed809aa60 0x7f1ed80cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 --2- 172.21.15.73:0/1767114695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ed806db70 0x7f1ed8156320 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 -- 172.21.15.73:0/1767114695 >> 172.21.15.73:0/1767114695 conn(0x7f1ed80b4050 msgr2=0x7f1ed809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:34:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 -- 172.21.15.73:0/1767114695 shutdown_connections 2024-04-15T15:34:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.364+0000 7f1edca00640 1 -- 172.21.15.73:0/1767114695 wait complete. 2024-04-15T15:34:00.385 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-15T15:34:00.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T15:34:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8afa200640 1 Processor -- start 2024-04-15T15:34:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8afa200640 1 -- start start 2024-04-15T15:34:00.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8afa200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8af40b20b0 0x7f8af40b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8afa200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8af415cbd0 0x7f8af415d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8afa200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af40cd3a0 con 0x7f8af4146110 2024-04-15T15:34:00.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8afa200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f8af40b5160 con 0x7f8af40b20b0 2024-04-15T15:34:00.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8afa200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8af40b40c0 con 0x7f8af415cbd0 2024-04-15T15:34:00.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8af2a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8af40b20b0 0x7f8af40b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8af2a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8af40b20b0 0x7f8af40b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.73:42636/0 (socket says 172.21.15.73:42636) 2024-04-15T15:34:00.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8af3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8af415cbd0 0x7f8af415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8af2a00640 1 -- 172.21.15.73:0/699504087 learned_addr learned my addr 172.21.15.73:0/699504087 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:34:00.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8af2a00640 1 -- 172.21.15.73:0/699504087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8af415cbd0 msgr2=0x7f8af415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:34:00.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8af2a00640 1 --2- 172.21.15.73:0/699504087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8af415cbd0 0x7f8af415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8af2a00640 1 -- 172.21.15.73:0/699504087 >> v1:172.21.15.118:6789/0 conn(0x7f8af4146110 legacy=0x7f8af40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.524+0000 7f8af2a00640 1 -- 172.21.15.73:0/699504087 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af40b43a0 con 0x7f8af40b20b0 2024-04-15T15:34:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8af2a00640 1 --2- 172.21.15.73:0/699504087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b20b0 0x7f8af40b2530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009870 tx=0x7f8ae001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd238890fb2b0fd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:34:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8af2000640 1 -- 172.21.15.73:0/699504087 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00ab650 con 0x7f8af40b20b0 2024-04-15T15:34:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8af2000640 1 -- 172.21.15.73:0/699504087 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8ae00b0070 con 0x7f8af40b20b0 2024-04-15T15:34:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8af2000640 1 -- 172.21.15.73:0/699504087 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00aba30 con 0x7f8af40b20b0 2024-04-15T15:34:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8afa200640 1 -- 172.21.15.73:0/699504087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b20b0 msgr2=0x7f8af40b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8afa200640 1 --2- 172.21.15.73:0/699504087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b20b0 0x7f8af40b2530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009870 tx=0x7f8ae001c560 comp rx=0 tx=0).stop 2024-04-15T15:34:00.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8afa200640 1 -- 172.21.15.73:0/699504087 shutdown_connections 2024-04-15T15:34:00.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8afa200640 1 --2- 172.21.15.73:0/699504087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8af415cbd0 0x7f8af415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8afa200640 1 --2- 172.21.15.73:0/699504087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b20b0 0x7f8af40b2530 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8afa200640 1 -- 172.21.15.73:0/699504087 >> 172.21.15.73:0/699504087 conn(0x7f8af4067dd0 msgr2=0x7f8af40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:34:00.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8afa200640 1 -- 172.21.15.73:0/699504087 shutdown_connections 2024-04-15T15:34:00.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8afa200640 1 -- 172.21.15.73:0/699504087 wait complete. 2024-04-15T15:34:00.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.528+0000 7f8afa200640 1 Processor -- start 2024-04-15T15:34:00.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8afa200640 1 -- start start 2024-04-15T15:34:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8afa200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8af40b20b0 0x7f8af40ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8afa200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af4146110 0x7f8af415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8afa200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af415cbd0 0x7f8af413a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8afa200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8af4169210 con 0x7f8af4146110 2024-04-15T15:34:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8afa200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8af40b3d70 con 0x7f8af415cbd0 2024-04-15T15:34:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8afa200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8af4169390 con 0x7f8af40b20b0 2024-04-15T15:34:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af2a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af4146110 0x7f8af415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af2a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af4146110 0x7f8af415b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54342/0 (socket says 172.21.15.73:54342) 2024-04-15T15:34:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af2a00640 1 -- 172.21.15.73:0/598658814 learned_addr learned my addr 172.21.15.73:0/598658814 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-04-15T15:34:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af3400640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8af40b20b0 0x7f8af40ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af3e00640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af415cbd0 0x7f8af413a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af2a00640 1 -- 172.21.15.73:0/598658814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8af40b20b0 msgr2=0x7f8af40ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af2a00640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8af40b20b0 0x7f8af40ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af2a00640 1 -- 172.21.15.73:0/598658814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af415cbd0 msgr2=0x7f8af413a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af2a00640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af415cbd0 0x7f8af413a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af2a00640 1 -- 172.21.15.73:0/598658814 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af406e4f0 con 0x7f8af4146110 2024-04-15T15:34:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8af2a00640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af4146110 0x7f8af415b170 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00ad040 tx=0x7f8ae001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:34:00.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8aeb400640 1 -- 172.21.15.73:0/598658814 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00be5f0 con 0x7f8af4146110 2024-04-15T15:34:00.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8aeb400640 1 -- 172.21.15.73:0/598658814 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8ae00be7b0 con 0x7f8af4146110 2024-04-15T15:34:00.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8aeb400640 1 -- 172.21.15.73:0/598658814 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00bebc0 con 0x7f8af4146110 2024-04-15T15:34:00.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8afa200640 1 -- 172.21.15.73:0/598658814 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af406ea80 con 0x7f8af4146110 2024-04-15T15:34:00.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8afa200640 1 -- 172.21.15.73:0/598658814 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af406f040 con 0x7f8af4146110 2024-04-15T15:34:00.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.532+0000 7f8afa200640 1 -- 172.21.15.73:0/598658814 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af4068ab0 con 0x7f8af4146110 2024-04-15T15:34:00.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.536+0000 7f8aeb400640 1 -- 172.21.15.73:0/598658814 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f8ae00b43f0 con 0x7f8af4146110 2024-04-15T15:34:00.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.536+0000 7f8aeb400640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ad4068410 0x7f8ad406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T15:34:00.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.536+0000 7f8aeb400640 1 -- 172.21.15.73:0/598658814 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f8ae0121440 con 0x7f8af4146110 2024-04-15T15:34:00.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.536+0000 7f8af3400640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ad4068410 0x7f8ad406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T15:34:00.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.536+0000 7f8af3400640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ad4068410 0x7f8ad406a8d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4001810 tx=0x7f8ae4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T15:34:00.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.540+0000 7f8aeb400640 1 -- 172.21.15.73:0/598658814 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ae0016150 con 0x7f8af4146110 2024-04-15T15:34:00.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.732+0000 7f8afa200640 1 -- 172.21.15.73:0/598658814 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8af406e860 con 0x7f8af4146110 2024-04-15T15:34:00.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.732+0000 7f8aeb400640 1 -- 172.21.15.73:0/598658814 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+3872 (secure 0 0 0) 0x7f8ae00f1350 con 0x7f8af4146110 2024-04-15T15:34:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-15T15:34:00.735 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1201649894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1201649894},{"type":"v1","addr":"172.21.15.73:6837","nonce":1201649894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/326969724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":326969724},{"type":"v1","addr":"172.21.15.118:6834","nonce":326969724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4095609152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4095609152},{"type":"v1","addr":"172.21.15.118:6835","nonce":4095609152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5955,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2291788853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2291788853},{"type":"v1","addr":"172.21.15.73:6836","nonce":2291788853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[]} 2024-04-15T15:34:00.735 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 26 2024-04-15T15:34:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 -- 172.21.15.73:0/598658814 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ad4068410 msgr2=0x7f8ad406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ad4068410 0x7f8ad406a8d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4001810 tx=0x7f8ae4009040 comp rx=0 tx=0).stop 2024-04-15T15:34:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 -- 172.21.15.73:0/598658814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af4146110 msgr2=0x7f8af415b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:34:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af4146110 0x7f8af415b170 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00ad040 tx=0x7f8ae001ada0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 -- 172.21.15.73:0/598658814 shutdown_connections 2024-04-15T15:34:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af415cbd0 0x7f8af413a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af4146110 0x7f8af415b170 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.73:6832/1395331382,v1:172.21.15.73:6833/1395331382] conn(0x7f8ad4068410 0x7f8ad406a8d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 --2- 172.21.15.73:0/598658814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8af40b20b0 0x7f8af40ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T15:34:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 -- 172.21.15.73:0/598658814 >> 172.21.15.73:0/598658814 conn(0x7f8af4067dd0 msgr2=0x7f8af40b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:34:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 -- 172.21.15.73:0/598658814 shutdown_connections 2024-04-15T15:34:00.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-15T15:34:00.736+0000 7f8afa200640 1 -- 172.21.15.73:0/598658814 wait complete. 2024-04-15T15:34:00.756 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-15T15:34:00.756 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-15T15:34:00.756 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-15T15:34:00.757 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:00.770 INFO:tasks.ceph.mds.a:Stopped 2024-04-15T15:34:00.770 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-15T15:34:00.770 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:00.825 INFO:tasks.ceph.mds.c:Stopped 2024-04-15T15:34:00.826 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-15T15:34:00.826 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:00.839 INFO:tasks.ceph.mds.b:Stopped 2024-04-15T15:34:00.840 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-15T15:34:00.840 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:00.895 INFO:tasks.ceph.mds.d:Stopped 2024-04-15T15:34:00.896 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-15T15:34:00.896 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-15T15:34:00.896 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:00.993 INFO:tasks.ceph.osd.0:Stopped 2024-04-15T15:34:00.993 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-15T15:34:00.993 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:03.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-15T15:34:03.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:34:03.408 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:34:07.095 INFO:tasks.ceph.osd.1:Stopped 2024-04-15T15:34:07.095 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-15T15:34:07.095 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:09.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-15T15:34:09.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-15T15:34:13.197 INFO:tasks.ceph.osd.2:Stopped 2024-04-15T15:34:13.198 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-15T15:34:13.198 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:13.260 INFO:tasks.ceph.osd.3:Stopped 2024-04-15T15:34:13.260 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-15T15:34:13.260 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:13.323 INFO:tasks.ceph.osd.4:Stopped 2024-04-15T15:34:13.324 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-15T15:34:13.324 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:13.424 INFO:tasks.ceph.osd.5:Stopped 2024-04-15T15:34:13.424 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-15T15:34:13.424 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:14.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-15T15:34:14.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-15T15:34:19.526 INFO:tasks.ceph.osd.6:Stopped 2024-04-15T15:34:19.527 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-15T15:34:19.527 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:19.605 INFO:tasks.ceph.osd.7:Stopped 2024-04-15T15:34:19.605 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-15T15:34:19.605 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-15T15:34:19.606 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:19.665 INFO:tasks.ceph.mgr.y:Stopped 2024-04-15T15:34:19.665 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-15T15:34:19.665 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:19.719 INFO:tasks.ceph.mgr.x:Stopped 2024-04-15T15:34:19.719 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-15T15:34:19.719 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-15T15:34:19.720 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:19.739 INFO:tasks.ceph.mon.a:Stopped 2024-04-15T15:34:19.739 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-15T15:34:19.739 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:19.756 INFO:tasks.ceph.mon.b:Stopped 2024-04-15T15:34:19.757 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-15T15:34:19.757 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:34:19.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-15T15:34:19.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-15T15:34:19.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-15T15:34:19.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-15T15:34:19.818 INFO:tasks.ceph.mon.c:Stopped 2024-04-15T15:34:19.818 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-15T15:34:19.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow request' | head -n 1 2024-04-15T15:34:19.852 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:34:19.852 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-15T15:34:20.120 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:34:20.120 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-15T15:34:20.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:34:20.316 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-15T15:34:20.508 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:34:20.508 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-15T15:34:20.693 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:34:20.693 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-15T15:34:20.952 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:34:20.953 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-15T15:34:21.169 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:34:21.170 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-15T15:34:21.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:34:21.337 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-15T15:34:21.520 INFO:tasks.ceph:Archiving mon data... 2024-04-15T15:34:21.521 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/data/mon.a.tgz 2024-04-15T15:34:21.521 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-15T15:34:21.530 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.M99XFB4Dm7 2024-04-15T15:34:21.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.M99XFB4Dm7 2024-04-15T15:34:21.658 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.M99XFB4Dm7 2024-04-15T15:34:21.732 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.M99XFB4Dm7 is 361KB 2024-04-15T15:34:21.797 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.M99XFB4Dm7 2024-04-15T15:34:21.805 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/data/mon.b.tgz 2024-04-15T15:34:21.805 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-04-15T15:34:21.815 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.YD9FXBQz6B 2024-04-15T15:34:21.815 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.YD9FXBQz6B 2024-04-15T15:34:21.967 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.YD9FXBQz6B 2024-04-15T15:34:22.044 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.YD9FXBQz6B is 483KB 2024-04-15T15:34:22.114 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.YD9FXBQz6B 2024-04-15T15:34:22.123 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/data/mon.c.tgz 2024-04-15T15:34:22.123 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-04-15T15:34:22.175 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.hDf7YNBJYT 2024-04-15T15:34:22.176 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.hDf7YNBJYT 2024-04-15T15:34:22.327 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.hDf7YNBJYT 2024-04-15T15:34:22.405 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.hDf7YNBJYT is 483KB 2024-04-15T15:34:22.474 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.hDf7YNBJYT 2024-04-15T15:34:22.483 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-15T15:34:22.483 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-15T15:34:22.486 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-15T15:34:22.555 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-15T15:34:22.592 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-15T15:34:22.592 INFO:tasks.ceph:Archiving crash dumps... 2024-04-15T15:34:22.594 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/remote/smithi073/crash 2024-04-15T15:34:22.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T15:34:22.619 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/remote/smithi118/crash 2024-04-15T15:34:22.620 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T15:34:22.653 INFO:tasks.ceph:Shutting down logrotate 2024-04-15T15:34:22.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:34:22.665 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T15:34:22.752 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-15T15:34:22.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-15T15:34:22.791 INFO:tasks.ceph:Compressing logs... 2024-04-15T15:34:22.791 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T15:34:22.817 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T15:34:22.844 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39153.log 2024-04-15T15:34:22.845 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35584.log 2024-04-15T15:34:22.846 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40924.log 2024-04-15T15:34:22.847 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39153.log.gz 2024-04-15T15:34:22.847 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36705.log 2024-04-15T15:34:22.847 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35584.log.gz 2024-04-15T15:34:22.849 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35144.log 2024-04-15T15:34:22.849 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40924.log.gz 2024-04-15T15:34:22.849 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37743.log 2024-04-15T15:34:22.850 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36705.log.gz 2024-04-15T15:34:22.851 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39935.log 2024-04-15T15:34:22.851 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35144.log.gz 2024-04-15T15:34:22.851 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27717.log 2024-04-15T15:34:22.851 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37743.log.gz 2024-04-15T15:34:22.853 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38198.log 2024-04-15T15:34:22.853 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39935.log.gz 2024-04-15T15:34:22.854 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37268.log 2024-04-15T15:34:22.854 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27717.log.gz 2024-04-15T15:34:22.855 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39803.log 2024-04-15T15:34:22.855 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38198.log.gz 2024-04-15T15:34:22.856 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40846.log 2024-04-15T15:34:22.856 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37268.log.gz 2024-04-15T15:34:22.856 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40768.log 2024-04-15T15:34:22.856 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39803.log.gz 2024-04-15T15:34:22.857 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33395.log 2024-04-15T15:34:22.857 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40846.log.gz 2024-04-15T15:34:22.858 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38067.log 2024-04-15T15:34:22.858 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40768.log.gz 2024-04-15T15:34:22.859 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38358.log 2024-04-15T15:34:22.859 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33395.log.gz 2024-04-15T15:34:22.859 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34148.log 2024-04-15T15:34:22.859 INFO:teuthology.orchestra.run.smithi073.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.38067.log.gz 2024-04-15T15:34:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40976.log 2024-04-15T15:34:22.861 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38358.log.gz 2024-04-15T15:34:22.861 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34148.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-15T15:34:22.862 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34148.log.gz 2024-04-15T15:34:22.862 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37639.log 2024-04-15T15:34:22.862 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40976.log.gz 2024-04-15T15:34:22.863 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40557.log 2024-04-15T15:34:22.863 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38410.log 2024-04-15T15:34:22.863 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37639.log.gz 2024-04-15T15:34:22.864 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32214.log 2024-04-15T15:34:22.865 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-15T15:34:22.866 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35992.log 2024-04-15T15:34:22.866 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40557.log.gz 2024-04-15T15:34:22.866 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41158.log 2024-04-15T15:34:22.866 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38410.log.gz 2024-04-15T15:34:22.866 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36679.log 2024-04-15T15:34:22.867 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35992.log.gz 2024-04-15T15:34:22.875 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33782.log 2024-04-15T15:34:22.875 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41158.log.gz 2024-04-15T15:34:22.876 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38436.log 2024-04-15T15:34:22.876 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36679.log.gz 2024-04-15T15:34:22.876 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39244.log 2024-04-15T15:34:22.876 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33782.log.gz 2024-04-15T15:34:22.876 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40898.log 2024-04-15T15:34:22.876 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38436.log.gz 2024-04-15T15:34:22.876 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36948.log 2024-04-15T15:34:22.877 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39244.log.gz 2024-04-15T15:34:22.877 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36549.log 2024-04-15T15:34:22.877 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40898.log.gz 2024-04-15T15:34:22.877 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36948.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-15T15:34:22.877 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36948.log.gz 2024-04-15T15:34:22.877 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40173.log 2024-04-15T15:34:22.877 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36549.log.gz 2024-04-15T15:34:22.878 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35132.log 2024-04-15T15:34:22.878 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.39291.log 2024-04-15T15:34:22.878 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40173.log.gz 2024-04-15T15:34:22.887 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.32214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32268.log 2024-04-15T15:34:22.887 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32214.log.gz 2024-04-15T15:34:22.887 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-15T15:34:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.32268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32268.log.gz 2024-04-15T15:34:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27734.log 2024-04-15T15:34:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.32312.log 2024-04-15T15:34:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.27734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.31998.log 2024-04-15T15:34:22.888 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27734.log.gz 2024-04-15T15:34:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.3.32312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.32312.log.gz 2024-04-15T15:34:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-15T15:34:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.31998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.31998.log.gz 2024-04-15T15:34:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27806.log 2024-04-15T15:34:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32219.log 2024-04-15T15:34:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.27806.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27806.log.gz 2024-04-15T15:34:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.32307.log 2024-04-15T15:34:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.32219.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-15T15:34:22.889 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32219.log.gz 2024-04-15T15:34:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.3.32307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.32307.log.gz 2024-04-15T15:34:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.32082.log 2024-04-15T15:34:22.890 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27686.log 2024-04-15T15:34:22.890 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.3.32082.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.3.32082.log.gz /var/log/ceph/ceph.log 2024-04-15T15:34:22.890 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-04-15T15:34:22.890 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.27686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27662.log 2024-04-15T15:34:22.890 INFO:teuthology.orchestra.run.smithi118.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27686.log.gz 2024-04-15T15:34:22.890 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27710.log 2024-04-15T15:34:22.890 INFO:teuthology.orchestra.run.smithi118.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-15T15:34:22.890 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.27662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27758.log 2024-04-15T15:34:22.891 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27662.log.gz 2024-04-15T15:34:22.891 INFO:teuthology.orchestra.run.smithi118.stderr: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-15T15:34:22.891 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.27710.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-15T15:34:22.891 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27710.log.gz 2024-04-15T15:34:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.27758.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-15T15:34:22.892 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27758.log.gz 2024-04-15T15:34:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-15T15:34:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.32087.log 2024-04-15T15:34:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32273.log 2024-04-15T15:34:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.3.32087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.32087.log.gz 2024-04-15T15:34:22.892 INFO:teuthology.orchestra.run.smithi118.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-15T15:34:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.32273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32273.log.gz 2024-04-15T15:34:22.893 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-15T15:34:22.894 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-15T15:34:22.894 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-15T15:34:22.894 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.b.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-15T15:34:22.901 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.31980.log 2024-04-15T15:34:22.902 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27638.log 2024-04-15T15:34:22.902 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.31980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27782.log 2024-04-15T15:34:22.902 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.31980.log.gz 2024-04-15T15:34:22.902 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.27638.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27638.log.gz 2024-04-15T15:34:22.904 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33204.log 2024-04-15T15:34:22.904 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35132.log.gz 2024-04-15T15:34:22.904 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.2.39291.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.2.39291.log.gz /var/log/ceph/ceph-client.admin.36497.log 2024-04-15T15:34:22.904 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-04-15T15:34:22.905 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40460.log 2024-04-15T15:34:22.905 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33204.log.gz 2024-04-15T15:34:22.905 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37109.log 2024-04-15T15:34:22.905 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36497.log.gz 2024-04-15T15:34:22.905 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41262.log 2024-04-15T15:34:22.905 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40460.log.gz 2024-04-15T15:34:22.905 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36869.log 2024-04-15T15:34:22.905 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37109.log.gz 2024-04-15T15:34:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41262.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41262.log.gz 2024-04-15T15:34:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40225.log 2024-04-15T15:34:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41184.log 2024-04-15T15:34:22.906 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36869.log.gz 2024-04-15T15:34:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36627.log 2024-04-15T15:34:22.906 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40225.log.gz 2024-04-15T15:34:22.906 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36341.log 2024-04-15T15:34:22.906 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41184.log.gz 2024-04-15T15:34:22.907 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39200.log 2024-04-15T15:34:22.907 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36627.log.gz 2024-04-15T15:34:22.907 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35454.log 2024-04-15T15:34:22.907 INFO:teuthology.orchestra.run.smithi073.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36341.log.gz 2024-04-15T15:34:22.907 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.39200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39200.log.gz 2024-04-15T15:34:22.907 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36078.log 2024-04-15T15:34:22.907 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35558.log 2024-04-15T15:34:22.907 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35454.log.gz 2024-04-15T15:34:22.907 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.2.36078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36078.log.gz 2024-04-15T15:34:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34200.log 2024-04-15T15:34:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35506.log 2024-04-15T15:34:22.908 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35558.log.gz 2024-04-15T15:34:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35119.log 2024-04-15T15:34:22.908 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34200.log.gz 2024-04-15T15:34:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35506.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35506.log.gzgzip 2024-04-15T15:34:22.908 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35139.log 2024-04-15T15:34:22.908 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-04-15T15:34:22.909 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35119.log.gz 2024-04-15T15:34:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.39296.log 2024-04-15T15:34:22.909 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35139.log.gz 2024-04-15T15:34:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38304.log 2024-04-15T15:34:22.909 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-04-15T15:34:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.2.39296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.39296.log.gz 2024-04-15T15:34:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-15T15:34:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36575.log 2024-04-15T15:34:22.910 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38304.log.gz 2024-04-15T15:34:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33585.log 2024-04-15T15:34:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33756.log 2024-04-15T15:34:22.910 INFO:teuthology.orchestra.run.smithi073.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.36575.log.gz 2024-04-15T15:34:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34931.log 2024-04-15T15:34:22.910 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33585.log.gz 2024-04-15T15:34:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33305.log 2024-04-15T15:34:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33756.log: /var/log/ceph/ceph-client.admin.34931.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33756.log.gz 2024-04-15T15:34:22.911 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34931.log.gz 2024-04-15T15:34:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40039.log 2024-04-15T15:34:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-client.admin.33305.log: --verbose -- /var/log/ceph/ceph-client.admin.35532.log 2024-04-15T15:34:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40039.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33305.log.gz 2024-04-15T15:34:22.911 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40039.log.gz 2024-04-15T15:34:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36367.log 2024-04-15T15:34:22.912 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.27782.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27782.log.gz 2024-04-15T15:34:22.915 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-client.admin.35532.log: --verbose -- /var/log/ceph/ceph-client.admin.27614.log 2024-04-15T15:34:22.915 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35532.log.gz 2024-04-15T15:34:22.915 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37455.log 2024-04-15T15:34:22.916 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36367.log.gz 2024-04-15T15:34:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34038.log 2024-04-15T15:34:22.916 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27614.log.gz 2024-04-15T15:34:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.37455.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39529.log 2024-04-15T15:34:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34038.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37455.log.gz 2024-04-15T15:34:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38787.log 2024-04-15T15:34:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39529.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.34038.log.gz 2024-04-15T15:34:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40381.log 2024-04-15T15:34:22.916 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39529.log.gz 2024-04-15T15:34:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37795.log 2024-04-15T15:34:22.917 INFO:teuthology.orchestra.run.smithi073.stderr: 92.0% 88.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-15T15:34:22.917 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38787.log.gz 2024-04-15T15:34:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39907.log 2024-04-15T15:34:22.917 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40381.log.gz 2024-04-15T15:34:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37795.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-15T15:34:22.917 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37795.log.gz 2024-04-15T15:34:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38813.log 2024-04-15T15:34:22.918 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39907.log.gz 2024-04-15T15:34:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34357.log 2024-04-15T15:34:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38813.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38813.log.gz 2024-04-15T15:34:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39961.log 2024-04-15T15:34:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-client.admin.34357.log: --verbose -- /var/log/ceph/ceph-client.admin.39309.log 2024-04-15T15:34:22.920 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34357.log.gz/var/log/ceph/ceph-client.admin.39961.log: 2024-04-15T15:34:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38172.log 2024-04-15T15:34:22.920 INFO:teuthology.orchestra.run.smithi073.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.39961.log.gz 2024-04-15T15:34:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39492.log 2024-04-15T15:34:22.921 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39309.log.gz 2024-04-15T15:34:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38172.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38172.log.gz 2024-04-15T15:34:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41002.log 2024-04-15T15:34:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40794.log 2024-04-15T15:34:22.922 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39492.log.gz 2024-04-15T15:34:22.923 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41002.log.gz 2024-04-15T15:34:22.923 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39585.log 2024-04-15T15:34:22.923 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37950.log 2024-04-15T15:34:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40794.log: /var/log/ceph/ceph-client.admin.39585.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40794.log.gz 2024-04-15T15:34:22.925 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.39585.log.gz -5 2024-04-15T15:34:22.925 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34936.log 2024-04-15T15:34:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34648.log 2024-04-15T15:34:22.926 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37950.log.gz 2024-04-15T15:34:22.927 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37403.log 2024-04-15T15:34:22.927 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34936.log.gz 2024-04-15T15:34:22.927 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37429.log 2024-04-15T15:34:22.928 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34648.log.gz 2024-04-15T15:34:22.929 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37403.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37403.log.gz 2024-04-15T15:34:22.929 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34726.log 2024-04-15T15:34:22.929 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35402.log 2024-04-15T15:34:22.930 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37429.log: /var/log/ceph/ceph-client.admin.34726.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37429.log.gz 2024-04-15T15:34:22.931 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34726.log.gz 2024-04-15T15:34:22.931 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38592.log 2024-04-15T15:34:22.931 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36809.log 2024-04-15T15:34:22.932 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35402.log.gz 2024-04-15T15:34:22.933 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38592.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38592.log.gz 2024-04-15T15:34:22.933 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33449.log 2024-04-15T15:34:22.933 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35120.log 2024-04-15T15:34:22.934 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36809.log: /var/log/ceph/ceph-client.admin.33449.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36809.log.gz 2024-04-15T15:34:22.935 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33449.log.gz 2024-04-15T15:34:22.935 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39772.log 2024-04-15T15:34:22.935 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.35120.log: -- /var/log/ceph/ceph-client.admin.34728.log 2024-04-15T15:34:22.936 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35120.log.gz 2024-04-15T15:34:22.937 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39772.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39772.log.gz 2024-04-15T15:34:22.937 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37509.log 2024-04-15T15:34:22.937 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38462.log 2024-04-15T15:34:22.938 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34728.log: /var/log/ceph/ceph-client.admin.37509.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34728.log.gz 2024-04-15T15:34:22.939 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33650.log 88.8% 2024-04-15T15:34:22.939 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37509.log.gz 2024-04-15T15:34:22.940 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39611.log 2024-04-15T15:34:22.940 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38462.log.gz 2024-04-15T15:34:22.941 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33650.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33650.log.gz 2024-04-15T15:34:22.941 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40121.log 2024-04-15T15:34:22.942 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41210.log 2024-04-15T15:34:22.943 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39611.log: /var/log/ceph/ceph-client.admin.40121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38120.log 2024-04-15T15:34:22.943 INFO:teuthology.orchestra.run.smithi073.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40121.log.gz 2024-04-15T15:34:22.944 INFO:teuthology.orchestra.run.smithi073.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.39611.log.gz 2024-04-15T15:34:22.944 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34622.log 2024-04-15T15:34:22.945 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41210.log.gz 2024-04-15T15:34:22.945 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34305.log 2024-04-15T15:34:22.945 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38120.log.gz 2024-04-15T15:34:22.946 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39746.log 2024-04-15T15:34:22.946 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34622.log.gz 2024-04-15T15:34:22.947 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39205.log 2024-04-15T15:34:22.947 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34305.log.gz 2024-04-15T15:34:22.948 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33423.log 2024-04-15T15:34:22.949 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39746.log.gz 2024-04-15T15:34:22.949 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.39205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39205.log.gz 2024-04-15T15:34:22.949 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34414.log 2024-04-15T15:34:22.950 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34518.log 2024-04-15T15:34:22.951 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33423.log: /var/log/ceph/ceph-client.admin.34414.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33423.log.gz 2024-04-15T15:34:22.951 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34331.log 2024-04-15T15:34:22.952 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34414.log.gz 2024-04-15T15:34:22.952 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35324.log 2024-04-15T15:34:22.952 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34518.log.gz 2024-04-15T15:34:22.953 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27498.log 2024-04-15T15:34:22.954 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34331.log.gz 2024-04-15T15:34:22.954 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34253.log 2024-04-15T15:34:22.955 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35324.log.gz 2024-04-15T15:34:22.955 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.27498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33730.log 2024-04-15T15:34:22.956 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27498.log.gz 2024-04-15T15:34:22.956 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34713.log 2024-04-15T15:34:22.957 INFO:teuthology.orchestra.run.smithi118.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-15T15:34:22.958 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34253.log.gz 2024-04-15T15:34:22.958 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33730.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33730.log.gz 2024-04-15T15:34:22.958 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36237.log 2024-04-15T15:34:22.959 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.34713.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40355.log 2024-04-15T15:34:22.959 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36237.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34713.log.gz 2024-04-15T15:34:22.960 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34711.log 2024-04-15T15:34:22.960 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36237.log.gz 2024-04-15T15:34:22.961 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40147.log 2024-04-15T15:34:22.961 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40355.log.gz 2024-04-15T15:34:22.962 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33501.log 2024-04-15T15:34:22.962 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34711.log.gz 2024-04-15T15:34:22.963 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37769.log 2024-04-15T15:34:22.963 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40147.log.gz 2024-04-15T15:34:22.964 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37892.log 2024-04-15T15:34:22.964 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33501.log.gz 2024-04-15T15:34:22.965 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36083.log 2024-04-15T15:34:22.966 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37769.log.gz 2024-04-15T15:34:22.966 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37892.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37892.log.gz 2024-04-15T15:34:22.966 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38761.log 2024-04-15T15:34:22.967 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.2.36083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33808.log 2024-04-15T15:34:22.967 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36083.log.gz 2024-04-15T15:34:22.969 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36653.log 2024-04-15T15:34:22.969 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38761.log.gz 2024-04-15T15:34:22.970 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38146.log 2024-04-15T15:34:22.970 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33808.log.gz 2024-04-15T15:34:22.970 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36653.log: /var/log/ceph/ceph-client.admin.35350.log 2024-04-15T15:34:22.971 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38146.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36653.log.gz 2024-04-15T15:34:22.971 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33704.log 2024-04-15T15:34:22.971 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38146.log.gz 2024-04-15T15:34:22.972 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35350.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-15T15:34:22.973 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35350.log.gz 2024-04-15T15:34:22.973 INFO:teuthology.orchestra.run.smithi118.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-15T15:34:22.974 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33704.log: /var/log/ceph/ceph-client.admin.33678.log 2024-04-15T15:34:22.974 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.3.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33704.log.gz 2024-04-15T15:34:22.974 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40303.log 2024-04-15T15:34:22.975 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41312.log 2024-04-15T15:34:22.977 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33678.log.gz 2024-04-15T15:34:22.977 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36835.log 2024-04-15T15:34:22.977 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40303.log.gz 2024-04-15T15:34:22.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36107.log 2024-04-15T15:34:22.978 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41312.log.gz 2024-04-15T15:34:22.979 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34096.log 2024-04-15T15:34:22.980 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36835.log.gz 2024-04-15T15:34:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33272.log 2024-04-15T15:34:22.981 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36107.log.gz 2024-04-15T15:34:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39018.log 2024-04-15T15:34:22.981 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34096.log.gz 2024-04-15T15:34:22.982 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40329.log 2024-04-15T15:34:22.982 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33272.log.gz 2024-04-15T15:34:22.983 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35662.log 2024-04-15T15:34:22.983 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39018.log.gz 2024-04-15T15:34:22.985 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40434.log 2024-04-15T15:34:22.985 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40329.log.gz 2024-04-15T15:34:22.985 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37691.log 2024-04-15T15:34:22.986 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35662.log.gz 2024-04-15T15:34:22.986 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40714.log 2024-04-15T15:34:22.987 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40434.log.gz 2024-04-15T15:34:22.988 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35143.log 2024-04-15T15:34:22.988 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37691.log.gz 2024-04-15T15:34:22.988 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38332.log 2024-04-15T15:34:22.989 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40714.log.gz 2024-04-15T15:34:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38715.log 2024-04-15T15:34:22.990 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35143.log.gz 2024-04-15T15:34:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38961.log 2024-04-15T15:34:22.993 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38332.log.gz 2024-04-15T15:34:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.38715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41132.log 2024-04-15T15:34:22.993 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38715.log.gz 2024-04-15T15:34:22.994 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38668.log 2024-04-15T15:34:22.994 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38961.log.gz 2024-04-15T15:34:22.995 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41132.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-15T15:34:22.995 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41132.log.gz 2024-04-15T15:34:22.996 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40583.log 2024-04-15T15:34:22.996 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38668.log.gz 2024-04-15T15:34:22.997 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35376.log 2024-04-15T15:34:22.998 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41106.log 2024-04-15T15:34:22.999 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40583.log.gz 2024-04-15T15:34:22.999 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35376.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35376.log.gz 2024-04-15T15:34:23.000 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35690.log 2024-04-15T15:34:23.001 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41106.log.gz 2024-04-15T15:34:23.002 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36393.log 2024-04-15T15:34:23.003 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38883.log 2024-04-15T15:34:23.003 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35690.log.gz 2024-04-15T15:34:23.004 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36393.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36393.log.gz 2024-04-15T15:34:23.004 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39881.log 2024-04-15T15:34:23.005 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33369.log 2024-04-15T15:34:23.005 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38883.log.gz 2024-04-15T15:34:23.006 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34923.log 2024-04-15T15:34:23.006 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39881.log.gz 2024-04-15T15:34:23.008 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38987.log 2024-04-15T15:34:23.008 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33369.log.gz 2024-04-15T15:34:23.009 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40199.log 2024-04-15T15:34:23.009 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34923.log.gz 2024-04-15T15:34:23.010 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38987.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38987.log.gz 2024-04-15T15:34:23.011 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38384.log 2024-04-15T15:34:23.011 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40199.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40199.log.gz 2024-04-15T15:34:23.012 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37135.log 2024-04-15T15:34:23.013 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34930.log 2024-04-15T15:34:23.013 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38384.log.gz 2024-04-15T15:34:23.014 INFO:teuthology.orchestra.run.smithi118.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-15T15:34:23.014 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37135.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37135.log.gz 2024-04-15T15:34:23.019 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34930.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34930.log.gz 2024-04-15T15:34:23.019 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36783.log 2024-04-15T15:34:23.019 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39694.log 2024-04-15T15:34:23.019 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36289.log 2024-04-15T15:34:23.019 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36783.log.gz 2024-04-15T15:34:23.020 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39694.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39694.log.gz 2024-04-15T15:34:23.020 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36289.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36289.log.gz 2024-04-15T15:34:23.021 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39829.log 2024-04-15T15:34:23.022 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33555.log 2024-04-15T15:34:23.023 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36471.log 2024-04-15T15:34:23.024 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39829.log.gz 2024-04-15T15:34:23.024 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33555.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33555.log.gz 2024-04-15T15:34:23.025 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36471.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36471.log.gz 2024-04-15T15:34:23.026 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37918.log 2024-04-15T15:34:23.027 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40609.log 2024-04-15T15:34:23.028 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37821.log 2024-04-15T15:34:23.028 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37918.log.gz 2024-04-15T15:34:23.030 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40609.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40609.log.gz 2024-04-15T15:34:23.030 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37821.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37821.log.gz 2024-04-15T15:34:23.031 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36211.log 2024-04-15T15:34:23.032 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36133.log 2024-04-15T15:34:23.033 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38855.log 2024-04-15T15:34:23.034 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36211.log.gz 2024-04-15T15:34:23.035 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36133.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36133.log.gz 2024-04-15T15:34:23.036 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38855.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38855.log.gz 2024-04-15T15:34:23.036 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34544.log 2024-04-15T15:34:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36159.log 2024-04-15T15:34:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34466.log 2024-04-15T15:34:23.038 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34544.log.gz 2024-04-15T15:34:23.040 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36159.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36159.log.gz 2024-04-15T15:34:23.041 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34466.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34466.log.gz 2024-04-15T15:34:23.041 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33860.log 2024-04-15T15:34:23.042 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38224.log 2024-04-15T15:34:23.044 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40069.log 2024-04-15T15:34:23.045 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38224.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33860.log.gz 2024-04-15T15:34:23.045 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38224.log.gz 2024-04-15T15:34:23.046 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40069.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40069.log.gz 2024-04-15T15:34:23.046 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34715.log 2024-04-15T15:34:23.047 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39416.log 2024-04-15T15:34:23.049 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35610.log 2024-04-15T15:34:23.049 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34715.log.gz 2024-04-15T15:34:23.052 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39416.log: /var/log/ceph/ceph-client.admin.35610.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39416.log.gz 2024-04-15T15:34:23.052 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35610.log.gz 2024-04-15T15:34:23.052 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37161.log 2024-04-15T15:34:23.053 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-15T15:34:23.054 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33475.log 2024-04-15T15:34:23.054 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37161.log.gz 2024-04-15T15:34:23.055 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39668.log 2024-04-15T15:34:23.055 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33475.log: 85.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-15T15:34:23.056 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33475.log.gz 2024-04-15T15:34:23.057 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37535.log 2024-04-15T15:34:23.058 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39668.log.gz 2024-04-15T15:34:23.059 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34383.log 2024-04-15T15:34:23.060 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41080.log 2024-04-15T15:34:23.060 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37535.log.gz 2024-04-15T15:34:23.060 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34383.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34383.log.gz 2024-04-15T15:34:23.061 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41080.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41080.log.gz 2024-04-15T15:34:23.062 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41286.log 2024-04-15T15:34:23.063 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38735.log 2024-04-15T15:34:23.064 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39218.log 2024-04-15T15:34:23.065 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41286.log.gz 2024-04-15T15:34:23.066 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38735.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38735.log.gz 2024-04-15T15:34:23.066 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39218.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39218.log.gz 2024-04-15T15:34:23.067 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38909.log 2024-04-15T15:34:23.068 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37320.log 2024-04-15T15:34:23.069 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40408.log 2024-04-15T15:34:23.070 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38909.log.gz 2024-04-15T15:34:23.071 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37320.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37320.log.gz 2024-04-15T15:34:23.072 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40408.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40408.log.gz 2024-04-15T15:34:23.072 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34932.log 2024-04-15T15:34:23.073 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40950.log 2024-04-15T15:34:23.075 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36921.log 2024-04-15T15:34:23.075 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34932.log.gz 2024-04-15T15:34:23.076 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40872.log 2024-04-15T15:34:23.076 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40950.log.gz 2024-04-15T15:34:23.077 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36921.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36921.log.gz 2024-04-15T15:34:23.077 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33527.log 2024-04-15T15:34:23.078 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40872.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.40872.log.gz -5 2024-04-15T15:34:23.078 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36731.log 2024-04-15T15:34:23.079 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35428.log 2024-04-15T15:34:23.079 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33527.log.gz 2024-04-15T15:34:23.081 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36731.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36731.log.gz 2024-04-15T15:34:23.081 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33834.log 2024-04-15T15:34:23.082 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35428.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35428.log.gz 2024-04-15T15:34:23.082 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41028.log 2024-04-15T15:34:23.083 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39720.log 2024-04-15T15:34:23.084 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33834.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33834.log.gz 2024-04-15T15:34:23.085 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41028.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41028.log.gz 2024-04-15T15:34:23.085 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37665.log 2024-04-15T15:34:23.086 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39720.log: gzip -5 --verbose 88.3% -- /var/log/ceph/ceph-client.admin.38250.log -- replaced with /var/log/ceph/ceph-client.admin.39720.log.gz 2024-04-15T15:34:23.086 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-04-15T15:34:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39987.log 2024-04-15T15:34:23.088 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37665.log.gz 2024-04-15T15:34:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38250.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38250.log.gz 2024-04-15T15:34:23.089 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39987.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39987.log.gz 2024-04-15T15:34:23.090 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35636.log 2024-04-15T15:34:23.091 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35716.log 2024-04-15T15:34:23.093 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37351.log 2024-04-15T15:34:23.093 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35636.log.gz 2024-04-15T15:34:23.093 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35716.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35716.log.gz 2024-04-15T15:34:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37351.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37351.log.gz 2024-04-15T15:34:23.095 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34720.log 2024-04-15T15:34:23.096 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39466.log 2024-04-15T15:34:23.098 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38514.log 2024-04-15T15:34:23.098 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34720.log.gz 2024-04-15T15:34:23.099 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40661.log 2024-04-15T15:34:23.099 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39466.log.gz 2024-04-15T15:34:23.100 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33910.log 2024-04-15T15:34:23.100 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38514.log.gz 2024-04-15T15:34:23.101 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40661.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40661.log.gz 2024-04-15T15:34:23.102 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40531.log 2024-04-15T15:34:23.102 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33910.log.gz 2024-04-15T15:34:23.103 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35834.log 2024-04-15T15:34:23.104 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-04-15T15:34:23.104 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40531.log.gz 2024-04-15T15:34:23.106 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35834.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35834.log.gz 2024-04-15T15:34:23.106 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34596.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gz 2024-04-15T15:34:23.107 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34174.log 2024-04-15T15:34:23.108 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39096.log 2024-04-15T15:34:23.110 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34174.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-15T15:34:23.110 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34174.log.gz 2024-04-15T15:34:23.111 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37613.log 2024-04-15T15:34:23.111 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39096.log.gz 2024-04-15T15:34:23.113 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.37613.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-15T15:34:23.113 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37613.log.gz 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-15T15:34:23.113 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-04-15T15:34:23.114 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40740.log 2024-04-15T15:34:23.115 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34570.log 2024-04-15T15:34:23.116 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40740.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40740.log.gz 2024-04-15T15:34:23.117 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34570.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34570.log.gz 2024-04-15T15:34:23.118 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40277.log 2024-04-15T15:34:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38540.log 2024-04-15T15:34:23.121 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40277.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40277.log.gz 2024-04-15T15:34:23.121 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38540.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38540.log.gz 2024-04-15T15:34:23.122 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-15T15:34:23.123 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39122.log 2024-04-15T15:34:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.39122.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39122.log.gz 2024-04-15T15:34:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35968.log 2024-04-15T15:34:23.129 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.35968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35968.log.gz 2024-04-15T15:34:23.129 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38041.log 2024-04-15T15:34:23.135 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38041.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38041.log.gz 2024-04-15T15:34:23.135 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37190.log 2024-04-15T15:34:23.135 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37190.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37190.log.gz 2024-04-15T15:34:23.135 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36315.log 2024-04-15T15:34:23.138 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36315.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36315.log.gz 2024-04-15T15:34:23.138 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34226.log 2024-04-15T15:34:23.141 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34226.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34226.log.gz 2024-04-15T15:34:23.141 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35768.log 2024-04-15T15:34:23.144 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35768.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35768.log.gz 2024-04-15T15:34:23.145 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37057.log 2024-04-15T15:34:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37587.log 2024-04-15T15:34:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37057.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37057.log.gz 2024-04-15T15:34:23.150 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37587.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37587.log.gz 2024-04-15T15:34:23.150 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36757.log 2024-04-15T15:34:23.153 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36757.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36757.log.gz 2024-04-15T15:34:23.153 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37481.log 2024-04-15T15:34:23.154 INFO:teuthology.orchestra.run.smithi073.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-15T15:34:23.155 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2024-04-15T15:34:23.156 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37481.log: 91.2% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37481.log.gz 2024-04-15T15:34:23.156 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-15T15:34:23.157 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38276.log 2024-04-15T15:34:23.158 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35142.log 2024-04-15T15:34:23.158 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gz 2024-04-15T15:34:23.159 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36895.log 2024-04-15T15:34:23.159 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38276.log.gz 2024-04-15T15:34:23.160 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35142.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35142.log.gz 2024-04-15T15:34:23.161 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36895.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36895.log.gz 2024-04-15T15:34:23.162 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37000.log 2024-04-15T15:34:23.163 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34724.log 2024-04-15T15:34:23.166 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34440.log 2024-04-15T15:34:23.166 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37000.log.gz 2024-04-15T15:34:23.166 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34724.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34724.log.gz 2024-04-15T15:34:23.166 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34440.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34440.log.gz 2024-04-15T15:34:23.167 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36419.log 2024-04-15T15:34:23.168 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36185.log 2024-04-15T15:34:23.170 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37083.log 2024-04-15T15:34:23.170 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36419.log.gz 2024-04-15T15:34:23.171 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35480.log 2024-04-15T15:34:23.171 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36185.log.gz 2024-04-15T15:34:23.171 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34933.log 2024-04-15T15:34:23.172 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37083.log.gz 2024-04-15T15:34:23.173 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35480.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35480.log.gz 2024-04-15T15:34:23.173 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38015.log 2024-04-15T15:34:23.174 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34933.log.gz 2024-04-15T15:34:23.174 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35136.log 2024-04-15T15:34:23.176 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35742.log 2024-04-15T15:34:23.176 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38015.log.gz 2024-04-15T15:34:23.177 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35136.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35136.log.gz 2024-04-15T15:34:23.177 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36523.log 2024-04-15T15:34:23.178 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35742.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35742.log.gz 2024-04-15T15:34:23.178 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36974.log 2024-04-15T15:34:23.180 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37031.log 2024-04-15T15:34:23.180 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36523.log.gz 2024-04-15T15:34:23.181 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36974.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36974.log.gz 2024-04-15T15:34:23.182 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37031.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37031.log.gz 2024-04-15T15:34:23.182 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40820.log 2024-04-15T15:34:23.183 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40251.log 2024-04-15T15:34:23.185 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34727.log 2024-04-15T15:34:23.185 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40820.log.gz 2024-04-15T15:34:23.186 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40251.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40251.log.gz 2024-04-15T15:34:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34727.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34727.log.gz 2024-04-15T15:34:23.188 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36601.log 2024-04-15T15:34:23.189 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39070.log 2024-04-15T15:34:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37377.log 2024-04-15T15:34:23.190 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36601.log.gz 2024-04-15T15:34:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37866.log 2024-04-15T15:34:23.192 INFO:teuthology.orchestra.run.smithi073.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39070.log.gz 2024-04-15T15:34:23.192 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37561.log 2024-04-15T15:34:23.192 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37377.log.gz 2024-04-15T15:34:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37866.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37866.log.gz 2024-04-15T15:34:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37294.log 2024-04-15T15:34:23.195 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37561.log.gz 2024-04-15T15:34:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36445.log 2024-04-15T15:34:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-04-15T15:34:23.197 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37294.log.gz 2024-04-15T15:34:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36445.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36445.log.gz 2024-04-15T15:34:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41236.log 2024-04-15T15:34:23.199 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz 2024-04-15T15:34:23.200 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38618.log 2024-04-15T15:34:23.201 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40013.log 2024-04-15T15:34:23.202 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41236.log.gz 2024-04-15T15:34:23.203 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38720.log 2024-04-15T15:34:23.203 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-15T15:34:23.204 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40013.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38618.log.gz 2024-04-15T15:34:23.204 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40013.log.gz 2024-04-15T15:34:23.205 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.38720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38720.log.gz 2024-04-15T15:34:23.205 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38935.log 2024-04-15T15:34:23.206 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34279.log 2024-04-15T15:34:23.207 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40635.log 2024-04-15T15:34:23.207 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38935.log.gz 2024-04-15T15:34:23.208 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39855.log 2024-04-15T15:34:23.208 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34279.log.gz 2024-04-15T15:34:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38488.log 2024-04-15T15:34:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39855.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40635.log.gz 2024-04-15T15:34:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39390.log 2024-04-15T15:34:23.211 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39855.log.gz 2024-04-15T15:34:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38566.log 2024-04-15T15:34:23.211 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38488.log.gz 2024-04-15T15:34:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37717.log 2024-04-15T15:34:23.213 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39390.log.gz 2024-04-15T15:34:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34122.log 2024-04-15T15:34:23.214 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38566.log.gz 2024-04-15T15:34:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39340.log 2024-04-15T15:34:23.214 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37717.log.gz 2024-04-15T15:34:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34917.log 2024-04-15T15:34:23.216 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34122.log.gz 2024-04-15T15:34:23.217 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38094.log 2024-04-15T15:34:23.218 INFO:teuthology.orchestra.run.smithi073.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39340.log.gz 2024-04-15T15:34:23.218 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40486.log 2024-04-15T15:34:23.225 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34917.log.gz 2024-04-15T15:34:23.225 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34674.log 2024-04-15T15:34:23.225 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38094.log.gz 2024-04-15T15:34:23.225 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40486.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22690.log 2024-04-15T15:34:23.225 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40486.log.gz 2024-04-15T15:34:23.225 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39555.log 2024-04-15T15:34:23.225 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34674.log.gz 2024-04-15T15:34:23.226 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.tmp-client.admin.22690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34492.log 2024-04-15T15:34:23.226 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22690.log.gz 2024-04-15T15:34:23.226 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40095.log 2024-04-15T15:34:23.226 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39555.log.gz 2024-04-15T15:34:23.226 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34492.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34492.log.gz 2024-04-15T15:34:23.226 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35950.log 2024-04-15T15:34:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34920.log 2024-04-15T15:34:23.228 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40095.log.gz 2024-04-15T15:34:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.35950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35950.log.gz 2024-04-15T15:34:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39044.log 2024-04-15T15:34:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41054.log 2024-04-15T15:34:23.228 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34920.log.gz 2024-04-15T15:34:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36263.log 2024-04-15T15:34:23.229 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39044.log.gz 2024-04-15T15:34:23.230 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41054.log: /var/log/ceph/ceph-client.admin.36263.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41054.log.gz 2024-04-15T15:34:23.230 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36263.log.gz 2024-04-15T15:34:23.537 INFO:teuthology.orchestra.run.smithi118.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-15T15:34:23.598 INFO:teuthology.orchestra.run.smithi073.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-15T15:34:23.615 INFO:teuthology.orchestra.run.smithi118.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-15T15:34:23.616 INFO:teuthology.orchestra.run.smithi118.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-15T15:34:23.621 INFO:teuthology.orchestra.run.smithi118.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-15T15:34:23.623 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-04-15T15:34:23.623 INFO:teuthology.orchestra.run.smithi118.stderr:real 0m0.785s 2024-04-15T15:34:23.623 INFO:teuthology.orchestra.run.smithi118.stderr:user 0m2.964s 2024-04-15T15:34:23.624 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m0.314s 2024-04-15T15:34:23.629 INFO:teuthology.orchestra.run.smithi073.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-15T15:34:23.713 INFO:teuthology.orchestra.run.smithi073.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-15T15:34:23.727 INFO:teuthology.orchestra.run.smithi073.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-15T15:34:23.728 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-04-15T15:34:23.728 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m0.908s 2024-04-15T15:34:23.729 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m3.486s 2024-04-15T15:34:23.729 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m0.694s 2024-04-15T15:34:23.730 INFO:tasks.ceph:Archiving logs... 2024-04-15T15:34:23.730 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/remote/smithi073/log 2024-04-15T15:34:23.732 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T15:34:24.421 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/remote/smithi118/log 2024-04-15T15:34:24.422 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T15:34:24.799 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-15T15:34:24.810 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-15T15:34:24.810 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T15:34:24.813 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T15:34:24.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-15T15:34:24.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-15T15:34:24.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-15T15:34:24.897 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-15T15:34:24.907 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-15T15:34:24.908 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T15:34:24.911 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T15:34:24.924 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-04-15T15:34:24.924 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-04-15T15:34:24.924 INFO:teuthology.orchestra.run.smithi073.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 177 0.078 -1.960 2.201 2024-04-15T15:34:24.924 INFO:teuthology.orchestra.run.smithi073.stdout:*hv02.front.sepi 63.231.80.2 3 u 30 64 177 0.085 -1.828 2.534 2024-04-15T15:34:24.924 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 27 64 177 0.091 -1.836 2.143 2024-04-15T15:34:24.924 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-15T15:34:24.926 INFO:teuthology.orchestra.run.smithi118.stdout: remote refid st t when poll reach delay offset jitter 2024-04-15T15:34:24.926 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================== 2024-04-15T15:34:24.927 INFO:teuthology.orchestra.run.smithi118.stdout:+hv01.front.sepi 67.205.162.81 3 u 30 64 177 0.129 -2.444 1.242 2024-04-15T15:34:24.927 INFO:teuthology.orchestra.run.smithi118.stdout:*hv02.front.sepi 63.231.80.2 3 u 23 64 177 0.109 +0.702 1.155 2024-04-15T15:34:24.927 INFO:teuthology.orchestra.run.smithi118.stdout:+hv03.front.sepi 74.6.168.72 3 u 20 64 177 0.148 -0.137 1.156 2024-04-15T15:34:24.927 INFO:teuthology.orchestra.run.smithi118.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-15T15:34:24.927 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-15T15:34:24.961 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-15T15:34:24.961 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-15T15:34:24.970 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-15T15:34:24.982 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-15T15:34:24.992 INFO:teuthology.task.internal:Duration was 885.483880 seconds 2024-04-15T15:34:24.992 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-15T15:34:25.002 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-15T15:34:25.002 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T15:34:25.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T15:34:25.089 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-15T15:34:25.089 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-04-15T15:34:25.089 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T15:34:25.110 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2024-04-15T15:34:25.110 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T15:34:25.130 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-15T15:34:25.131 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T15:34:25.157 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T15:34:25.207 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-15T15:34:25.208 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T15:34:25.238 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T15:34:25.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-15T15:34:25.330 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-15T15:34:25.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T15:34:25.351 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T15:34:25.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-15T15:34:25.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T15:34:25.401 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T15:34:25.415 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-04-15T15:34:25.432 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2024-04-15T15:34:25.450 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T15:34:25.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:34:25.485 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T15:34:25.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:34:25.498 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-15T15:34:25.509 INFO:teuthology.task.internal:Transferring archived files... 2024-04-15T15:34:25.510 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/remote/smithi073 2024-04-15T15:34:25.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T15:34:25.553 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149/remote/smithi118 2024-04-15T15:34:25.554 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T15:34:25.580 INFO:teuthology.task.internal:Removing archive directory... 2024-04-15T15:34:25.580 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T15:34:25.593 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T15:34:25.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-15T15:34:25.641 INFO:teuthology.task.internal:Not uploading archives. 2024-04-15T15:34:25.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-15T15:34:25.652 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-15T15:34:25.652 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T15:34:25.656 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T15:34:25.661 INFO:teuthology.orchestra.run.smithi073.stdout: 658121 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 15:34 /home/ubuntu/cephtest 2024-04-15T15:34:25.675 INFO:teuthology.orchestra.run.smithi118.stdout: 658123 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 15:34 /home/ubuntu/cephtest 2024-04-15T15:34:25.677 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-15T15:34:25.688 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-15T15:34:25.709 INFO:teuthology.nuke:Checking targets against current locks 2024-04-15T15:34:25.735 DEBUG:teuthology.nuke:shortname: smithi073 2024-04-15T15:34:25.735 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T15:34:25.759 DEBUG:teuthology.nuke:shortname: smithi118 2024-04-15T15:34:25.759 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T15:34:25.764 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 15:08:42.362777', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP1yFPtNF4djnER2a5Tzj8HISpSxE2ok0zR9L2l4VyzfhRoRvmw2aI6dyBxFOcpTYbp+gzX6e4WOksp1idelL28='} 2024-04-15T15:34:25.792 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-15_14:54:08-fs-wip-lusov-quiesce-xlock-distro-default-smithi/7657149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 15:08:42.360860', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbsZRMhhQTg2OkI3DiREEAPxKc834j7fqByWOCKhckGRXPuwOMkjZ42tBj+67zXyu8FZWM7Ph+skG80R37dbqU='} 2024-04-15T15:34:25.823 INFO:teuthology.orchestra.console.smithi073:Power off 2024-04-15T15:34:25.824 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T15:34:25.848 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-04-15T15:34:25.849 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:34:25.868 INFO:teuthology.orchestra.console.smithi118:Power off 2024-04-15T15:34:25.868 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T15:34:25.878 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-15T15:34:25.891 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2024-04-15T15:34:25.892 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:34:25.916 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-04-15T15:34:29.880 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:34:29.917 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:34:29.991 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-15T15:34:30.029 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-04-15T15:34:33.994 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:34:34.030 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:34:34.105 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-04-15T15:34:34.139 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-04-15T15:34:34.240 INFO:teuthology.orchestra.console.smithi118:Power off completed 2024-04-15T15:34:38.106 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:34:38.218 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-04-15T15:34:38.318 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-04-15T15:34:38.424 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 client.1-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/quiesce} duration: 885.4838795661926 failure_reason: 'Test failure: test_quiesce_blocked (tasks.cephfs.test_quiesce.TestQuiesce)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f854d3ea6fc14274971dec34263b56fe status: fail success: false 2024-04-15T15:34:38.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:34:38.508 INFO:teuthology.run:FAIL